🚀 New: ChatGPT Scraper API — Run prompts & get structured JSON responses

Try it now
Login
Get API Key
Manthan Koolwal

Manthan Koolwal

Twitter Linkedin-in Medium-m

I am the founder of Scrapingdog, with blogs I write on here, I try to give unique ideas that you can use while scraping. Each blog is a recipe blended with my experience in this domain. Now I am not an expert, since it is a vast field, it keeps growing, and I just write what I have learned. And if you like my work, do share on social media.

how to setup proxy in puppeteer

Latest

How To Use Proxy in Puppeteer (A Complete Guide)

In this read, we have set up a proxy in Puppeteer to bypass IP bans, used proxy authentication, and rotated proxies for efficient, undetected web scraping.
Read More
scrape yelp

How To Scrape Yelp Data using Python

In this tutorial, we are going to extract data from a business listing on Yelp using Python.
Read More
best brightdata alternatives

5 Bright Data Alternatives for Web Scraping

In this blog, we have listed 5 alternatives of Bright Data. All of them are economical to Brightdata, you can test them all for free to see which one fits best.
Read More
scrape linkedin profiles using python

Scrape Linkedin Profiles using Python

In this blog, we have discussed how you can scrape LinkedIn profiles using Python.
Read More
cloudscraper

How To Scrape Website with Cloudscraper in Python & Fix Common Errors

Cloudscraper can be used to bypass cloudflare protection while web scraping. In this guide, you will learn how to effectively use it & what are its limitations.
Read More
Automate Summarizing Scholarly article with Scrapingdog Google Scholar API & Open AI

Automating Scraping & Summarizing Research Papers with Python & OpenAI

In this article, we have scraped relevant researches from Google scholars, summarized them using Python, Open AI & Scrapingdog Google Scholar API.
Read More
scraping google trends

Scraping Google Trends using Nodejs (Storing Data in CSV)

Learn how to scrape Google Trends using Node.js and Scrapingdog API. Export data to CSV, visualize trends with charts, and analyze results step by step guide.
Read More