🚀 Grab 10% off on all plans. Apply code WELCOME2026 at checkout. 🚀

Learn More

Add Your Heading Text Here

Login
Get free trial
Darshan Khandelwal

Darshan Khandelwal

Twitter Linkedin-in Medium-m

Chief of Technology at Scrapingdog. Every new bug comes under my to-do list. Writing is not something I’m into, but I share my insights through the blogs I write. Coding is what I love to do. Happy to connect with you on my social handle!

Challenges in Web Scraping

Latest

7 Challenges in Large Scale Web Scraping & How To Overcome Them

In this read, we have listed out some of the challenges that you may have during large scale data extraction. You can build a hassle free data pipeline using a Web Scraping API.
Read More
Build Amazon Price Tracker using Python

Build Amazon Price Tracker using Python (Get Email Alerts on Price Drop)

In this article, we will learn how to build an Amazon price tracker using Python, to keep an eye on our favorite product. When the price drops, the system is built to send us alerts.
Read More
C# web scraping

A Comprehensive Guide on Web Scraping with C#

In this blog, we have discussed how you can scrape LinkedIn profiles using Python.
Read More
Scraping Email from any website

How To Scrape Email Addresses From Any Website

In this blog, we have explained how you can scrape email address from websites. We have used Google Sheets and scraped Google search results to get the email data.
Read More
how to use proxy with python requests

How To Use A Proxy With Python Requests

We will learn, how to use a proxy request with Python. Further, we have told, how you can use Scrapingdog rotating proxies with Python requests.
Read More
User Agents in Web Scraping

A Complete Guide on User-Agents in Web Scraping (+Best User-Agent List)

In this comprehensive tutorial we have discussed what are user agents in web scraping, how to use them effectively and why you should use them when scraping.
Read More
Scraping LinkedIn Jobs

Scrape LinkedIn Jobs using Python (Save Data in CSV)

In this blog, we are going to scrape linkedin Jobs using Python. Further, you can use Scrapingdog's LinkedIn Jobs API to scale this process. We have saved the scraped data in a CSV file.
Read More