The 11 best web scraping tools (2024)
Platforms, APIs, or no-code scrapers—whatever you prefer, you'll find them in this list of top scraping tools.
102 Posts
How to handle forms and authentication in Scrapy
Learn how to use Scrapy to deal with complex login forms and token authentication
MechanicalSoup: a good Python tool for web scraping?
Learn how MechanicalSoup compares with other Python tools like BeautifulSoup and Selenium
Playwright vs. Cypress
Features, pros, and cons to help you choose between these two web testing frameworks.
Scaling email marketing and lead generation with itrinity and Apify
How itrinity uses Apify to take its email verification and outreach strategies to another level.
8 open-source LangChain alternatives
LangChain is a powerful framework for developing LLM apps, but it's not without its disadvantages. So what are the alternatives?
Web scraping HTML tables with Python
I scraped HTML tables from Yahoo Finance with Pandas, and I didn't even need to open DevTools!
Data provenance: how to apply it to scraped data
Did you know that web scraping platforms can aid in capturing essential data provenance information?
Python CSS selectors and how to use them
A short guide to using CSS selectors with Selenium and Beautiful Soup.
What is data parsing? Process, techniques, tools, and use cases
Discover all you need to know about data parsing. Learn how it works, common techniques, popular tools, and uses.
The definitive guide to text scraping
How to extract text data from URLs and PDFs for text mining and analysis.
Best ScrapingBee alternatives
Discover the pros and cons of 10 ScrapingBee alternatives in this comparative review.
How to extract and download news articles online
Want to download multiple online articles for text research? Here's the quickest and easiest way to get the job done.
Why companies are scraping Google Maps plus the 5 best Google Maps scrapers
We provide you with the top 5 Google Maps scrapers for your business.
Rotating proxies: why you need them for web scraping
Web scraping without proxy rotation? Good luck! But even that isn't enough to not get blocked.
Scrapy vs. Selenium: how to choose between them for web scraping
What are Scrapy and Selenium good for? When should you opt for one over the other?
Pagination in Python: how to scrape a paginated website
Learn to build a scraper with Beautiful Soup to scrape paginated sites and deploy it to the cloud.
Data parsing with regex: when and when not to use regular expressions for data extraction
Learn about using regular expressions for data parsing and when to avoid them.