Alternatives to Scrapy for web scraping in 2023
We compared Scrapy with 5 alternatives for web scraping in both Python and JavaScript. Which one will you try next?
Category
Web Crawling
Web crawling is what fuels search engines, such as Google. Learn about Apify's web crawlers to help you with your crawling projects.
16 Posts
What are web crawlers and how do they work?
A quick introduction to web crawlers and how to get started building your own crawlers for web scraping.
Top 11 open source web crawlers - and one powerful web scraper
Learn about free software libraries, packages, and SDKs that can get your web crawling journey started in no time.
The definitive guide to text scraping
Text scraping and computational text mining and analysis methods are becoming increasingly popular among students, scholars, and researchers in multiple academic fields. We show you how to extract text data from websites with Smart Article Extractor.
How to scrape Google search results (SERPs)
Find out how you can scrape Google Search result pages (SERPs) and extract reviews, organic and paid results, ads, prices, People Also Ask, and more.
Announcing Crawlee: the web scraping and browser automation library
Crawlee is an open-source web scraping and automation library that helps you build reliable scrapers. Fast.
Bots and automation tools: are they friends or enemies?
BOTS is a four-letter word. But do bots deserve all the bad rap? We explain the difference between good and bad bots, how to use the good ones, and how to protect yourself against the bad ones.
Powerful tool to check broken links on any website
Read on how and why using a free broken links checker can keep your SEO score healthy.
Web crawling vs. web scraping: what is the difference?
Want to learn about web scraping and how it differs from web crawling? Read on to understand web crawling vs. web scraping and how web scraping can create an API for any website.
