Web Scraping

Read about everything related to web scraping and web crawling, with content ranging from beginner to advanced web scraping god.
122 posts
Web Scraping
Latest Posts
Building functional AI models for web scraping
AI

Building functional AI models for web scraping

Natasha Lekh
Natasha Lekh
Combining machine learning and web scraping is a natural next step in web automation. Let's explore how this comes into reality with three AI-based web scraping projects: Product Mapping, Automated Product Detail Extraction, and Browser Fingerprint Generator.
9 min read
How to scrape Google Shopping
Tutorial

How to scrape Google Shopping

Mariachiara Faraon
Mariachiara Faraon
Google Shopping enables users to search for products across different vendors and websites, and easily compare product details. Read more about the benefits of scraping Google Shopping and how to do it in this easy tutorial.
4 min read
How web scraping is bridging language barriers
Education

How web scraping is bridging language barriers

Theo Vasilis
Theo Vasilis
When a research team set out to build a machine translation module for Syrian and Moroccan migrants and refugees, it faced a significant challenge: how do you get enough data for dialects used only in casual conversation? This is how web scraping became the solution.
4 min read
Is web scraping legal?
Web Scraping

Is web scraping legal?

Ondra Urban
Ondra Urban
Web scraping is legal if you scrape data publicly available on the internet. But you should avoid scraping personal data or intellectual property. We cover the confusion surrounding the legality of web scraping and give you tips for compliant and ethical scrapers.
17 min read
Great! Next, complete checkout for full access to Apify
Welcome back! You've successfully signed in
You've successfully subscribed to Apify
Success! Your account is fully activated, you now have access to all content
Success! Your billing info has been updated
Your billing was not updated