Web Scraping

EU Commission + Apify fight fake discounts in Europe

Case studies

Web scraping

Black Friday

How web scraping, AI, and the European Commission have come together to sweep away fake discounts in Europe

Even if you didn’t know it, before the COVID-19 pandemic, another plague was sweeping Europe, and it’s still prevalent today: fake discounts.

Theo Vasilis

Jan 24, 2023

Datacenter proxies: when to use them and how to make the most of them

Proxy

Web scraping

Datacenter proxies: when to use them and how to make the most of them

Datacenter proxies are faster, more stable, and way cheaper than other proxy types. Find out how to use them properly to avoid getting blocked when web scraping.

Theo Vasilis

Jan 23, 2023

What are web crawlers and how do they work?

Web crawling

SEO

Google

What are web crawlers and how do they work?

Learn what web crawlers are, how they work, their role in indexing the internet for Google, and how to build your own. Includes essential web crawling tips.

Theo Vasilis

Jan 23, 2023

Web scraping

COVID-19

What's the future of web scraping in 2023?

Let’s see what web scraping was like in 2022 from technical, legal, business, and trending perspectives, as well as try predicting what 2023 holds.

Natasha Lekh

Jan 20, 2023

Web scraping

How to scale Puppeteer and Playwright

Scaling web scrapers horizontally across multiple containers for optimal concurrency. Tips and advice for large-scale scraping projects using Puppeteer or Playwright.

Lukáš Křivka

Dec 14, 2022

Comparison

AWS Lambda

Web scraping

Web scraping with AWS Lambda vs. Apify: what are the differences?

In the tech world, can David compete with Goliath? Let’s find out how Apify fares as an AWS Lambda alternative for web scraping.

Theo Vasilis

Nov 14, 2022

Law

Web scraping

Developments in the hiQ v. LinkedIn case

What does the new judgment in the case of hiQ Labs, Inc. v LinkedIn Corp mean for web data extraction? We investigate the latest developments and explain the current legal status of web scraping ⚖️

Lucie Růžičková

Nov 11, 2022

Web scraping

Law

What is ethical web scraping and how do you do it? ⚖️ 5 principles of web scraping ethics

With great data comes great responsibility. Whether you’re a web scraper developer or a website owner, you should know these 5 principles of web scraping ethics.

Theo Vasilis

Oct 20, 2022

Tutorial

Amazon

Pricing strategy

How to scrape data on Amazon Best Sellers

A quick guide to extracting data on Amazon Best Sellers with Amazon API made by Apify.

Natasha Lekh

Oct 12, 2022

Web scraping

Amazon

Ecommerce

How to scrape Amazon reviews in under a minute

This simple tutorial shows you how to scrape Amazon reviews in no time. Download your data in 6 formats for sentiment analysis or competitor monitoring.

Theo Vasilis

Oct 4, 2022

Web scraping

Tutorial

Beginner's guide to web scraping

How can a beginner start web scraping with Apify? Tips on planning your web scraping project and 4 ways to get started.

David Barton

Sep 30, 2022

Web

Web scraping

Data extraction

What is a web ripper? Top 5 website ripper tools (but we’re hiding something)

If you wish to migrate your website to a new server, keep a copy of your site as a backup, or use web data for educational purposes, these powerful site rippers and website ripper tools might be what you need.

Theo Vasilis

Sep 19, 2022

Data extraction

Web scraping

Business

Why do businesses need data extraction?

Data extraction turns semi-structured and unstructured data into fully structured data and provides helpful insights for reporting and analytics. Find out how data extraction works and its benefits for your business.

Guest Author

Aug 23, 2022

Apify updates

Web scraping

Web crawling

Announcing Crawlee: the web scraping and browser automation library

Crawlee is an open-source web scraping and automation library that helps you build reliable scrapers. Fast.

Percival Villalva

Aug 11, 2022

Proxy

Web scraping

7 best proxy scraper services in 2023

Other than protecting your identity, using a proxy server can bring about many benefits. What are they, and which are the best proxies to use?

Dávid Lukáč

Jul 5, 2022

Business

Pricing strategy

Lead generation

5 best practices of web scraping for improving your business

Discover how web scraping technologies can facilitate lead generation, market and product research, and competitive intelligence on the web.

Natasha Lekh

Jul 4, 2022

Bots

Automation

Web scraping

Bots and automation tools: are they friends or enemies?

BOTS is a four-letter word. But do bots deserve all the bad rap? We explain the difference between good and bad bots, how to use the good ones, and how to protect yourself against the bad ones.

Guest Author

Jul 3, 2022

Engineering

Web scraping

How to use web scraping to find and buy the perfect bike

Finding the perfect bike can be made easier with web scraping and automation tools. Join Pavel as he uses the Apify platform to get his dream bikes and the gear to go with them.

Pavel Dolecek

Jun 30, 2022