Web scraping

Learn how to use web scraping to monitor your own website, keep an eye on competitors, perform SEO audits, and scrape Google.

How much do you know about captchas? Why do we need them, are there alternatives, and do they even still work on the modern web? Read our exploration of the CAPTCHA, how it fails on multiple fronts, and how it might even result in some exploitative practices across the world.

Take a look at the main roadblocks that product development teams are facing and go over actionable tips that’ll help business owners and software developers quickly develop high-quality products.

How to web scrape your target audience to generate leads and analyze data to get actionable insights for your marketing strategies and campaigns.

What technologies might be able to benefit or revolutionize fintech? Is there a role for web scraping in fintech?

Building open source does not pay much. Running SaaS is still complicated. We have a better way to let you make money from your hobby.

Today, we’re launching the largest Apify update this year: a new billing system with new monthly and annual plans, flexible pay-as-you-go…

Some old tricks and deceptive practices, but two e-shops have seen the light and are being honest with their customers — with our help.

Apify aggregates data from official coronavirus stats in 50 countries. Find out how we created an automated, open-source scraping solution.

Results of our annual Black Friday 2020 analysis for Czechia. Improvements in discounts, but some still misleading. In Czech language only.

Web scraping is driving four big revolutions in the real estate industry: business intelligence, investment, marketing, and PropTech.

We calculated the standard deviation of bids placed by devs on Apify Marketplace and were surprised to find price convergence over time.

13 ways the media can use scraping, data, and RPA to track new trends, automate grunt work, make better content, and even fight fake news.

Indeed is a website devoted to helping people get the jobs they want. Web scraping Indeed enables you to extend the official API.

How to keep ahead of the competition by using web scraping to monitor prices, track product performance, and keep your listings up to date.

Learn about modern web scraping protection techniques and how to bypass them. Scrape up to three times more pages by combining IP address rotation with shared IP address emulation.

At Apify, we have taken up the ambitious task of making the web more open.

What’s new at Apify? Read on to find out. And for the latest news, follow us on Twitter.