Web scraping

Since the launch of Apify actors last autumn, Apify is no longer just a tool to extract data from websites. It has become a full-featured serverless computing platform that enables people to automate workflows on the web, run data processing pipelines or integrate with third-party systems.

The new HTTP proxy endpoint provides access to Apify’s large pool of proxies, with intelligent IP address rotation and health checks.

Web scraping in 2018 is not only about processing HTML. Learn modern ways to extract data from web pages using XHRs, Schema.org Microdata, JSON Linked Data, JavaScript variables and more.

Find out how Realitio uses Apify to create a real estate listings aggregator that helps people find their next home.

Many online stores now offer “large” Black Friday discounts. We used web scraping to find out actual discounts. In Czech language only.

Today we are launching the largest upgrade of Apifier to date —a new product called Actor together with a complete redesign of the website. Oh, and Apifier has been renamed to Apify! Note that all existing crawlers are safe and sound — nothing has changed for them.

We’ve just released our official integration with Zapier. So with a few clicks, you can connect Apifier to hundreds of apps including Slack, Trello, Google Spreadsheets, Dropbox, Salesforce, and loads more.

Since the beginning of Apifier, our core mission has been to API-fy the web at scale.

Application programmable interface (API) is one of the core components of Apifier. Heck, “API” is even in our company name as we are helping people to APIfy the web.

It’s exactly one year today since we launched Apifier, so we thought this was a great opportunity to share what we’ve been up to in the last 12 months.

The earliest version of the Apify API was released three weeks after the company launched as Apifier.

Apify's first-ever blog post from when the company launched.