What is the difference between web scraping and crawling?
Web crawling vs web scraping. We explain the differences and how web scraping can create an API for any website.
5 min read
Web Crawling
10 posts
Latest Posts
Pros and cons of web scraping
If you've ever heard of web scraping or web crawling, this post is for you. In this article, we will talk about the pros and cons of using web scraping tools and technologies.
13 min read
How to scrape YouTube
YouTube is the biggest video hosting on the internet. Discover how to use web scraping to extract useful data from YouTube videos, captions, and comments.
6 min read
4 common e-commerce web scraping challenges & tips to navigate them
How to web scrape your target audience to generate leads and analyze data to get actionable insights for your marketing strategies and campaigns.
7 min read
How to scrape Reddit
Why Reddit is one of the biggest social sharing sites on the internet and how you can use web scraping to extract useful data from subreddits.
7 min read
The Apify Crawler product to be replaced by an Apify actor
On Sep 30, 2019, we’ll be retiring the legacy Apify Crawler product together with Apify API version 1. Migrate your crawlers to actors.
On September 30, 2019, we’ll be retiring the legacy Apify Crawler product together with Apify API version 1. This post explains how to migrate crawlers to the new
9 min read
Why the world needs a universal web scraping library for JavaScript
We’ve released the Apify SDK — an open-source Node.js library for scraping and web crawling. There was one for Python, but none for JS.
We’ve released the Apify SDK — an open-source Node.js library for scraping and web crawling. There was one for Python, but until now, there was no such library for
1 min read
One Crawler to Audit Them All
Agency Analytics only needed a single generic Apify crawler to power their SEO Audit Tool
Read about how Agency Analytics only needed a single generic Apify crawler to power their SEO Audit Tool. They were also able to set it up themselves, with just a little support from the Apify team.
2 min read
Apifier is now Apify!
Today we are launching the largest upgrade of Apifier to date —a new product called Actor together with a complete redesign of the website…
5 min read
Christmas API revamp
Application programmable interface (API) is one of the core components of Apifier. Heck, “API” is even in our company name as we are…
2 min read