Text scraping and computational text mining and analysis methods are becoming increasingly popular among students, scholars, and researchers in multiple academic fields. We show you how to extract text data from websites with Smart Article Extractor.
BOTS is a four-letter word. But do bots deserve all the bad rap? We explain the difference between good and bad bots, how to use the good ones, and how to protect yourself against the bad ones.
Want to learn about web scraping and how it differs from web crawling? Read on to understand web crawling vs. web scraping and how web scraping can create an API for any website.
If you've ever heard of web scraping or web crawling, this post is for you. In this article, we will talk about the pros and cons of using web scraping tools and technologies.
On September 30, 2019, we’ll be retiring the legacy Apify Crawler product together with Apify API version 1. Please migrate your crawlers to tasks of the new apify/legacy-phantomjs-crawler actor, which provides the same functionality, configuration options and results as Apify Crawler.
We’ve released the Apify SDK — an open-source Node.js library for scraping and web crawling. There was one for Python, but until now, there was no such library for JavaScript, THE language of the web.
Read about how Agency Analytics only needed a single generic Apify crawler to power their SEO Audit Tool. They were also able to set it up themselves, with just a little support from the Apify team.