Web Scraping

How to scrape Google Shopping

Google Shopping enables users to search for products across different vendors and websites, and easily compare product details. Read more about the benefits of scraping Google Shopping and how to do it in this easy tutorial.

4 min read May 17, 2022

Web Scraping

What is large-scale scraping and how does it work?

Lukáš Křivka

When scraping very large or complex websites, a normal scraping workflow won't get the job done. Read on to find out how to overcome the challenges of large-scale scraping.

4 min read May 16, 2022

Amazon

How an Amazon price tracker can help you compete with big business

Theo Vasilis

We show you how to automate Amazon price checks to help you stay ahead of the competition.

5 min read May 12, 2022

Web Scraping

How web scraping is bridging language barriers

Theo Vasilis

When a research team set out to build a machine translation module for Syrian and Moroccan migrants and refugees, it faced a significant challenge: how do you get enough data for dialects used only in casual conversation? This is how web scraping became the solution.

4 min read May 9, 2022

Web Scraping

Is web scraping legal?

Ondra Urban

Web scraping is legal if you scrape data publicly available on the internet. But you should avoid scraping personal data or intellectual property. We cover the confusion surrounding the legality of web scraping and give you tips for compliant and ethical scrapers.

16 min read Apr 28, 2022

Web Scraping

Your step-by-step guide to scraping Amazon

David Barton

Scraping Amazon is a fast and efficient method of extracting useful data in the e-commerce industry. Our simple step-by-step guide will show you how to get ahead of the competition with a powerful Amazon Product Scraper.

3 min read Apr 28, 2022

Tutorial

How to scrape Tripadvisor data with an unofficial API

Theo Vasilis

Using the right API will help you scrape Tripadvisor at scale. You don't need to be a computer wizard to do it. Our step-by-step guide will show you how to extract data from Tripadvisor with a ready-to-use web scraping tool that anyone can use.

4 min read Apr 21, 2022

Research

5 surprising ways to use software for academic research

Theo Vasilis

What are the latest technological trends in the field of academia? What software do academics use? What are the best digital research tools and online research methods for students and scholars? We tackled these questions, and the answers will surprise you.

6 min read Apr 19, 2022

Apify SDK

Migrating from Scrapy to Apify SDK

Percival Villalva

What if a single decision could cut your scraping costs by 90% while improving efficiency up to 60%? That's precisely what the retail data company, Daltix, experienced by migrating their scrapers from Scrapy to Apify.

7 min read Apr 4, 2022

Tutorial

How to scrape Pinterest data in 5 easy steps

Theo Vasilis

Want to scrape Pinterest data but don’t have the tech skills? Our short step-by-step web scraping tutorial will show you how easy it is with Apify’s Pinterest Scraper

5 min read Mar 29, 2022

Engineering

Web scraping with client-side Vanilla JavaScript

Matt Stephens

The free Vanilla JS Scraper tool makes web scraping more accessible by easing the learning curve. Get right into writing your first web crawler without the need for any new knowledge beyond Vanilla JavaScript.

6 min read Mar 28, 2022

Web Scraping

11 email scrapers you should know about

Theo Vasilis

So you want to extract email addresses from any site on the web, but which email scraper should you use? Read on if you want to know the best email scraper software for your email extraction projects

3 min read Mar 23, 2022