Web scraping

Combining machine learning and web scraping is a natural next step in web automation. Let's explore how this comes into reality with three AI-based web scraping projects: Product Mapping, Automated Product Detail Extraction, and Browser Fingerprint Generator.

When it comes to e-commerce or marketing strategy, you can't avoid price monitoring, but you can automate it if you know how to do it.

For contracts that are concluded on the internet, there are four categories to help with assessing their enforceability. Read on to find out what they are and if they can be enforced.

Google Shopping enables users to search for products across different vendors and websites, and easily compare product details. Read more about the benefits of scraping Google Shopping and how to do it in this easy tutorial.

When scraping very large or complex websites, a normal scraping workflow won't get the job done. Read on to find out how to overcome the challenges of large-scale scraping.

Learn how to automate Amazon price checks to stay ahead of your competition.

When a research team set out to build a machine translation module for Syrian and Moroccan migrants and refugees, it faced a significant challenge: how do you get enough data for dialects used only in casual conversation? This is how web scraping became the solution.

What are the latest technological trends in the field of academia? What software do academics use? What are the best digital research tools and online research methods for students and scholars? We tackled these questions, and the answers will surprise you.

What if a single decision could cut your scraping costs by 90% while improving efficiency up to 60%? That's precisely what the retail data company, Daltix, experienced by migrating their scrapers from Scrapy to Apify.

The free Vanilla JS Scraper tool makes web scraping more accessible by easing the learning curve. Get right into writing your first web crawler without the need for any new knowledge beyond Vanilla JavaScript.

So you want to extract email addresses from any site on the web, but which email scraper should you use? Read on if you want to know the best email scraper software for your email extraction projects.

Scrape e-commerce websites for customer, product, and transaction data to keep an eye on your competitors, monitor prices, research products, and measure brand sentiment. Find out how to scrape Decathlon and hundreds of other e-commerce websites with this easy step-by-step guide.

Web scraping is key to unlocking the web's full potential in 2022. From AI to e-commerce, web scraping is paving the way for applied data in 2022.

If you're looking for an API for Capterra, this scraper acts as an unofficial Capterra API to help you extract data at scale.

Find out how to use Best Buy Scraper to collect data from one of the most surprising online retail successes of 2021.

Web scraping speeds up the data extraction process for both academic or market research. Manual research is fine when copying and pasting information from a few websites, but web scraping is the way to get data for more extensive projects.

Websites have protections to stop malicious bots. But not all bots are created equal. Find out about the methods used to avoid being blocked while scraping the web legally and ethically.

Find out the difference between web scraping and screen scraping. Discover their uses and which tools to use for them.