Web scraping

Give your scraping skills a boost with the most popular full-stack web scraping library for Node.js

Dynamic vs. static web pages: learn the difference and why it matters for web scraping.

I scraped HTML tables from Yahoo Finance with Pandas, and I didn't even need to open DevTools!

Learn to build a web scraper that extracts articles daily from 4 different platforms.

A comprehensive Python guide for browser automation and web scraping with Playwright.

Learn how to send HTTP requests and handle responses with the Requests library.

Learn how to apply XPath effectively to enhance web scraping and automation.

Playwright is now an established player in the web scraping and automation world. In 2024, there's really no reason to use Puppeteer instead.

GPT Scraper uses web scraping to let ChatGPT really access websites, with the help of the OpenAI API.

Google doesn't provide a SERP API, so try these 5 SERP API alternatives to get search data.

Learn how manipulating HTTP headers can enhance the data transfer process.

How to extract text data from URLs and PDFs for text mining and analysis.

Discover the pros and cons of 10 ScrapingBee alternatives in this comparative review.

Web scraping is legal if you scrape data publicly available on the internet. But you should be careful when scraping personal data or intellectual property. We cover the confusion surrounding the legality of web scraping and give you tips for compliant and ethical scrapers.

Learn how to scrape Google Images and expand your data collection to gain valuable insights.

Learn how to scrape Google Scholar to extract details of publications and information on articles, such as titles, authors, links, related articles, and much more.

There are lots of web scraping services out there, but which is the right choice for you? We look at ScrapingBee to see what it offers the dev looking to get data.

Extract Amazon information without the Amazon API.