Selenium web scraping with Python (Complete guide for 2024)
How to locate and wait for elements, take screenshots, execute JavaScript code, and more.
Category
Web scraping
Read about everything related to web scraping and web crawling, with content ranging from beginner to advanced web scraping god.
282 Posts
How to scrape a website (ultimate guide for 2024)
Learn how to extract data from websites using Python and no-code tools. This guide covers the basics of web scraping, connecting to a web page, parsing HTML, and storing the scraped data.
Web scraping case law: HiQ v. LinkedIn
hiQ Labs v. LinkedIn Corp. and its impact on web scraping. Learn how the case sets legal precedents for extracting publicly available data.
8 best Python web scraping libraries in 2024
Python developers have access to some of the best web scraping libraries and frameworks available. Learn what they do and when to use them.
Web scraping with R
Guide to web scraping basics with R. Covers setup, key libraries, essential techniques, and whether it's the right tool for your task.
Web scraping with PHP
A beginner-friendly guide to building PHP web scrapers. Learn to extract data, handle HTML elements, and understand the pros and cons of PHP for web scraping.
How to inspect elements in Chrome, Safari, Firefox, and more
This guide will equip you with the knowledge you need to use DevTools in multiple browsers.
How to scrape YouTube data: step-by-step guide in 2024
YouTube is the biggest video hosting on the internet. Discover how to use web scraping to extract useful data from YouTube videos, captions, and comments.
AI data extraction: What is it and how does it work?
Learn all about AI-driven data extraction methods, including how they work, their applications and limitations.
How to scrape Airbnb data: step-by-step guide in 2024
Learn how to use our Airbnb Scraper to extract Airbnb data on rental offers, including prices, reviews, location, and host details.
How to download tweets from Twitter in 2024
Learn how to download tweets from Twitter in 5 simple steps.
What is a headless browser: Explanation, use cases, libraries
Find out what a headless browser is, what you can use it for, and how it will help you with scraping websites. Learn about the best headless browsers and libraries.
How Chefclub uses Apify to find great recipe ideas
Learn how Chefclub improves their work with Apify's Instagram scraper, making video creation easier and boosting their social media presence.
E-commerce web scraping: how to build an e-commerce scraper
You only need a few lines of code to scrape data from e-commerce websites.
What is retrieval-augmented generation (and why use it for LLMs)?
RAG has revolutionized search and information retrieval. We explain how it works.
Announcing Crawlee for Python: a modern, open-source web scraping library for Python developers
Unified interface for HTTP and headless browser crawling, with automatic retries, proxy rotation, session management, and pluggable storage.
Perfect-fit marketing leads with web scraping
How hintly finds great marketing leads by integrating Apify’s social media scraping tools, making it easier to get insights from the freshest data.
How to use Cloudscraper in Python for web scraping
Learn how to bypass Cloudflare's anti-bot measures.
