How to scrape Reddit data with unofficial Reddit API
Learn how you can use a Reddit web scraper to extract useful data from subreddits.
54 Posts
How to scrape Twitter (X.com) data using Python without Twitter API
Step-by-step guide to building a Python Twitter scraper without using Twitter API.
What is web scraping?
The basics of web scraping: what it is, how it works, real-world use cases, and how to get started.
How Parsedom uses Apify to simplify data collection from Google Maps
Parsedom, a data services startup, uses Apify's Google Maps scraper to automate and improve their data collection from Google Maps.
Playwright timeout: how to change and fix
Learn to manage Playwright timeouts in testing and web scraping with tips on optimizing locators, setting timeouts, mocking endpoints, retries, and splitting tests.
How to scrape eBay and extract listings data
Use web scraping to extract structured data from eBay without using the official eBay API.
How Chefclub uses Apify to find great recipe ideas
Learn how Chefclub improves their work with Apify's Instagram scraper, making video creation easier and boosting their social media presence.
Announcing Crawlee for Python: a modern, open-source web scraping library for Python developers
Unified interface for HTTP and headless browser crawling, with automatic retries, proxy rotation, session management, and pluggable storage.
Perfect-fit marketing leads with web scraping
How hintly finds great marketing leads by integrating Apify’s social media scraping tools, making it easier to get insights from the freshest data.
Better lead generation for a digital marketing agency
How Sydney-based Nodd Solutions improved their data collection with Apify thanks to clean data, easy proxies, and great integrations.
How a university researcher studies TikTok user behavior with web scraping
Learn how Pilar, a university researcher in Spain, uses web scraping to study how people use TikTok and improves both her research and teaching.
How a digital marketer uses Apify to improve outreach campaigns
How a digital marketer automated outreach campaigns by using Apify to scrape Google Maps for contact details. Says "it is a fantastic product".
How to fix error code 1020 (11 easy solutions in 2024)
Find out how to fix error code 1020, what's going on, and why this error code happens.
LLM web scraping: using large language models to talk to websites
Discover a new way to interact with websites using large language models. Website Content Crawler makes it easy to ingest and process web content, turning any website into a conversational partner for your AI chatbot or LLM.
499 status code: how to solve it when web scraping
Is your web scraper getting 499 status codes? Solve them with this quick guide.
How I use GPT Scraper to let ChatGPT access the internet
GPT Scraper uses web scraping to let ChatGPT really access websites, with the help of the OpenAI API.
Your step-by-step guide to scraping Amazon product data
Extract Amazon information without the Amazon API.
Best web scraping APIs in 2024
As web scraping matures and 2024 progresses, there are now some really excellent web scraping APIs out there. We explore 10 top-notch options for you to choose from.