How to use ChatGPT for web scraping (step-by-step guide)
If you know web scraping basics, this tutorial will teach you how to speed things up with AI.
Category
Web scraping
Read about everything related to web scraping and web crawling, with content ranging from beginner to advanced web scraping god.
282 Posts
Better lead generation for a digital marketing agency
How Sydney-based Nodd Solutions improved their data collection with Apify thanks to clean data, easy proxies, and great integrations.
Oxylabs vs. Bright Data (for web scraping)
Oxylabs & Bright Data are known for their proxy services and have recently invested in web scraping. How do they compare?
How to scrape JavaScript-rendered pages with Python
A step-by-step guide to extracting dynamic content from websites with Selenium.
How a university researcher studies TikTok user behavior with web scraping
Learn how Pilar, a university researcher in Spain, uses web scraping to study how people use TikTok and improves both her research and teaching.
How to use a proxy in Puppeteer (full guide for 2024)
A detailed guide to using proxies with Puppeteer. Learn how to authenticate proxies and avoid common pitfalls.
How to use cURL with a proxy (2024 step-by-step guide)
A guide through the processes of using cURL with proxies, authentication, and various configuration methods.
Web scraping: how to solve 403 errors
Why am I getting a 403 error status code when web scraping? Three possible answers on how to fix 403 errors when web scraping: user agents, HTTP headers, and proxies.
How a digital marketer uses Apify to improve outreach campaigns
How a digital marketer automated outreach campaigns by using Apify to scrape Google Maps for contact details. Says "it is a fantastic product".
How to use a proxy with Axios and Node.js
Learn to scrape the web efficiently by using proxy servers with one of the most popular HTTP clients for Node.js.
5 Python web scraping projects for 2024
If you're new to web scraping and want some interesting project ideas, check these out.
How to scrape LinkedIn with Python: step-by-step guide
Everything you need to know about scraping LinkedIn job data.
Web scraping social media for OSINT
OSINT researchers can get some data from social media platforms by using APIs. But web scraping is faster, more complete, and easier. Find out why.
Scraping real estate data with Python
Learn to use Apify with Playwright to interact with Zillow pages and extract real estate data.
How Apify uses Apify ↻
Dogfooding in Apify: 10 examples of how we use our own web scraping and automation tools for work and fun.
Zyte vs. Apify vs. Crawlbase
Unlike basic web scraping APIs, these platforms do more than help you pull data from websites.
What is data collection: Types and methods
Learn about different data collection methods and the process of gathering data for analysis.
