Announcing Apify product advocates
Product advocates are your trusted advisors. They have your best interests in mind, and use their product knowledge and technical expertise to proactively help and advise.
9 Posts
21 tips on how to crawl a website without getting blocked
Do you want to know how to crawl a website without getting blocked? Here is your go-to guide on choosing proxies wisely, fighting Cloudflare, solving CAPTCHAs, avoiding honeytraps, and more.
Playwright web scraping: how to scrape the web with Playwright in 2024
Playwright is now an established player in the web scraping and automation world. In 2024, there's really no reason to use Puppeteer instead.
This is how I think you should install Node in 2024
Avoid time sinks and install Node.js properly with a node version manager. Skip nvm and use fnm - fast, dependable. Here's how to do it right.
Is web scraping legal?
Web scraping is legal if you scrape data publicly available on the internet. But you should be careful when scraping personal data or intellectual property. We cover the confusion surrounding the legality of web scraping and give you tips for compliant and ethical scrapers.
Puppeteer tutorial: how to scrape the web with Puppeteer in 2024
Learn how to start a browser with Puppeteer, click buttons and wait for actions, and how to extract data from websites. From building a basic scraper to large-scale crawling.
6 things you should know before buying or building a web scraper
From understanding the complexity of target websites to legal considerations, discover what we wish we'd been telling our customers from day one.
Datacenter proxies: when to use them and how to make the most of them
Datacenter proxies are faster, more stable, and way cheaper than other proxy types. Find out how to use them properly to avoid getting blocked when web scraping.
Fast cars and startups: can a lawyer become a programmer?
Ondra tried life in the fast lane to escape the boredom of a legal career, but ultimately learned to love code and found his true home at Apify.