How to scale Puppeteer and Playwright
Scaling web scrapers horizontally across multiple containers for optimal concurrency. Tips and advice for large-scale scraping projects using Puppeteer or Playwright.
5 min read
Lukáš Křivka
Philosopher turned self-taught developer. I manage a team of devs at Apify, and still love going deep into programming concepts. I like gardening, sports, and dogs.
4 posts
Latest Posts
What is large-scale scraping and how does it work?
When scraping very large or complex websites, a normal scraping workflow won't get the job done. Read on to find out how to overcome the challenges of large-scale scraping.
4 min read
Import data easily with Apify’s Google Sheets integration
Unleash the full potential of Apify automation tools! Integrate your Apify tools with Google spreadsheets to upload lists of URLs, save crawled data for later processing, and more.
9 min read
Dataset processing on Apify
Processing data can be a challenge. Apify provides a wide range of tools for you to shape the data as you see fit.
9 min read