Who are your organization’s GitHub Champions?
What we learned from collecting individual contribution metrics in our GitHub repositories.
Category
Engineering
We share hard-won insights, tips, and tricks we learned while building an open web scraping and automation platform from scratch.
23 Posts
How to debug an infinite loop in Node.js production code
Print the stack trace of an infinite loop in a Node.js application running in a Docker container using GNU debugger (GDB) and Kubernetes.
Bypassing web scraping protection: get the most out of your proxies with shared IP address emulation
Learn about modern web scraping protection techniques and how to bypass them. Scrape up to three times more pages by combining IP address rotation with shared IP address emulation.
Using a man-in-the-middle proxy to scrape data from a mobile app API
In this technical post, you’ll learn how to set up a man-in-the-middle proxy and install a self-signed certificate on your mobile phone in order to intercept HTTPS communication between any mobile app and its backend API.
How to make headless Chrome and Puppeteer use a proxy server with authentication
We have released a new open-source package called proxy-chain on NPM to enable running headless Chrome and Puppeteer over a proxy server that requires authentication.
