
Why you need to monitor long-running large-scale scraping projects
A great deal can go wrong in long-running large-scale web scraping projects. We go through a few of the common problems you’re likely to encounter, which can be mitigated or prevented by monitoring.