Scrapinghub Support Center

How can we help you today?

Many failed requests with 429 code. What does it mean?

Modified on: Wed, 21 Mar, 2018 at 5:11 AM

For each crawlera plan there is a limit to Concurrency (Requests that can be made parallel at a time). Concurrency is cumulative of all domains crawled at a time and also requests through different Crawlera accounts in the Organization.

Hence when the concurrency is more than the limit of the plan, Crawlera gives the error message of 429 (Parallel Connection limit reached). You would need to lower the concurrency or upgrade to higher plans to have higher concurrency.