Skip to content

Why not be the spider in the process of change max concurrent requests ? #57

wants to merge 1 commit into from

3 participants


I, as an active user, really miss this feature.
Thank you for your work.

Scrapy project member

Can you elaborate on the rationale for this change? (why you needed it, how you use it). Thanks.


For example when the site began to give the page where it says that too many requests (response code 200) I would like to change the number of queries on the fly, or by sending a signal HUB

Scrapy project member
dangra commented Jan 7, 2013

I think the goal on this pull request can be implemented pretty much like AutoThrottle extension does using changes introduced by #206

@dangra dangra closed this Jan 7, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.