Skip to content

Why not be the spider in the process of change max concurrent requests ? #57

Closed
wants to merge 1 commit into from

3 participants

@minisotm

I, as an active user, really miss this feature.
Thank you for your work.

@pablohoffman
Scrapy project member

Can you elaborate on the rationale for this change? (why you needed it, how you use it). Thanks.

@minisotm

For example when the site began to give the page where it says that too many requests (response code 200) I would like to change the number of queries on the fly, or by sending a signal HUB

@dangra
Scrapy project member
dangra commented Jan 7, 2013

I think the goal on this pull request can be implemented pretty much like AutoThrottle extension does using changes introduced by #206

@dangra dangra closed this Jan 7, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.