Please sign in to comment.
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
|@@ -11,7 +11,7 @@ Design goals|
|1. be nicer to sites instead of using default download delay of zero|
|2. automatically adjust scrapy to the optimum crawling speed, so the user|
|doesn't have to tune the download delays and concurrent requests to find the|
|optimum one. the user only needs to specify the maximum concurrent requests|
|optimum one. The user only needs to specify the maximum concurrent requests|
|it allows, and the extension does the rest.|
|How it works|