Permalink
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Browse files
Merge pull request #943 from Lazar-T/patch-3
- Loading branch information
Showing
with
1 addition
and
1 deletion.
-
+1
−1
docs/topics/autothrottle.rst
|
@@ -11,7 +11,7 @@ Design goals |
|
|
1. be nicer to sites instead of using default download delay of zero |
|
|
2. automatically adjust scrapy to the optimum crawling speed, so the user |
|
|
doesn't have to tune the download delays and concurrent requests to find the |
|
|
optimum one. the user only needs to specify the maximum concurrent requests |
|
|
optimum one. The user only needs to specify the maximum concurrent requests |
|
|
it allows, and the extension does the rest. |
|
|
|
|
|
How it works |
|
|