-
Notifications
You must be signed in to change notification settings - Fork 165
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add option for a delay between request #133
Comments
Hi @XiangRongLin, thank you for the report. In general, I've avoided implementing options for fetching pages, since that opens up a whole new dimension of configuration (do we support delays / parallelism? proxies? authentication headers? etc.). Instead you are able to use a combination of curl https://example.com | percollate pdf - --url=https://example.com For bundling multiple pages into a single EPUB, the workaround is admittedly a bit convoluted:
It might make sense to introduce an option to control parallelism and delay, such as: percollate epub --wait=N url1 url2 ... When |
Adds the -w, --wait=<sec> global CLI option to pause between processing URLs for a number of seconds. If unspecified, URLs are processed in parallel as before. Fixes #133.
The |
Feature description
In the scenario that multiple urls are passed in, I want to be able to specify a delay between the request to the website.
My usecase would be downloading all chapters from a table of contents, where I image that I would quickly get blocked if hundreds of requests are sent as fast as possible.
Existing workarounds
Is there any way to obtain the desired effect with the current functionality?
Not that I know of, because I want the output to be combined into a single epub file.
The text was updated successfully, but these errors were encountered: