Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate to CLI-based tool, multithread download, better error handling #5

Open
wants to merge 15 commits into
base: master
Choose a base branch
from

Conversation

Midnight145
Copy link

The tool is now command-line based, instead of modifying the link variable directly.

  • You can use --link [link] or --input-file [path] to download books

Configurable output path

  • You can use --output-path in conjunction with --link, or --input-file formatted with link,output_path

Removes temporary pages by default

  • Can be kept by passing --keep

Book splicing can be done with flags instead of modifying variables directly

  • Configured with flags --begin, --end

Uses os.path.join instead of hardcoded UNIX-based paths

The main download is multithreaded to download multiple files at once, useful for larger books

  • Defaults to 5 threads, configurable with --thread-count

Retries failed downloads several times and will sleep for a few seconds in case of 429 Too many requests

  • Defaults to 3 retries, configurable with --retries

In the event of missing pages, you get a prompt at the end where you can force continue, download manually, or attempt to redownload automatically (single-threaded)

@SchmueI
Copy link

SchmueI commented Sep 19, 2023

Great work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants