Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug Report] Mango gets stuck while downloading from mangadex #108

Closed
flying-sausages opened this issue Sep 24, 2020 · 4 comments
Closed

[Bug Report] Mango gets stuck while downloading from mangadex #108

flying-sausages opened this issue Sep 24, 2020 · 4 comments
Labels
bug Something isn't working

Comments

@flying-sausages
Copy link
Collaborator

Describe the bug
When a large amount of chapters are being retrieved from Mangadex, the downloader sometimes "stalls". The UI is showing the current chapter as "Downloading" but the pages downloaded don't progress

To Reproduce
Steps to reproduce the behavior:

  1. Go to download client, get https://mangadex.org/manga/16411 (English only, chapters >128)
  2. select all chapters
  3. Send them to the download client
  4. Wait some
  5. notice the pages aren't downloading anymore

Expected behavior

Environment (please complete the following information):

  • OS: Ubu20.04
  • Browser FF Stable 80.0.1
  • Mango Version 0.12.3

Docker (if you are running Mango in a Docker container)

  • Nope

Additional context
A restart usually starts it back up again. The chapter in question starts to download from 0 again. I've had this happen a couple times to me today, but my log level was too low to catch it so I'm waiting for this to manifest again.

Some logs:

Will update in a second when the issue reproduces itself for the 4th time.
@flying-sausages flying-sausages added the bug Something isn't working label Sep 24, 2020
@flying-sausages
Copy link
Collaborator Author 

Sep 24 21:39:48 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:48 | Downloading https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qF
oamfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d8.png
Sep 24 21:39:48 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:48 | [success] https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qFoa
mfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d7.png
Sep 24 21:39:53 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:53 | downloading https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qF
oamfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d8.png
Sep 24 21:39:53 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:53 | Using monkey-patched HTTP::Client
Sep 24 21:39:53 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:53 | Downloading https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qF
oamfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d9.png
Sep 24 21:39:53 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:53 | [success] https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qFoa
mfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d8.png
Sep 24 21:39:58 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:58 | downloading https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qF
oamfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d9.png
Sep 24 21:39:58 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:58 | Using monkey-patched HTTP::Client
Sep 24 21:39:59 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:59 | Downloading https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qF
oamfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d10.png
Sep 24 21:39:59 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:39:59 | [success] https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qFoa
mfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d9.png
Sep 24 21:40:04 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:40:04 | downloading https://gq27rwa5t6e8c.swz7vqsbrq1e2.mangadex.network:443/qWWY9OFNOh5LMLgX6MljmnvhAJgs02ud6oMiWY1U9bEy_kwMF8URybMeCztNWAL-4NHA9R8QEJ9kxd35ULUDVGYLlLOVtvq1qF
oamfUtj1q6_ATG2t-Gv3rD7DcScJQDh2sbcEH__WAXo1mHf9kYKuacIUZwdqbZlhp7u0i0cnP38Tf31ZMs4ivLW4mBtHwozBYTPkOgXjymTdFTSAi1GtghzagFJw/data/17299eb3686479602ce2890e6ef18a8e/d10.png
Sep 24 21:40:04 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:40:04 | Using monkey-patched HTTP::Client
Sep 24 21:41:47 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:41:47 | Scan completed
Sep 24 21:41:47 ssgcld mango[1452789]: [INFO]    2020/09/24 21:41:47 | Scanned 3 titles in 282.43ms
Sep 24 21:46:47 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:46:47 | Scan completed
Sep 24 21:46:47 ssgcld mango[1452789]: [INFO]    2020/09/24 21:46:47 | Scanned 3 titles in 38.797ms
Sep 24 21:51:47 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:51:47 | Scan completed
Sep 24 21:51:47 ssgcld mango[1452789]: [INFO]    2020/09/24 21:51:47 | Scanned 3 titles in 38.251ms
Sep 24 21:56:47 ssgcld mango[1452789]: [DEBUG]   2020/09/24 21:56:47 | Scan completed
Sep 24 21:56:47 ssgcld mango[1452789]: [INFO]    2020/09/24 21:56:47 | Scanned 3 titles in 67.153ms
Sep 24 22:01:47 ssgcld mango[1452789]: [DEBUG]   2020/09/24 22:01:47 | Scan completed

It just got stuck on page 10.

image

@hkalexling
Copy link
Member

Yeah I've seen this a few times as well. I haven't got the time to investigate, but I guess it's because the mangadex @home server encountered some error and left the connection open. I will try to add a timeout value (say 1 minute?) to the request and see how it works.

@flying-sausages
Copy link
Collaborator Author

I think 5-10 seconds should be enough timeout to download an image. If 3 re-tries fail I'd throw an error.

hkalexling added a commit that referenced this issue Oct 15, 2020
@hkalexling
Configurable read timeout (#108)
853f422
@hkalexling
Copy link
Member

The read timeout has been added in v0.14.0. By default it's 30 seconds, and it can be configured using download_timeout_seconds in the config file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hkalexling @flying-sausages