Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chapter download stuck, Headless-Browser? #62

Closed
JohnnyBigoud opened this issue Oct 2, 2023 · 19 comments
Closed

Chapter download stuck, Headless-Browser? #62

JohnnyBigoud opened this issue Oct 2, 2023 · 19 comments
Labels
bug Something isn't working

Comments

@JohnnyBigoud
Copy link

What is broken?

Hello,

I updated the image earlier but didn't have time to make my watchlist again. I did it today and noticed downloads are getting stuck.

You can see below current chapter downloading is having a very huge time counter and progress doesn't increase anymore.
image

Screenshot of the docker container log (tranga-api)
image

I noticed by restarting the container problems gets resolved until some time where it gets stuck again.
Below is the log after container restart where chapter 985 is completed and it starts next one in the list.
image

Log-output

No response

Additional stuff

No response

@JohnnyBigoud JohnnyBigoud added the bug Something isn't working label Oct 2, 2023
@C9Glax
Copy link
Owner

C9Glax commented Oct 2, 2023

Okay I have seen this somewhere else already, my guess is that a failed download would not really interrupt the task, leaving it running forever.
Will see if I can fix that tomorrow

C9Glax added a commit that referenced this issue Oct 3, 2023
Instead of assigning buffer copy directy from result to filestream
@C9Glax
Copy link
Owner

C9Glax commented Oct 3, 2023

Hey there, I have no really found a concrete issue but might have a clue, if you use cuttingedge and it happens again, can you post the log again?

@JohnnyBigoud
Copy link
Author

Updated my stack.

  1. My tasks list got emptied. I checked into the persistant volume mapped and it was erased there as well. I cannot figure out why.
  2. I filled in the tasks list again and it still stops

image

image

This is after restarting the container
image

@C9Glax
Copy link
Owner

C9Glax commented Oct 3, 2023

My tasks list got emptied. I checked into the persistant volume mapped and it was erased there as well. I cannot figure out why.

To confirm, right now there is jobs in that mapped folder?

I added even more debugoutputs, because I can't figure out where it stops. To me it looks like the headless browser is getting stuck...

C9Glax added a commit that referenced this issue Oct 3, 2023
@JohnnyBigoud
Copy link
Author

Are the tasks not saved in same folder as before?
They are not appearing anymore.

image

image

Here's my docker-compose
image

I'll add them again and continue checking.

@C9Glax
Copy link
Owner

C9Glax commented Oct 3, 2023

Ah no... capitalization changed...
Check the current docker-compose, you can also now remove the imagecache thing.

Anyways I also added a timeout of 5 Minutes on jobs, so that should hopefully get it to at least not completely stop working

@JohnnyBigoud
Copy link
Author

Yes I just noticed and corrected.
I was about to tell you. I updated my docker-compose.

@JohnnyBigoud
Copy link
Author

I added a new manga yesterday and all 600 chapters got downloaded correctly so it is probably corrected.

Another issue probably unrelated but I am still getting parsing errors when adding some manga
image

@C9Glax
Copy link
Owner

C9Glax commented Oct 4, 2023

Okay that's good, but from what I can see you used Manganato for that, correct?
Manganato doesn't use the headless browser, so that narrows down the issue at least.

C9Glax added a commit that referenced this issue Oct 4, 2023
C9Glax added a commit that referenced this issue Oct 4, 2023
@C9Glax
Copy link
Owner

C9Glax commented Oct 4, 2023

I set the timeout for naviagtion to 10 seconds.
Also I fixed the parsing error. Manganato sometimes just doesn't provide a chapternumber....

@JohnnyBigoud
Copy link
Author

Great I'll check again.
I used manganato in this particular case but the initial issue was raised using mangasee.

@JohnnyBigoud
Copy link
Author

After updating the container I am getting this error on startup

image

C9Glax added a commit that referenced this issue Oct 4, 2023
@C9Glax
Copy link
Owner

C9Glax commented Oct 4, 2023

yea 10ms is a bit short to start a browser... should be fixed

@JohnnyBigoud
Copy link
Author

Commit fixed the startup issue.

Parsing issue with Manganato remains
image

C9Glax added a commit that referenced this issue Oct 4, 2023
Parsing, parsing, parsing
@C9Glax
Copy link
Owner

C9Glax commented Oct 4, 2023

Just squashing parsing errors... This one's at a different place. just fixed

Hope I am not taking up too much of your time 👍🏼

@JohnnyBigoud
Copy link
Author

No worries. I test what I can. Thank you for putting up with my spam ^^

@C9Glax
Copy link
Owner

C9Glax commented Oct 4, 2023

What improves for you, improves for me. Only that it is me, who creates the problems.

@C9Glax C9Glax changed the title Chapter download stuck Chapter download stuck, Headless-Browser? Oct 5, 2023
@JohnnyBigoud
Copy link
Author

Hello after running for 2 days now. I cannot reproduce the error. I guess this is fixed. I'll continue monitoring.

@C9Glax
Copy link
Owner

C9Glax commented Oct 6, 2023

Reopen if it stops again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants