Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Windows] download error for too many connections on default downloader + workaround #14075

Closed
eladkarako opened this issue Aug 30, 2017 · 1 comment
Labels

Comments

@eladkarako
Copy link

@eladkarako eladkarako commented Aug 30, 2017

I've made a little batch file to process a text-file with URLs, and to fire many youtube-dl.exe processes, one for URL- essentially a "parallel downloader".

I've noticed that the first three got connected and the rest were usually ended with an unable to open connection error,

it usually meant I need to run the batch again until all of the processes would finish, the issue was usually after the page and the player js were fetched and the download should have started..

It is probably an issue with the default downloader,
once I've switched to using the external-downloader aria2c all of the opened connections are managed without any issue.

I've since than updated my batches in github.com/eladkarako/youtube-dl-p to use the workaround.

but if you want to replicate the issue place youtube-dl.exe along with those two batch files and text file in the same folder, then run videos.cmd:

item.cmd

@echo off
echo Downloading "%~1"...

call youtube-dl.exe --force-ipv4 --geo-bypass --verbose --print-traffic --no-call-home --no-check-certificate --prefer-insecure "%~1"

pause
exit

videos.cmd

@echo off
echo Downloading "%~1"...

call youtube-dl.exe --force-ipv4 --geo-bypass --verbose --print-traffic --no-call-home --no-check-certificate --prefer-insecure "%~1"

pause
exit

videos.txt

https://www.youtube.com/watch?v=mX-SktWVHao
https://www.youtube.com/watch?v=hROB3qde5Wk
https://www.youtube.com/watch?v=hBtvYLrcqXI
https://www.youtube.com/watch?v=KevqYckwBXw
https://www.youtube.com/watch?v=F-uQNfQKsA4
https://www.youtube.com/watch?v=92f3RRkakO8
https://www.youtube.com/watch?v=wwcatLNs79Y
https://www.youtube.com/watch?v=2wml6eoLQ0U
https://www.youtube.com/watch?v=P-t8iOjebVY
https://www.youtube.com/watch?v=jxD5S__otjM
https://www.youtube.com/watch?v=wm6wO4kUQOU
https://www.youtube.com/watch?v=gPmjeUHI3cs
https://www.youtube.com/watch?v=78iJt51vxGY
https://www.youtube.com/watch?v=_iB5kTp4fC4
https://www.youtube.com/watch?v=7ecIZnRrDFE
https://www.youtube.com/watch?v=l3zBFyZAAjc
https://www.youtube.com/watch?v=2N8PHJ6tnLQ
https://www.youtube.com/watch?v=P0f7uGCgZrU
https://www.youtube.com/watch?v=T6dfjR0zl4s
https://www.youtube.com/watch?v=9cXtsWVTA20
https://www.youtube.com/watch?v=KSxnKdbYSqM
https://www.youtube.com/watch?v=-Sjm24ZgmoI
https://www.youtube.com/watch?v=dzLH9374cgw
https://www.youtube.com/watch?v=jTw0QmkJb5k

You should expect few successful downloads starting,
and few CMD windows showing something like this:

Ps.
the amount of half-open connection I allowed in my Windows machine,

was tweaked to allow more than 9000 opened-connections at the same time, so it should replicate successfully on other computers too...

@dstftw dstftw closed this Sep 1, 2017
@dstftw dstftw added the invalid label Sep 1, 2017
@eladkarako
Copy link
Author

@eladkarako eladkarako commented Sep 1, 2017

?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.