Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Change auto retry time? #5652
Change auto retry time? #5652
Comments
|
If increasing sleep interval (to reasonably large value) did not help, your conclusions on throttling are obviously wrong. In any case imposing different kinds of heuristics is brittle and requires fine-grained testing. |
|
Ah, ok. As for why, some courses like Udacity are broken up into many short videos and have 300+ videos per playlist. Say I put 2 of them in queue and it stops halfway through the second course. If I simply restart it will have to go through 450 videos again before getting to the first new one which takes a while (I'm not sure if it's pinging the server each time but if it is that probably doesn't help with the throttle). I'll keep trying longer sleep times. The only problem is with that many small videos it adds a ton of time to the total download since it's getting multiplied hundreds of times. |
|
For those cases you should use |
|
Any workaround to solve "ERROR: content too short" ? Need to download 1000+ videos. Still happen to me and keep manually press the command again. Retry option didn't help also. Since youtube-dl automatically detects files already been downloaded, i finally created a bash script to auto retry the command until success. |
Is there any way to change the auto-retry wait time?
When I download very long playlists (250+, usually very short segments) I run into the "content too short" error which I'm almost certain is youtube's throttling after a certain number of videos. The auto-retry always seems to fail. I've noticed I can either wait 15 minutes or so or change my IP address via VPN. But since the retry fails I have to go back and manually figure out how far it got (when multiple playlists are queued), edit the url's, tell it what video number to start on, etc. It's very tedious.
I think this could be solved with a simple parameter for extending the retry time interval (maybe specifically for this error). It could retry once or twice, then wait x minutes between subsequent tries. This would allow queuing up of more videos without having to reset every time the throttle limit is hit. There are a number of other 'content too short' reports and I think they are all running into the same downloading limit.
PS. I have tried increasing the sleep interval (between each video) and that doesn't seem to have helped.