Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Write to --download-archive if date is not in range or matched reject pattern #2832
Comments
|
I was going to write a bug report about this. But it's already here, it seems. Anyways, seconded! (Alternatively, I would like a switch that enabled writing to the archive even if downloading is otherwise disabled.) |
|
I would definitely appreciate this being added as I just want to skip to the latest videos you can use |
|
Workaround for anyone that wants to bypass this issue:
|
|
Does anyone know at what point it stops looking for IDs in the archives file? Surely it doesn't go back 3000 videos to make sure that ID is in the archive.txt |
|
@twiclo it will go all the way to the start last I checked, if you use any filters to skip a video it will not add the ID to the archive file, it seems to only add the ID on download. |
|
I generated a small archive.txt that surely wasn't filled with all of Styx's 3K+ videos and when I ran the command again it said it was only downloading 33. So there's a limit I'm interested to see what it is. I tried looking at the source code and really couldn't understand the organization for the flag |
Does for me Version: Example (Interuppted because I don't want to wait for it to check datestamp of 2000+ videos. To clarify this is without --simulate, you can see that when a video is skipped because it's date is not in range the IDs are not written to the archive file (meaning that every time this runs it's going to check every single video again): Edit: Date is a poor example in a few ways due to the most recent videos being first you can imagine if the filter you're running is looking for more specific conditions that require going through every video. The original request is valid but more so youtube-dl should only skip writing the ID if there is an error not if the video was downloaded. |
My proposal is to add some option like --write-anyway that would write the ID to the download archive folder. This way in future operations, would be processed faster because it would not need to open connection and would skip it locally.
Thank you for your great job