Is there a method to have --break-on-existing work on a per channel basis?

[andrewklajman]

Apologies if I am not phrasing this properly.

I am running a yt-dlp script once per day with the goal of downloading all the recent videos of channels defined in a list set by --batch-file.

The problem is that some of these channels have thousands of videos. I use --download-archive so these thousands of videos will not download but because the yt-dlp is checking each one of these videos it can take hours to run this script.

I though that I could use the option --break-on-existing so that it would download the recent videos for each channel and then break for each channel.

But instead as soon as the first break is met in the --download-archive list the entire yt-dlp download ends.

What I want to know is if it is possible to use the --break-on-existing on each channel in the --batch-file. Is this possible?

[andrewklajman]

Im thinking that i could probably just use xargs to do this.
cat batchfil.txt | xargs -I % sh -c 'ytp-dl --break-on-exiting %'

But would be nice if yt-dlp had some setting that i was missing

[pukkandan]

No, there is no in-built way to do this. You need to have some wrapper that feeds the URLs one by one to separate instances. The xargs method works. It is also easy to do this with a for loop

[pukkandan]

Update: Now there is --break-per-input