Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unreasonable Logic on --download-archive FILE feature and --date-after #17031

Closed
OpaqueArc opened this issue Jul 21, 2018 · 3 comments
Closed

Unreasonable Logic on --download-archive FILE feature and --date-after #17031

OpaqueArc opened this issue Jul 21, 2018 · 3 comments
Labels

Comments

@OpaqueArc
Copy link

@OpaqueArc OpaqueArc commented Jul 21, 2018

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like this: [x])
  • Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.07.10. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2018.07.10

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones
  • Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue




Description of your issue, suggested solution and other information

Issue1:
According to the description

--download-archive FILE

feature is implemented to avoid duplicated download of specific video
but the question is, when I used

--format best,worst

After the download of the "best" video, youtube-dl will recognize the video as duplicated and skip the download on the "worst" video
I used --download-archive feature because I intended to run youtube-dl periodically to stay synchronized with a channel, without downloading the same video again and again.
After some extra testing, I am aware that youtube-dl will abort the download if there's already a video there in the target path, and I don't necessarily need to use that command,
but doesn't

downloading the same video in different qualities in the same pass will be recognized as"duplicated"

sounds unreasonable?

Issue2:
When the option "--date-after" is applied, youtube-dl shouldn't download anything uploaded before the given date.
But when presented with a channel(which automatically lists videos in reverse order of time)
youtube-dl will still attempt to test EVERY video to see if it meets the criteria
Should this be recognized as a bug? Since I'm trying to stay synced with a channel which has 2000+ videos, testing every video in a pass would be very time consuming, and would probably result in a 402 abuse ban(luckily that I tested this manually)
Yes, I know that I can avoid that by setting

--max-downloads NUMBER

As youtube-dl would automatically abort after given downloads. By fine-tuning these two options, it would be possible to stay synced and avoid excessive page retrieves.
but for those channels with inconsistent updates, this could still be annoying and cause de-sync
Any luck that these problems would be fixed in the future?
BTW: thanks for all the work done, this tool saved my day :D

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Jul 21, 2018

  1. --download-archive does not support multiple formats.
  2. In general you are not guaranteed to have any ordering in a playlist.
@dstftw dstftw closed this Jul 21, 2018
@dstftw dstftw added the duplicate label Jul 21, 2018
@OpaqueArc
Copy link
Author

@OpaqueArc OpaqueArc commented Jul 21, 2018

If possible, please add 1. into documents( that wasn't specified)
Doesn't the list returned by a channel-id guarantees any order?

@OpaqueArc
Copy link
Author

@OpaqueArc OpaqueArc commented Jul 21, 2018

Anyway, do I have any option to "limit" youtube-dl to check only the very first videos given in the list?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.