Skip to content

/ youtube-dl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[vimeo]: `--download-archive` broken when downloading user likes #21493

Closed
leonklingele opened this issue Jun 22, 2019 · 3 comments
Closed

[vimeo]: `--download-archive` broken when downloading user likes #21493

leonklingele opened this issue Jun 22, 2019 · 3 comments
Labels
invalid

Comments

@leonklingele
Copy link

@leonklingele leonklingele commented Jun 22, 2019 •
edited

Checklist

  • I'm reporting a broken site support issue
  • I've verified that I'm running youtube-dl version 2019.06.21
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar bug reports including closed ones
  • I've read bugs section in FAQ

Verbose log

$ youtube-dl -i --download-archive ytdl-archive.txt -v "https://vimeo.com/michaelkoenig/likes"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-i', u'--download-archive', u'ytdl-archive.txt', u'-v', u'https://vimeo.com/michaelkoenig/likes']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.06.21
[debug] Python version 2.7.16 (CPython) - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: avconv 12.3, avprobe 12.3, ffmpeg 4.1.3, ffprobe 4.1.3, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[vimeo:likes] michaelkoenig: Downloading webpage
[download] Downloading playlist: Videos Michael König likes
[vimeo:likes] michaelkoenig: Downloading page 1/3
[vimeo:likes] michaelkoenig: Downloading page 2/3
[vimeo:likes] michaelkoenig: Downloading page 3/3
[vimeo:likes] playlist Videos Michael König likes: Downloading 30 videos
[download] Downloading video 1 of 30
[vimeo] 257761811: Downloading webpage
[vimeo] 257761811: Extracting information
[vimeo] 257761811: Downloading webpage
[vimeo] 257761811: Downloading JSON metadata
WARNING: Unable to download JSON metadata: HTTP Error 403: Forbidden
[vimeo] 257761811: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 257761811: Downloading fastly_skyfire m3u8 information
[vimeo] 257761811: Downloading akfire_interconnect_quic MPD information
[vimeo] 257761811: Downloading akfire_interconnect_quic MPD information
[vimeo] 257761811: Downloading fastly_skyfire MPD information
[vimeo] 257761811: Downloading fastly_skyfire MPD information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://skyfire.vimeocdn.com/1561205024-0x49002ffd77835acf6d1a00bbe5b7710179b69fc8/257761811/sep/video/1042997539,1309465728,1042997544,1042997543,1042997541,1042997540,1042997534/master.mpd?base64_init=1'
[dashsegments] Total fragments: 32
[download] Destination: Volumes - Art film by Maxim Zhestkov-257761811.fdash-fastly_skyfire_sep-video-1042997543.mp4
[download] 100% of 434.96MiB in 03:44
[debug] Invoking downloader on u'https://skyfire.vimeocdn.com/1561205024-0x49002ffd77835acf6d1a00bbe5b7710179b69fc8/257761811/sep/video/1042997539,1309465728,1042997544,1042997543,1042997541,1042997540,1042997534/master.mpd?base64_init=1'
[dashsegments] Total fragments: 32
[download] Destination: Volumes - Art film by Maxim Zhestkov-257761811.fdash-fastly_skyfire_sep-audio-1042997539.m4a
[download] 100% of 2.29MiB in 00:13
[ffmpeg] Merging formats into "Volumes - Art film by Maxim Zhestkov-257761811.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel 'repeat+info' -i 'file:Volumes - Art film by Maxim Zhestkov-257761811.fdash-fastly_skyfire_sep-video-1042997543.mp4' -i 'file:Volumes - Art film by Maxim Zhestkov-257761811.fdash-fastly_skyfire_sep-audio-1042997539.m4a' -c copy -map '0:v:0' -map '1:a:0' 'file:Volumes - Art film by Maxim Zhestkov-257761811.temp.mp4'
Deleting original file Volumes - Art film by Maxim Zhestkov-257761811.fdash-fastly_skyfire_sep-video-1042997543.mp4 (pass -k to keep)
Deleting original file Volumes - Art film by Maxim Zhestkov-257761811.fdash-fastly_skyfire_sep-audio-1042997539.m4a (pass -k to keep)
[download] Downloading video 2 of 30
^C
ERROR: Interrupted by user

$ cat ytdl-archive.txt
vimeo 257761811

$ youtube-dl -i --download-archive ytdl-archive.txt -v "https://vimeo.com/michaelkoenig/likes"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-i', u'--download-archive', u'ytdl-archive.txt', u'-v', u'https://vimeo.com/michaelkoenig/likes']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.06.21
[debug] Python version 2.7.16 (CPython) - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: avconv 12.3, avprobe 12.3, ffmpeg 4.1.3, ffprobe 4.1.3, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[vimeo:likes] michaelkoenig: Downloading webpage
[download] Downloading playlist: Videos Michael König likes
[vimeo:likes] michaelkoenig: Downloading page 1/3
[vimeo:likes] michaelkoenig: Downloading page 2/3
[vimeo:likes] michaelkoenig: Downloading page 3/3
[vimeo:likes] playlist Videos Michael König likes: Downloading 30 videos
[download] Downloading video 1 of 30
[vimeo] 257761811: Downloading webpage
[vimeo] 257761811: Extracting information
[vimeo] 257761811: Downloading webpage
[vimeo] 257761811: Downloading JSON metadata
WARNING: Unable to download JSON metadata: HTTP Error 403: Forbidden
[vimeo] 257761811: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 257761811: Downloading fastly_skyfire m3u8 information
[vimeo] 257761811: Downloading akfire_interconnect_quic MPD information
[vimeo] 257761811: Downloading akfire_interconnect_quic MPD information
[vimeo] 257761811: Downloading fastly_skyfire MPD information
[vimeo] 257761811: Downloading fastly_skyfire MPD information
[debug] Default format spec: bestvideo+bestaudio/best
[download] Volumes - Art film by Maxim Zhestkov has already been recorded in archive
[download] Downloading video 2 of 30
^C
ERROR: Interrupted by user

Description

The --download-archive option can be used to record the IDs of downloaded files in an archive so youtube-dl does not attempt to download them again. This option works fine with YouTube itself, however doesn't with Vimeo.
When using the option with [vimeo] to download user likes, youtube-dl still fetches the following information from the Internets:

  • info JSON
  • m3u8 information
  • etc.

Rel.: #19022
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Jun 22, 2019

This is considered correct behavior since video id is not known before entry extraction.
@dstftw dstftw closed this Jun 22, 2019
@dstftw dstftw added the invalid label Jun 22, 2019
@leonklingele
Copy link
Author

@leonklingele leonklingele commented Jun 22, 2019

dstftw added a commit that referenced this issue Jun 22, 2019
@dstftw
[vimeo:likes] Implement extrator in terms of channel extractor
Verified
This commit was signed with a verified signature.
dstftw Sergey M.
GPG key ID: 2C393E0F18A9236D Learn about signing commits
091c9b4 
This allows to obtain videos' ids before extraction (#21493)
@leonklingele
Copy link
Author

@leonklingele leonklingele commented Jun 22, 2019

Thanks for the fix @dstftw 😻
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
invalid
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
@dstftw @leonklingele
You can’t perform that action at this time.