Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Youtube Premiere/Livestreams will result in corrupted Downloads as opposed to giving an Error Message such as "Video currently not available" #18416

Closed
GregoriusT opened this issue Dec 5, 2018 · 2 comments
Labels

Comments

@GregoriusT
Copy link

@GregoriusT GregoriusT commented Dec 5, 2018

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like this: [x])
  • Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.12.03. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2018.12.03

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones
  • Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue


If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

gregorius@ZBOX:~$ sudo -H pip install --upgrade youtube-dl
[sudo] password for gregorius: 
Collecting youtube-dl
  Downloading https://files.pythonhosted.org/packages/16/cd/8c979c72742c446b3d1dd6d52a2d78feb39748d09a1ac52dabfb56cd6889/youtube_dl-2018.12.3-py2.py3-none-any.whl (1.8MB)
    100% |████████████████████████████████| 1.8MB 361kB/s 
Installing collected packages: youtube-dl
  Found existing installation: youtube-dl 2018.11.23
    Uninstalling youtube-dl-2018.11.23:
      Not removing or modifying (outside of prefix):
      /usr/bin/youtube-dl
      Successfully uninstalled youtube-dl-2018.11.23
Successfully installed youtube-dl-2018.12.3
gregorius@ZBOX:~$ youtube-dl https://www.youtube.com/watch?v=pbbY90zF5mo -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://www.youtube.com/watch?v=pbbY90zF5mo', u'-v']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.12.03
[debug] Python version 2.7.15rc1 (CPython) - Linux-4.15.0-33-generic-x86_64-with-Ubuntu-18.04-bionic
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] pbbY90zF5mo: Downloading webpage
[youtube] pbbY90zF5mo: Downloading video info webpage
[youtube] pbbY90zF5mo: Downloading m3u8 information
[youtube] pbbY90zF5mo: Downloading MPD manifest
[youtube] pbbY90zF5mo: Downloading MPD manifest
[debug] Default format spec: best/bestvideo+bestaudio
[debug] Invoking downloader on u'https://manifest.googlevideo.com/api/manifest/hls_playlist/id/pbbY90zF5mo.0/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-8vq54voxqx-cxgs.googlevideo.com/ei/NPsHXJOpFcen1gLD4ZnAAw/gcr/de/playlist_type/DVR/initcwndbps/2780/mm/32/mn/sn-8vq54voxqx-cxgs/ms/lv/mv/m/pl/17/dover/11/keepalive/yes/mt/1544026850/disable_polymer/true/ip/47.64.110.191/ipbits/0/expire/1544048532/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,goi,sgoap,sgovp,hls_chunk_host,ei,gcr,playlist_type,initcwndbps,mm,mn,ms,mv,pl/signature/52655939C45807DEDCC1D89C75D344D6A24CD798.71D93D8BABA3F95275D59D24757A139187C2A5EE/key/dg_yt0/playlist/index.m3u8'
[download] Destination: [Bears Den]GT6 Adventure - Working on Mixers and a few baths-pbbY90zF5mo.mp4
[debug] ffmpeg command line: ffmpeg -y -loglevel verbose -headers 'Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Accept-Language: en-us,en;q=0.5
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:59.0) Gecko/20100101 Firefox/59.0                                                                                                                                                            
' -i 'https://manifest.googlevideo.com/api/manifest/hls_playlist/id/pbbY90zF5mo.0/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-8vq54voxqx-cxgs.googlevideo.com/ei/NPsHXJOpFcen1gLD4ZnAAw/gcr/de/playlist_type/DVR/initcwndbps/2780/mm/32/mn/sn-8vq54voxqx-cxgs/ms/lv/mv/m/pl/17/dover/11/keepalive/yes/mt/1544026850/disable_polymer/true/ip/47.64.110.191/ipbits/0/expire/1544048532/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,goi,sgoap,sgovp,hls_chunk_host,ei,gcr,playlist_type,initcwndbps,mm,mn,ms,mv,pl/signature/52655939C45807DEDCC1D89C75D344D6A24CD798.71D93D8BABA3F95275D59D24757A139187C2A5EE/key/dg_yt0/playlist/index.m3u8' -c copy -f mp4 '-bsf:a' aac_adtstoasc 'file:[Bears Den]GT6 Adventure - Working on Mixers and a few baths-pbbY90zF5mo.mp4.part'                                      
ffmpeg version 3.4.4-0ubuntu0.18.04.1 Copyright (c) 2000-2018 the FFmpeg developers                                                                                                                                                         
  built with gcc 7 (Ubuntu 7.3.0-16ubuntu3)                                                                                                                                                                                                 
  configuration: --prefix=/usr --extra-version=0ubuntu0.18.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared                                                                             
  libavutil      55. 78.100 / 55. 78.100                                                                                                                                                                                                    
  libavcodec     57.107.100 / 57.107.100                                                                                                                                                                                                    
  libavformat    57. 83.100 / 57. 83.100                                                                                                                                                                                                    
  libavdevice    57. 10.100 / 57. 10.100                                                                                                                                                                                                    
  libavfilter     6.107.100 /  6.107.100                                                                                                                                                                                                    
  libavresample   3.  7.  0 /  3.  7.  0                                                                                                                                                                                                    
  libswscale      4.  8.100 /  4.  8.100                                                                                                                                                                                                    
  libswresample   2.  9.100 /  2.  9.100                                                                                                                                                                                                    
  libpostproc    54.  7.100 / 54.  7.100                                                                                                                                                                                                    
[hls,applehttp @ 0x55e402eac9c0] HLS request for url 'https://r3---sn-8vq54voxqx-cxgs.googlevideo.com/videoplayback/id/pbbY90zF5mo.0/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-8vq54voxqx-cxgs.googlevideo.com/ei/NPsHXJOpFcen1gLD4ZnAAw/gcr/de/playlist_type/DVR/initcwndbps/2780/mm/32/mn/sn-8vq54voxqx-cxgs/ms/lv/mv/m/pl/17/keepalive/yes/mt/1544026850/disable_polymer/true/ip/47.64.110.191/ipbits/0/expire/1544048532/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,goi,sgoap,sgovp,hls_chunk_host,ei,gcr,playlist_type,initcwndbps,mm,mn,ms,mv,pl/signature/52655939C45807DEDCC1D89C75D344D6A24CD798.71D93D8BABA3F95275D59D24757A139187C2A5EE/key/dg_yt0/playlist/index.m3u8/sq/862/goap/clen%3D48063%3Blmt%3D1544025210813205/govp/clen%3D557916%3Blmt%3D1544025210813200/dur/2.000/file/seg.ts', offset 0, playlist 0                                                                                                                                                                                                                             
[hls,applehttp @ 0x55e402eac9c0] Opening 'https://r3---sn-8vq54voxqx-cxgs.googlevideo.com/videoplayback/id/pbbY90zF5mo.0/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-8vq54voxqx-cxgs.googlevideo.com/ei/NPsHXJOpFcen1gLD4ZnAAw/gcr/de/playlist_type/DVR/initcwndbps/2780/mm/32/mn/sn-8vq54voxqx-cxgs/ms/lv/mv/m/pl/17/keepalive/yes/mt/1544026850/disable_polymer/true/ip/47.64.110.191/ipbits/0/expire/1544048532/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,goi,sgoap,sgovp,hls_chunk_host,ei,gcr,playlist_type,initcwndbps,mm,mn,ms,mv,pl/signature/52655939C45807DEDCC1D89C75D344D6A24CD798.71D93D8BABA3F95275D59D24757A139187C2A5EE/key/dg_yt0/playlist/index.m3u8/sq/862/goap/clen%3D48063%3Blmt%3D1544025210813205/govp/clen%3D557916%3Blmt%3D1544025210813200/dur/2.000/file/seg.ts' for reading       
[h264 @ 0x55e4032fc740] Reinit context to 1920x1088, pix_fmt: yuv420p                                                                                                                                                                       
Input #0, hls,applehttp, from 'https://manifest.googlevideo.com/api/manifest/hls_playlist/id/pbbY90zF5mo.0/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/cmbypass/yes/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-8vq54voxqx-cxgs.googlevideo.com/ei/NPsHXJOpFcen1gLD4ZnAAw/gcr/de/playlist_type/DVR/initcwndbps/2780/mm/32/mn/sn-8vq54voxqx-cxgs/ms/lv/mv/m/pl/17/dover/11/keepalive/yes/mt/1544026850/disable_polymer/true/ip/47.64.110.191/ipbits/0/expire/1544048532/sparams/ip,ipbits,expire,id,itag,source,requiressl,ratebypass,live,cmbypass,goi,sgoap,sgovp,hls_chunk_host,ei,gcr,playlist_type,initcwndbps,mm,mn,ms,mv,pl/signature/52655939C45807DEDCC1D89C75D344D6A24CD798.71D93D8BABA3F95275D59D24757A139187C2A5EE/key/dg_yt0/playlist/index.m3u8':                                                                                                                                           
  Duration: N/A, start: 1724.000000, bitrate: N/A                                                                                                                                                                                           
  Program 0                                                                                                                                                                                                                                 
    Metadata:
      variant_bitrate : 0
    Stream #0:0: Audio: aac (LC) ([15][0][0][0] / 0x000F), 48000 Hz, stereo, fltp
    Metadata:
      variant_bitrate : 0
    Stream #0:1: Video: h264 (Main), 1 reference frame ([27][0][0][0] / 0x001B), yuv420p(tv, bt709, left), 1920x1080 (1920x1088) [SAR 1:1 DAR 16:9], 30 fps, 30 tbr, 90k tbn, 60 tbc
    Metadata:
      variant_bitrate : 0
Output #0, mp4, to 'file:[Bears Den]GT6 Adventure - Working on Mixers and a few baths-pbbY90zF5mo.mp4.part':
  Metadata:
    encoder         : Lavf57.83.100
    Stream #0:0: Video: h264 (Main), 1 reference frame (avc1 / 0x31637661), yuv420p(tv, bt709, left), 1920x1080 (0x0) [SAR 1:1 DAR 16:9], q=2-31, 30 fps, 30 tbr, 90k tbn, 90k tbc
    Metadata:
      variant_bitrate : 0
    Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp
    Metadata:
      variant_bitrate : 0
Stream mapping:
  Stream #0:1 -> #0:0 (copy)
  Stream #0:0 -> #0:1 (copy)
Press [q] to stop, [?] for help
q
?
...
<end of log>

Description of your issue, suggested solution and other information

Note: The URL I used was a Livestream, if you check it about 30 minutes after the Stream is already over it will work properly again, so you need to test with a random Livestream or Premiere Video from Youtube in order to reproduce this Issue!

So I recently got pissed at how Youtube does the Subscriptions and wrote myself a Script that just automatically downloads them, the Script itself is working for all Channels except for the ones that use Youtube Premiere.

Youtube Premiere handles like a Livestream, but ends up being in the List of Videos uploaded by the Channel unlike real Livestreams. In on itself no Problem if youtube-dl would recognize that its not downloadable (yet) and abort on that specific Issue with an Error.

Instead it goes into this weird Mode where it downloads random Parts of the Video until it somewhen decides the Video is 100% downloaded (despite that clearly not being the case, and the File size isn't even matching) and then ofcourse putting the URL into the download archive, resulting in me missing a Video (which to prevent was the purpose of my script in the first place)

But the Mode is also problematic in the sense of the press "q or ?" part at the end, since it wont respond to either presses at all (also "?" on German Keyboards requires a shift+ß in order to type it, so maybe replace that with an "h" for "help" instead?)

In case it matters, my Script has been written like multiple Lines of the following in a row, but the weird Mode happens regardless of arguments given to it, it even happens without the -v for verbose.

youtube-dl "https://www.youtube.com/channel/UCl84oPPKuECe1PbIwDSN1Cg/videos" -iqf "best[height<=240]" -o "/data/Downloads/Videos/%(title)s.%(ext)s" --restrict-filenames --retries infinite --console-title --download-archive "~/Documents/Scripts/downloaded.txt" --playlist-end 24 --http-chunk-size 10M

I know there is a Feature where it can download Subscriptions with my credentials, but I do not trust Youtubes Side to work properly for that, considering it just drops random Videos out of my Bell Notifications all the time against my consent... (Not to mention the Security Issues of giving my Google Account Credentials to some random Developers Software somewhere (not intended as insult, just common sense))

If this seems like a Multiple-Issue request, I only provided that Download Script as my personal example of why I would like this Bug to be fixed, the Script itself works fine otherwise. ;)

I hope I gave enough Info for this Issue, I'll be afk for about an hour and then check email from time to time to see if I got a reply to this. ^^

@dstftw dstftw closed this Dec 5, 2018
@dstftw dstftw added the duplicate label Dec 5, 2018
@GregoriusT
Copy link
Author

@GregoriusT GregoriusT commented Dec 5, 2018

Wait what is this a duplicate of? I have Searched for "Youtube", "Premiere", "Live", "Livestream" and "Live Stream" individually and nothing popped up even when removing Search Filters from the Search Bar.

Also this Issue existed since at least a year, and only now that I rely on that Script it became enough of a Problem to report it.

Edit: I just went through all the Reports that happened in the last month, and none of them described the Issue I am having (maybe one that had an obscure title that I skipped?), so what is this a duplicate of if I may ask?

@GregoriusT
Copy link
Author

@GregoriusT GregoriusT commented Dec 11, 2018

Because nobody told me where that duplicate is, I am gonna report an update here:

I just updated youtube-dl and tested it on a Youtube Premiere Video and it still does the same corrupted File Stuff as specified above, once the Premiere actually started.

This Line should work for replicating this Bug for the next 2 and a half hours:
youtube-dl "https://www.youtube.com/user/Lanipator/videos" --playlist-end 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.