Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Server HTTP error on youtube video, only audio fails to download #11332

Closed
ninedotnine opened this issue Dec 1, 2016 · 5 comments
Closed

Server HTTP error on youtube video, only audio fails to download #11332

ninedotnine opened this issue Dec 1, 2016 · 5 comments

Comments

@ninedotnine
Copy link

@ninedotnine ninedotnine commented Dec 1, 2016

  • I've verified and I assure that I'm running youtube-dl 2016.12.01

  • At least skimmed through README and most notably FAQ and BUGS sections

  • Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
[debug] System config: []
[debug] User config: ['-o', '%(title)s.%(ext)s', '--restrict-filenames', '--ignore-errors']
[debug] Command-line args: ['--verbose', 'https://www.youtube.com/watch?v=9LsYD3gFhuc']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.12.01
[debug] Python version 3.5.2 - Linux-4.8.4-1-zen-x86_64-with-arch
[debug] exe versions: ffmpeg 3.1.5, ffprobe 3.1.5, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] 9LsYD3gFhuc: Downloading webpage
[youtube] 9LsYD3gFhuc: Downloading video info webpage
[youtube] 9LsYD3gFhuc: Extracting video information
[youtube] {43} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {18} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {36} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {17} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {135} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {244} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {134} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {243} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {133} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {242} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {160} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {278} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {140} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {171} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {249} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {250} signature length 44.40, html5 player en_US-vflydz95C
[youtube] {251} signature length 44.40, html5 player en_US-vflydz95C
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on 'https://r4---sn-vgpvoj5-tu1e.googlevideo.com/videoplayback?key=yt6&mime=video%2Fmp4&ipbits=0&initcwndbps=5932500&pl=26&keepalive=yes&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Crequiressl%2Csource%2Cupn%2Cexpire&itag=135&ei=pZk_WKjJKYjUugKyzLCADA&requiressl=yes&gir=yes&mm=31&mn=sn-vgpvoj5-tu1e&id=o-AObBwKJ10Kivr75gT4DmUhZv2xDAIHKidPWRc2Nis61f&dur=312.601&source=youtube&clen=14517353&mt=1480562991&mv=m&ms=au&lmt=1392364696009357&expire=1480584709&upn=BITija_9hYw&ip=137.122.64.12&signature=367D587531BE003C09E6E15BCC8A80CAB57544F3.CB7069358A67AF2FC452E5A804733D79A9F1B1B1&ratebypass=yes'
[download] Destination: A._Corelli_-_Sonate_da_Camera_Op.2_-_No.1_in_D_Major.f135.mp4
[download] 100% of 13.84MiB in 00:11
[debug] Invoking downloader on 'https://r4---sn-vgpvoj5-tu1e.googlevideo.com/videoplayback?key=yt6&mime=audio%2Fwebm&ipbits=0&initcwndbps=5932500&pl=26&keepalive=yes&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Crequiressl%2Csource%2Cupn%2Cexpire&itag=251&ei=pZk_WKjJKYjUugKyzLCADA&requiressl=yes&gir=yes&mm=31&mn=sn-vgpvoj5-tu1e&id=o-AObBwKJ10Kivr75gT4DmUhZv2xDAIHKidPWRc2Nis61f&dur=312.721&source=youtube&clen=7057618&mt=1480562991&mv=m&ms=au&lmt=1413179426830927&expire=1480584709&upn=BITija_9hYw&ip=137.122.64.12&signature=93EDCE9B7FF54070D44B0AE86C6F38D1858544ED.738D44D15E89944D781D8A58FCFB2A16AA15FD5F&ratebypass=yes'
[download] Got server HTTP error. Retrying (attempt 1 of 10)...
[download] Got server HTTP error. Retrying (attempt 2 of 10)...
[download] Got server HTTP error. Retrying (attempt 3 of 10)...
[download] Got server HTTP error. Retrying (attempt 4 of 10)...
[download] Got server HTTP error. Retrying (attempt 5 of 10)...
[download] Got server HTTP error. Retrying (attempt 6 of 10)...
[download] Got server HTTP error. Retrying (attempt 7 of 10)...
[download] Got server HTTP error. Retrying (attempt 8 of 10)...
[download] Got server HTTP error. Retrying (attempt 9 of 10)...
[download] Got server HTTP error. Retrying (attempt 10 of 10)...
ERROR: giving up after 10 retries
  File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "./youtubedl/__main__.py", line 19, in <module>
    youtube_dl.main()
  File "./youtubedl/youtube_dl/__init__.py", line 444, in main
    _real_main(argv)
  File "./youtubedl/youtube_dl/__init__.py", line 434, in _real_main
    retcode = ydl.download(all_urls)
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 1791, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 705, in extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 751, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 1435, in process_video_result
    self.process_info(new_info)
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 1693, in process_info
    partial_success = dl(fname, new_info)
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 1641, in dl
    return fd.download(name, info)
  File "./youtubedl/youtube_dl/downloader/common.py", line 353, in download
    return self.real_download(filename, info_dict)
  File "./youtubedl/youtube_dl/downloader/http.py", line 131, in real_download
    self.report_error('giving up after %s retries' % retries)
  File "./youtubedl/youtube_dl/downloader/common.py", line 162, in report_error
    self.ydl.report_error(*args, **kargs)
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 568, in report_error
    self.trouble(error_message, tb)
  File "./youtubedl/youtube_dl/YoutubeDL.py", line 530, in trouble
    tb_data = traceback.format_list(traceback.extract_stack())

The audio (and only the audio) for https://www.youtube.com/watch?v=9LsYD3gFhuc fails to download. The video (and audio) plays fine in a browser. After running youtube-dl, the output is an mp4 file with no audio! :^(

@FichteFoll
Copy link

@FichteFoll FichteFoll commented Dec 1, 2016

I have also been experiencing this starting about 2-3 weeks ago and it's very annoying and inconsistent. It may work once, then audio is missing, then both audio and video are missing, then it works again.

I have a couple logs from mpv that I can upload on request. For now, this should do:

C:\Users\Fichte>ytdl -v --no-progress --format=bestvideo+bestaudio 35fBK7kCTgU
[debug] System config: []
[debug] User config: ['--ffmpeg-location=e:/Install/_Multimedia/ffmpeg-20151025-git-2ccc1b3-win64-static/bin', '--format=bestvideo[height<=?1440]+bestaudio/best', '--output=w:\\Video\\Download\\%(title)s_%(id)s.%(ext)s', '--no-mtime']
[debug] Command-line args: ['-v', '--no-progress', '--format=bestvideo+bestaudio', '35fBK7kCTgU']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2016.11.22
[debug] Python version 3.5.0 - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-76262-g2ccc1b3, ffprobe N-76262-g2ccc1b3
[debug] Proxy map: {}
[youtube] 35fBK7kCTgU: Downloading webpage
[youtube] 35fBK7kCTgU: Downloading video info webpage
[youtube] 35fBK7kCTgU: Extracting video information
[youtube] {22} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {43} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {18} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {36} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {17} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {137} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {248} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {136} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {247} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {135} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {244} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {134} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {243} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {133} signature length 44.38, html5 player en_US-vflzQdL0P
[youtube] {242} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {160} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {278} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {140} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {171} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {249} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {250} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {251} signature length 44.40, html5 player en_US-vflzQdL0P
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on 'https://r2---sn-4g57kn7s.googlevideo.com/videoplayback?source=youtube&initcwndbps=1333750&id=o-AKyqyYID9S1by3OxovNgeifrJyys_0jHY0pDQkowgY7a&dur=292.200&expire=1480637632&key=yt6&ip=2a02%3A908%3A1210%3A3420%3A2831%3A7a9f%3A3ae2%3Ae3a3&lmt=1473481394500028&upn=zrGO0PBrA3Q&ipbits=0&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Crequiressl%2Csource%2Cupn%2Cexpire&nh=IgpwZjAxLmZyYTE2KhsyMDAxOjczMDoyZDAxOjE1OjpkNTJlOmIzNjE&keepalive=yes&mime=video%2Fmp4&pl=36&itag=137&ei=YGhAWIrEBoSligbkmKeACw&ms=au&mt=1480615712&mv=m&mm=31&requiressl=yes&gir=yes&clen=20315046&mn=sn-4g57kn7s&signature=5D3AF4ADE88E83490E125064656D1B2F849F394C.226A1A8351C79F9C98DEE68C70D1EF3B20CC32F3&ratebypass=yes'
[download] Got server HTTP error. Retrying (attempt 1 of 10)...
[download] Destination: w:\Video\Download\FRND - Friend_35fBK7kCTgU.f137.mp4
[download] Download completed
[debug] Invoking downloader on 'https://r2---sn-4g57kn7s.googlevideo.com/videoplayback?source=youtube&initcwndbps=1333750&id=o-AKyqyYID9S1by3OxovNgeifrJyys_0jHY0pDQkowgY7a&dur=292.201&expire=1480637632&key=yt6&ip=2a02%3A908%3A1210%3A3420%3A2831%3A7a9f%3A3ae2%3Ae3a3&lmt=1473362184798877&upn=zrGO0PBrA3Q&ipbits=0&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Crequiressl%2Csource%2Cupn%2Cexpire&nh=IgpwZjAxLmZyYTE2KhsyMDAxOjczMDoyZDAxOjE1OjpkNTJlOmIzNjE&keepalive=yes&mime=audio%2Fwebm&pl=36&itag=251&ei=YGhAWIrEBoSligbkmKeACw&ms=au&mt=1480615712&mv=m&mm=31&requiressl=yes&gir=yes&clen=5172805&mn=sn-4g57kn7s&signature=48807893BD929BE211CBD960946E10BAC64C8D49.09A1067A46F547F43EC154285FE509719DBDC735&ratebypass=yes'
[download] Destination: w:\Video\Download\FRND - Friend_35fBK7kCTgU.f251.webm
[download] Download completed
[ffmpeg] Merging formats into "w:\Video\Download\FRND - Friend_35fBK7kCTgU.mkv"
[debug] ffmpeg command line: 'e:/Install/_Multimedia/ffmpeg-20151025-git-2ccc1b3-win64-static/bin\ffmpeg' -y -i 'file:w:\Video\Download\FRND - Friend_35fBK7kCTgU.f137.mp4' -i 'file:w:\Video\Download\FRND - Friend_35fBK7kCTgU.f251.webm' -c copy -map 0:v:0 -map 1:a:0 'file:w:\Video\Download\FRND - Friend_35fBK7kCTgU.temp.mkv'
Deleting original file w:\Video\Download\FRND - Friend_35fBK7kCTgU.f137.mp4 (pass -k to keep)
Deleting original file w:\Video\Download\FRND - Friend_35fBK7kCTgU.f251.webm (pass -k to keep) 
[debug] System config: []
[debug] User config: ['--ffmpeg-location=e:/Install/_Multimedia/ffmpeg-20151025-git-2ccc1b3-win64-static/bin', '--format=bestvideo[height<=?1440]+bestaudio/best', '--output=w:\\Video\\Download\\%(title)s_%(id)s.%(ext)s', '--no-mtime']
[debug] Command-line args: ['-v', '--no-progress', '--format=bestvideo+bestaudio', '35fBK7kCTgU']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2016.11.22
[debug] Python version 3.5.0 - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-76262-g2ccc1b3, ffprobe N-76262-g2ccc1b3
[debug] Proxy map: {}
[youtube] 35fBK7kCTgU: Downloading webpage
[youtube] 35fBK7kCTgU: Downloading video info webpage
[youtube] 35fBK7kCTgU: Extracting video information
[youtube] {22} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {43} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {18} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {36} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {17} signature length 42.40, html5 player en_US-vflzQdL0P
[youtube] {137} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {248} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {136} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {247} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {135} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {244} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {134} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {243} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {133} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {242} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {160} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {278} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {140} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {171} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {249} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {250} signature length 44.40, html5 player en_US-vflzQdL0P
[youtube] {251} signature length 44.40, html5 player en_US-vflzQdL0P
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on 'https://r2---sn-4g57kn7s.googlevideo.com/videoplayback?ei=2WpAWL6FDMnHWZrFj4AH&pl=36&upn=cL0-RXfNWUU&ipbits=0&mt=1480616330&requiressl=yes&itag=137&lmt=1473481394500028&keepalive=yes&dur=292.200&expire=1480638265&nh=IgpwZjAyLmZyYTE1KhkyMDAxOjQ4NjA6MToxOjA6MWFhZTowOjE3&ip=2a02%3A908%3A1210%3A3420%3A2831%3A7a9f%3A3ae2%3Ae3a3&mime=video%2Fmp4&key=yt6&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Crequiressl%2Csource%2Cupn%2Cexpire&initcwndbps=1250000&mm=31&gir=yes&mn=sn-4g57kn7s&id=o-ABIgrqMiQ2TQs4_jl4N3iufaEalTq6sz1nCSv8QivR3v&clen=20315046&mv=m&ms=au&source=youtube&signature=DA179736D4B56699DDEDBB688C2CD21FA749F813.826C9DFB09C7CB2259623E69B2B892D0AAE77F1B&ratebypass=yes'
[download] Destination: w:\Video\Download\FRND - Friend_35fBK7kCTgU.f137.mp4
[download] Download completed
[debug] Invoking downloader on 'https://r2---sn-4g57kn7s.googlevideo.com/videoplayback?ei=2WpAWL6FDMnHWZrFj4AH&pl=36&upn=cL0-RXfNWUU&ipbits=0&mt=1480616330&requiressl=yes&itag=251&lmt=1473362184798877&keepalive=yes&dur=292.201&expire=1480638265&nh=IgpwZjAyLmZyYTE1KhkyMDAxOjQ4NjA6MToxOjA6MWFhZTowOjE3&ip=2a02%3A908%3A1210%3A3420%3A2831%3A7a9f%3A3ae2%3Ae3a3&mime=audio%2Fwebm&key=yt6&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Crequiressl%2Csource%2Cupn%2Cexpire&initcwndbps=1250000&mm=31&gir=yes&mn=sn-4g57kn7s&id=o-ABIgrqMiQ2TQs4_jl4N3iufaEalTq6sz1nCSv8QivR3v&clen=5172805&mv=m&ms=au&source=youtube&signature=36593A713EC328D960940148DCA5111A29189857.76E11D52B998BABD3F40120114A5950E767D70D5&ratebypass=yes'
[download] Got server HTTP error. Retrying (attempt 1 of 10)...
[download] Got server HTTP error. Retrying (attempt 2 of 10)...
[download] Destination: w:\Video\Download\FRND - Friend_35fBK7kCTgU.f251.webm
[download] Download completed
[ffmpeg] Merging formats into "w:\Video\Download\FRND - Friend_35fBK7kCTgU.mkv"
[debug] ffmpeg command line: 'e:/Install/_Multimedia/ffmpeg-20151025-git-2ccc1b3-win64-static/bin\ffmpeg' -y -i 'file:w:\Video\Download\FRND - Friend_35fBK7kCTgU.f137.mp4' -i 'file:w:\Video\Download\FRND - Friend_35fBK7kCTgU.f251.webm' -c copy -map 0:v:0 -map 1:a:0 'file:w:\Video\Download\FRND - Friend_35fBK7kCTgU.temp.mkv'
Deleting original file w:\Video\Download\FRND - Friend_35fBK7kCTgU.f137.mp4 (pass -k to keep)
Deleting original file w:\Video\Download\FRND - Friend_35fBK7kCTgU.f251.webm (pass -k to keep) 

My interent connection is usually very stable and I have only encountered this with YouTube.

@ninedotnine
Copy link
Author

@ninedotnine ninedotnine commented Dec 2, 2016

I should have mentioned that for me it's reliably reproducible - it doesn't ever work.

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Dec 2, 2016

Format 251 you are requesting is not available. This is server-side YouTube issue. Select another format.

@dstftw dstftw closed this Dec 2, 2016
@FichteFoll
Copy link

@FichteFoll FichteFoll commented Dec 3, 2016

So, my issue is a different one I presume?

@yan12125
Copy link
Collaborator

@yan12125 yan12125 commented Dec 3, 2016

@FichteFoll that's normal. YouTube servers are not always stable, so there's a retry mechanism in youtube-dl.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
You can’t perform that action at this time.