Youtube-dl Not Detecting Some 1080p Streams #1605
Comments
|
Duplicate of #1578. YouTube seems to have introduced a bug in that they sometimes don't list all available formats. |
|
Ok, I think I found the solution. Thanks to Issue #1596 I learned how to list all available formats with youtube-dl. For the video I checked, on closer inspection, I noticed that the tag for the 1080p mp4 is now 137, NOT 37. So I tried "f137", and the 1080p mp4 stream downloaded for that video. If this is consistent, from now on everyone should list all available formats b4 attempting to download whichever resolution they want. Edit: Never mind, the download is not playing. What does DASH video mean? |
|
no, 137 is DASH Video. |
|
HUZZAH! Nothing MeGUI couldn't handle! >:-) So, solution found for people who know how to mux and demux their media. |
|
Well it's not optimal, but we may be stuck with it. Youtube did have both tags on the 1080p videos before, not sure if they've dropped 37 or if this is a temporary glitch. |
|
Youtube is doing some changes which is breaking 1080p on all downloaders, lets pray this is temporary. |
|
It seems they also dropped webm 1080p (itag 46) and webm 720p (itag 45) |
|
One thing I've been doing to get around this is downloading the tag 137 and tag 141 and mux-ing them back together with ffmpeg -i video.mp4 -i audio.mp4 -c copy output.mp4 |
|
Yes, this is possible but annoying especially if you want to integrate this into an app. |
|
@seojoohyun DASH is adaptive from itag 133 ~ 138, but if you download itag 137, you will always get 1080p video. |
|
@strex How do you know that the App is indeed using format 37? Can you provide a pcap dump? |
|
YouTube app on my iphone still use format 18 at most time. For the content it plays, youtube-dl can also download itag 18. Tried one content youtube-dl failed to download itag 18, YouTube app says "This content not available for mobile device". |
|
The content mentioned by @strex doesn't have itag 37 on Desktop. $ youtube-dl -F b6vSf0cA9qY [youtube] Setting language [youtube] b6vSf0cA9qY: Downloading video webpage [youtube] b6vSf0cA9qY: Downloading video info webpage [youtube] b6vSf0cA9qY: Extracting video information Available formats: 22 : mp4 [720x1280] 18 : mp4 [360x640] 43 : webm [360x640] 5 : flv [240x400] 36 : 3gp [240x320] 17 : 3gp [144x176] 137 : mp4 [1080p] (DASH Video) 136 : mp4 [720p] (DASH Video) 135 : mp4 [480p] (DASH Video) 134 : mp4 [360p] (DASH Video) 133 : mp4 [240p] (DASH Video) 160 : mp4 [192p] (DASH Video) 141 : mp4 [256k] (DASH Audio) 172 : webm [256k] (DASH Audio) 140 : mp4 [128k] (DASH Audio) 171 : webm [128k] (DASH Audio) 139 : mp4 [48k] (DASH Audio) |
|
@strex this is very interesting, is there a way to find out the user agent of this app ? |
|
YouTube verify more than just UA. Simply change UA won't get the job done. Actually there is no watch page or things similar when video plays on YouTube app on IOS, and YouTube serves totally different page for YouTube in browser on IOS. |
|
I'm afraid the full 1080p mp4 stream is not being detected on ANY 1080p video anymore, old or recent. Is Youtube doing this intentionally to prevent people from DLing 1080p streams? |
|
@goldensun87 1080p is available for our test video: |
|
@phihag Does that mean Youtube might be rolling back the new DASH video only update? |
|
@philhag I strongly disagree with your interpretation. YouTube introduced for large files at higher resolution than 720p (your quoted excerpt is not large enough) the DASH format i.e. separate download of sound and video streams. For exemple I did not yet succeed to download (in Linux Debian) this video in 1080p since the change: http://www.youtube.com/watch?v=OnoNITE-CLc You can check in any browser that 1080p is available to viewers. However your program (right now in Ubuntu 12.04) just goes up till 720p no more, as expected if you didn't implement the change: $ youtube-dl -F http://www.youtube.com/watch?v=OnoNITE-CLc The 1080p file is around 85 MB. Some other Linux available programs have already tried to implement this feature. For exemple ClipGrab. However it is still a mess to remux Audio and Video with the currently available libraries. According to its developper I would have to remove entirely the ffmpeg binary and replace it by a symlink to the libav binary version available in daily build from GitHub in Launchpad albeit only from Raring 13.04 ... FYI ClipGrab in Windows is working fine. To me it should be better to use libav from the sources instead of using ffmpeg if the DASH streams are not yet supported in ffmpeg. I was just looking if some other program would fit the bill ... But it looks like you even arn't even aware of the latest rules implemented by YouTube ... |
|
@pmo-19 We are well aware of DASH, and muxing works fine with ffmpeg. Are you sure you're using a recent version of youtube-dl? Add |
|
@phihag OK thank you for your answer. Sorry for the delay I took answering back. However you were right my installed version was not up to date. It looks like the tool sees now all the available formats. But after testing the latest version I can confirm that, as I told you before, the ffmpeg library (you seem to use) is not working for muxing back the sound and video files. $ youtube-dl -F http://www.youtube.com/watch?v=OnoNITE-CLc Using your tool I get a Video file with no sound at all ... With ClipGrab I got a somewaht garbled Audio (the file size match the Audio file size) and no Video ... Which as I said before was fixed according to its German developper by using a dirty symlink from ffmpeg to libav binary. However from the daily github packages available in Launchpad. These packages are supplied for 13.04 Raring and up. So at this moment as I am using 12.04 Precise I cannot test it properly. Can you confirm this behaviour ? As there has been 1 or 2 updates since my last test. If you can't confirm I will perform a remake ... |
|
@phihag I forgot to state again that I intended to download the 1080p version of the above mentioned clip. $ youtube-dl -f137 http://www.youtube.com/watch?v=OnoNITE-CLc |
|
It might be something to do with your version of ffmpeg both ffmpeg and libav should be able to do this by different parameters, and I am using ffmpeg built from source. The combined video plays fine. |
|
FYI all URLs provided here, with todays build, none show 1080p available, except for dash :( |
|
@xanadu Thank you very much for your insight. Well I took almost 3 month to answer back. My version of ffmpeg was not the culprit as I have the latest version of this library installed through the following Launchpad ppa https://launchpad.net/~jon-severinsson/+archive/ffmpeg In fact I thought the launch of the ffmpeg cmd. lines were part of the youtube-dl program. Then I had never had to use these type of ffmpeg cmd. Your set of cmd. worked perfectly. Thank you again. I tested it end of December. I did not retry with the latest build ... May be in the coming days. Here is the result for the available formats: $ youtube-dl -F http://www.youtube.com/watch?v=OnoNITE-CLc @FernandoMiguel Do you see something different ? |
|
@pmo-19 exactly. google killed all >720p streams and now we only have dash one availables, which require us to use ffmpeg to mix them on a related note, it's amazing how much processing power youtube has on their hands, to be able to delete all files they dont want (that took a big chunk of time to process previously) and make new ones for ALL their archive! |
|
@FernandoMiguel DASH or Dynamic Adaptive Streaming over HTTP is an adaptative bitrate streaming technology. The specification provides specific guidance and formats for use with two types of containers: ISO base media file format (e.g. MP4 file format) or MPEG-2 Transport Stream. See Wikipedia http://en.wikipedia.org/wiki/Dynamic_Adaptive_Streaming_over_HTTP You can also refer to DASH Adaptive Streaming for HTML 5 Video This is a more efficient way to transmit multimedia over HTTP and may be the reason why it is used by Google's YouTube. If you don't like to use ffmpeg cmd. line to re-assemble the multimedia file you can use a GUI application like ClipGrab which works (now) well in Linux, Mac OS X and Windows ... to download the parts from the URL and re-assemble it later on. I have tested it successfuly although some previous versions (end of 2013) were compatible with ffmpeg only and now the latest version will only work with libav ... |
|
I just found a Firefox Add-On called "Complete Youtube Saver". It can automatically mux the dash and audio, but only if the user directs the add-on to the folder where they have their latest version of ffmpeg.exe saved. @phihag I don't know if the developer of Complete Youtube Saver provides the source code for his program to everyone, but if he does, then maybe you can study the programming and incorporate the auto function into your program. |
|
@pmo-19 after i got ffmpeg working (required 3rd party repo), it's working well, other than checking if there's an higher version and pick that one. we need a flag to do all of this automaticly and fallback graciously |
|
@xanadu I used successfuly your ffmpeg cmd. lines to mux back Audio / Video. I recently build myself from source the libav 9.12. Can you tell me which cmd. line instructions you use to mux with libav ? |
|
@FernandoMiguel just wanted to say that actually, YouTube doesn't need that much of processing power in order to change to DASH because they can just transmux it. It would be another story if they had to transcode all the catalog. Transmuxing is a very light operation and it can be done only the first time a user watches the video at 1080p. Regards. |
The bug has occurred on both vevo and non-vevo videos. I can't name any specific videos. It is basically hit-or-miss. The program JDownloader has also had trouble detecting several 1080p streams, where the program manages to detect the 1080p stream after few tries, or fails to detect altogether.
The text was updated successfully, but these errors were encountered: