Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Higher quality videos not detected, despite being available to AdobeHDS.php #13492

Closed
Twombs opened this issue Jun 25, 2017 · 10 comments
Closed

Higher quality videos not detected, despite being available to AdobeHDS.php #13492

Twombs opened this issue Jun 25, 2017 · 10 comments

Comments

@Twombs
Copy link

@Twombs Twombs commented Jun 25, 2017

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like that [x])
  • Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.06.25. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2017.06.25

Before submitting an issue make sure you have:

  • At least skimmed through README and most notably FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue


If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Higher quality videos not detected.

If the purpose of this issue is a site support request please provide all kinds of example URLs

http://iview.abc.net.au/programs/doctor-who/ZW0979A011S00

Description of your issue, suggested solution and other information

http://iview.abc.net.au/programs/doctor-who/ZW0979A011S00
(1) If I use the AdobeHDS.php script for this same web page, then it detects and downloads the new High Quality video files that are available. But youtube-dl only sees the old low quality video files. If I grab the manifest data using the HDS Link Detector for Firefox, and use that with youtube-dl, then it downloads the High Quality video file.
(2) Is there someway I can download the manifest file or data with youtube-dl ... or specify that be used?

@Twombs
Copy link
Author

@Twombs Twombs commented Jun 26, 2017

Thanks for adding them in bud, I guess. However, they are not really needed.
It is the fact, that something (they) can detect and download the higher resolution files, that is all important. It shows they are there and available. Something that I guess youtube-dl should also be able to do, but isn't.
ABC (iView) have only just started making these higher resolution version videos available.

@d2au
Copy link
Contributor

@d2au d2au commented Jun 26, 2017

@TheDcoder
Copy link

@TheDcoder TheDcoder commented Jun 26, 2017

Is there someway I can download the manifest file

Did you try the --get-url option to get the URL of the manifest file?

@Twombs
Copy link
Author

@Twombs Twombs commented Jun 26, 2017

nope, don't recall seeing that one ... and I went through them all enough times. will give it a go. thanks

@Twombs
Copy link
Author

@Twombs Twombs commented Jun 26, 2017

I do now recall the --get-url_ option, as I checked that and the other get options out. Seeing it on its own, it looked unfamiliar.

In any case, it just gets the m3u8 link, not the manifest.

@Twombs
Copy link
Author

@Twombs Twombs commented Jun 26, 2017

However, not being a nerd head, I did not understand the significance of anything JSON related, but I was inspired to do a dump (ha ha ha), and so used the --dump-json command. In amongst all the data it returned, was several m3u8 entries, but more importantly, some .f4m (manifest) ones too.

Alas though, looking at them, they don't quite match up with what AdobeHDS.php gets.
http://iviewum-vh.akamaihd.net/z/playback/_definst_/_video/ZW0979A011S00MA1D1_0b2d3a57_,650000,500000,220000,60000,.mp4.csmil/manifest.f4m?hdcore=3.7.0
as opposed to the AdobeHDS one
http://iviewum-vh.akamaihd.net/z/playback/_definst_/_video/ZW0979A011S00MA1D1_0b2d3a57_,1500000,1000000,650000,500000,220000,.mp4.csmil/manifest.f4m?hdcore=true&hdnea=st=1498384615~exp=1498394614~acl=/*~hmac=4a2f4794a201b7b0caf6262afd6c40974a0352fd6c6ddb6aa3fb2f96a1bc70da&g=CCBMFNRSEQJC&plugin=jwplayer-3.9.0.0

It is possible I guess, that adding the missing elements might work for other videos too ... or maybe just some of them. Need to do some testing.

@TheDcoder
Copy link

@TheDcoder TheDcoder commented Jun 26, 2017

Hopefully we will have a fixed version of yotube-dl thanks to @d2au's contribution 😁

@0880
Copy link

@0880 0880 commented Jun 26, 2017

Seems to work with #13489 ...

youtube-dl "http://iview.abc.net.au/programs/doctor-who/ZW0979A011S00" -F
[abc.net.au:iview] ZW0979A011S00: Downloading webpage
[abc.net.au:iview] ZW0979A011S00: Downloading f4m manifest
[abc.net.au:iview] ZW0979A011S00: Downloading m3u8 information
[info] Available formats for ZW0979A011S00:
format code  extension  resolution note
hds-200      flv        unknown     200k
hls-200      mp4        320x180     200k , avc1.77.30, mp4a.40.2
hds-388      flv        unknown     388k
hls-388      mp4        512x288     388k , avc1.77.30, mp4a.40.2
hds-505      flv        unknown     505k
hls-505      mp4        640x360     505k , avc1.77.30, mp4a.40.2
hds-774      flv        unknown     774k
hls-774      mp4        800x450     774k , avc1.640028, mp4a.40.2
hds-1162     flv        unknown    1162k
hls-1162     mp4        1024x576   1162k , avc1.640028, mp4a.40.2 (best)
Video: MPEG4 Video (H264) 1024x576 25fps [V: h264 high L4.0, yuv420p, 1024x576]
Audio: AAC 44100Hz stereo 130kbps [A: aac lc, 44100 Hz, stereo, 130 kb/s]

Python - latest version for Windows: https://www.python.org/downloads/ + youtube-dl ...

pip install --upgrade youtube-dl
Collecting youtube-dl
  Downloading youtube_dl-2017.6.25-py2.py3-none-any.whl (1.6MB)
    100% |████████████████████████████████| 1.6MB 239kB/s
Installing collected packages: youtube-dl
Successfully installed youtube-dl-2017.6.25

... + #13489 copied to C:\Python\Lib\site-packages\youtube_dl\extractor\abc.py

@Saklad5
Copy link

@Saklad5 Saklad5 commented Jun 29, 2017

Is it possible that this would affect other extractors? I’ve noticed that TBS has a similar problem, but I assumed that was because it was only able to access the Android-targeted manifest, and that the higher-quality ones required some terrible DRM plugin that Android didn’t support.

@dstftw dstftw closed this in 58179eb Jul 9, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
6 participants
You can’t perform that action at this time.