[ZDF] HD format as mp4 file (best) not found

[andreygursky]

• I've verified and I assure that I'm running youtube-dl 2018.09.26

Before submitting an issue make sure you have:

• At least skimmed through the README, most notably the FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones
• Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

---

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

youtube-dl -v -F https://www.zdf.de/filme/kudamm-56/kudamm-56-teil-1-102.html
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'https://www.zdf.de/filme/kudamm-56/kudamm-56-teil-1-102.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.09.26
[debug] Python version 2.7.15 (CPython) - Linux-4.14.0-3-amd64-x86_64-with-debian-9.0
[debug] exe versions: ffmpeg 3.4.2-1, ffprobe 3.4.2-1, rtmpdump 2.4
[debug] Proxy map: {}
[ZDF] kudamm-56-teil-1-102: Downloading webpage
[ZDF] kudamm-56-teil-1-102: Downloading JSON content
[ZDF] kudamm-56-teil-1-102: Downloading JSON metadata
[ZDF] kudamm-56-teil-1-102: Downloading m3u8 information
[ZDF] kudamm-56-teil-1-102: Downloading m3u8 information
[ZDF] kudamm-56-teil-1-102: Downloading f4m manifest
[ZDF] kudamm-56-teil-1-102: Downloading f4m manifest
[info] Available formats for kudamm-56-teil-1-102:
format code                              extension  resolution note
hls-55-0                                 mp4        audio only   55k , mp4a.40.2
hls-55-1                                 mp4        audio only   55k , mp4a.40.2
http-h264_aac_mp4_http_na_na-low         mp4        unknown    [deu] low 
http-h264_aac_mp4_http_na_na-high-0      mp4        unknown    [deu] high 
http-h264_aac_mp4_http_na_na-high-1      mp4        unknown    [deu] high 
http-h264_aac_mp4_http_na_na-veryhigh-0  mp4        unknown    [deu] veryhigh 
http-h264_aac_mp4_http_na_na-veryhigh-1  mp4        unknown    [deu] veryhigh 
hls-124                                  mp4        240x136     124k , avc1.66.30, mp4a.40.2
hds-187-0                                flv        unknown     187k 
hds-187-1                                flv        unknown     187k 
hls-187                                  mp4        320x176     187k , avc1.77.30, mp4a.40.2
hls-220                                  mp4        320x176     220k , avc1.66.30, mp4a.40.2
hls-273                                  mp4        320x176     273k , avc1.66.30, mp4a.40.2
hds-435-0                                flv        unknown     435k 
hds-435-1                                flv        unknown     435k 
hls-435                                  mp4        480x272     435k , avc1.77.30, mp4a.40.2
hls-476                                  mp4        480x272     476k , avc1.66.30, mp4a.40.2
hds-605                                  flv        unknown     605k 
hls-605                                  mp4        640x360     605k , avc1.77.30, mp4a.40.2
hds-1456                                 flv        unknown    1456k 
hls-1456                                 mp4        852x480    1456k , avc1.77.30, mp4a.40.2
hds-2257                                 flv        unknown    2257k 
hls-2257                                 mp4        1024x576   2257k , avc1.77.30, mp4a.40.2
hds-3258                                 flv        unknown    3258k 
hls-3258                                 mp4        1280x720   3258k , avc1.77.30, mp4a.40.2 (best)

---

Description of your issue, suggested solution and other information

1280x720 mp4 file (https://rodlzdf-a.akamaihd.net/none/zdf/16/03/160320_kudamm_teil1_kud/4/160320_kudamm_teil1_kud_3328k_p36v12.mp4) has not been discovered. It should be selected as "best" instead of hls-3258 ts stream (which would need ffmpeg processing).

Above is only an example for the issue with ZDF.

I'm aware of one working workaround for this issue: using the advertised HTTP link for mp4 file with the highest resolution, try to locate a file with HD resolution by replacing the trailing part of the URL.

https://github.com/mediathekview/MServer/blob/8dc8646ba66d80d747bf21394dcc7ed0a1f293dc/src/main/java/mServer/crawler/sender/MediathekZdf.java#L189-L236

  private static void updateHdStatus(DatenFilm film, String urlSeite) {
    // manuell die Auflösung für HD setzen, 2 Versuche
    updateHd("1456k_p13v12.mp4", "3328k_p36v12.mp4", film, urlSeite);
    updateHd("2256k_p14v12.mp4", "3328k_p36v12.mp4", film, urlSeite);
    updateHd("2328k_p35v12.mp4", "3328k_p36v12.mp4", film, urlSeite);


    updateHd("1456k_p13v12.mp4", "3256k_p15v12.mp4", film, urlSeite);
    updateHd("2256k_p14v12.mp4", "3256k_p15v12.mp4", film, urlSeite);
    updateHd("2328k_p35v12.mp4", "3256k_p15v12.mp4", film, urlSeite);


    updateHd("1496k_p13v13.mp4", "3296k_p15v13.mp4", film, urlSeite);
    updateHd("2296k_p14v13.mp4", "3296k_p15v13.mp4", film, urlSeite);
    updateHd("2328k_p35v13.mp4", "3296k_p15v13.mp4", film, urlSeite);


    updateHd("1496k_p13v13.mp4", "3328k_p36v13.mp4", film, urlSeite);
    updateHd("2296k_p14v13.mp4", "3328k_p36v13.mp4", film, urlSeite);
    updateHd("2328k_p35v13.mp4", "3328k_p36v13.mp4", film, urlSeite);


    updateHd("1496k_p13v14.mp4", "3328k_p36v14.mp4", film, urlSeite);
    updateHd("2296k_p14v14.mp4", "3328k_p36v14.mp4", film, urlSeite);
    updateHd("2328k_p35v14.mp4", "3328k_p36v14.mp4", film, urlSeite);


    updateHd("1496k_p13v14.mp4", "3328k_p35v14.mp4", film, urlSeite);
    updateHd("2296k_p14v14.mp4", "3328k_p35v14.mp4", film, urlSeite);
    updateHd("2328k_p35v14.mp4", "3328k_p35v14.mp4", film, urlSeite);
  }


  private static void modifyUrl(DatenFilm film, String urlSeite, FilmeSuchen mSFilmeSuchen) {
    //große URL verbessern
    changeUrl("2256k_p14v11.mp4", "2328k_p35v11.mp4", film, urlSeite, mSFilmeSuchen);
    changeUrl("2256k_p14v12.mp4", "2328k_p35v12.mp4", film, urlSeite, mSFilmeSuchen);
    changeUrl("2296k_p14v13.mp4", "2328k_p35v13.mp4", film, urlSeite, mSFilmeSuchen);


    //klein nach groß
    changeUrl("1456k_p13v11.mp4", "2328k_p35v11.mp4", film, urlSeite, mSFilmeSuchen);
    changeUrl("1456k_p13v11.mp4", "2256k_p14v11.mp4", film, urlSeite, mSFilmeSuchen); //wenns nicht geht, dann vielleicht so


    changeUrl("1456k_p13v12.mp4", "2328k_p35v12.mp4", film, urlSeite, mSFilmeSuchen);
    changeUrl("1456k_p13v12.mp4", "2256k_p14v12.mp4", film, urlSeite, mSFilmeSuchen); //wenns nicht geht, dann vielleicht so


    changeUrl("1496k_p13v13.mp4", "2328k_p35v13.mp4", film, urlSeite, mSFilmeSuchen);
    changeUrl("1496k_p13v13.mp4", "2296k_p14v13.mp4", film, urlSeite, mSFilmeSuchen); //wenns nicht geht, dann vielleicht so
  }


  public static void urlTauschen(DatenFilm film, String urlSeite, FilmeSuchen mSFilmeSuchen) {
    modifyUrl(film, urlSeite, mSFilmeSuchen);
    updateHdStatus(film, urlSeite);
  }