plugins.ard_mediathek: No playable streams found on this URL

[tmatthews5511]

Checklist

• This is a plugin issue and not a different kind of issue
• I have read the contribution guidelines
• I have checked the list of open and recently closed plugin issues
• I have checked the commit log of the master branch

Streamlink version

Latest build from the master branch

Description

The ARD (German Public TV) seems not to be working at the moment with Streamlink.

It gives a 'error: No playable streams found on this URL: https://www.ardmediathek.de/daserste/live/Y3JpZDovL2Rhc2Vyc3RlLmRlL0xpdmVzdHJlYW0tRGFzRXJzdGU'

Debug log

[cli][debug] OS:         Linux-5.10.0-15-amd64-x86_64-with-glibc2.31
[cli][debug] Python:     3.9.2
[cli][debug] Streamlink: 0.0.0+unknown
[cli][debug] Dependencies:
[cli][debug]  PySocks: 1.7.1
[cli][debug]  isodate: 0.6.1
[cli][debug]  lxml: 4.8.0
[cli][debug]  pycountry: 22.3.5
[cli][debug]  pycryptodome: 3.14.1
[cli][debug]  requests: 2.27.1
[cli][debug]  websocket-client: 1.3.1
[cli][debug]  importlib-metadata: 4.11.3
[cli][debug] Arguments:
[cli][debug]  url=https://www.ardmediathek.de/daserste/live/Y3JpZDovL2Rhc2Vyc3RlLmRlL0xpdmVzdHJlYW0tRGFzRXJzdGU
[cli][debug]  stream=['720p']
[cli][debug]  --loglevel=debug
[cli][debug]  --output=blah.mp4
[cli][debug]  --http-proxy=socks5h://xxx.xxxd@xxxx.dynv6.net:8200
[cli][info] Found matching plugin ard_mediathek for URL https://www.ardmediathek.de/daserste/live/Y3JpZDovL2Rhc2Vyc3RlLmRlL0xpdmVzdHJlYW0tRGFzRXJzdGU
error: No playable streams found on this URL: https://www.ardmediathek.de/daserste/live/Y3JpZDovL2Rhc2Vyc3RlLmRlL0xpdmVzdHJlYW0tRGFzRXJzdGU

[bastimeyer]

The response of the initial HTTP request seems to be empty now, so the plugin can't find the stream URL. Not sure yet why.

<script id="fetchedContextValue" type="application/json">
    null
</script>

The same request gets made by their site though and proper JSON data is included. That means that most likely some headers are missing.

---

A couple of live streams on ard_mediathek appear to be static now:

• DasErste: https://mcdn.daserste.de/daserste/de/master.m3u8
• WDR: https://mcdn.wdr.de/wdr/wdrfs/de/master.m3u8
• NDR: https://mcdn.ndr.de/ndr/hls/ndr_fs/ndr_nds/master.m3u8
• BR: https://mcdn.br.de/br/fs/bfs_sued/hls/de/master.m3u8
• ArdOne: https://mcdn.one.ard.de/ardone/hls/master.m3u8
• Alpha: https://mcdn.br.de/br/fs/ard_alpha/hls/de/master.m3u8

Others are hosed on Akamai and are probably not static:

• SWR: https://swrbwd-hls.akamaized.net/hls/live/2018672/swrbwd/master.m3u8
• HR: https://hrhlsde.akamaized.net/hls/live/2024526/hrhlsde/index.m3u8
• MDR: https://mdrtvsnhls.akamaized.net/hls/live/2016928/mdrtvsn/index.m3u8
• RadioBremen: https://rbhlslive.akamaized.net/hls/live/2020435/rbfs/master.m3u8
• RBB: https://rbb-hls-brandenburg.akamaized.net/hls/live/2017825/rbb_brandenburg/index.m3u8
• SR: https://srfs.akamaized.net/hls/live/689649/srfsgeo/index.m3u8
• Arte: https://arteliveext.akamaized.net/hls/live/2030993/artelive_de/index.m3u8
• KiKa: https://kikageohls.akamaized.net/hls/live/2022693-b/livetvkika_de/master.m3u8
• 3Sat: https://zdf-hls-18.akamaized.net/hls/live/2016501/dach/high/master.m3u8
• TagesSchau24: https://tagesschau.akamaized.net/hls/live/2020115/tagesschau/tagesschau_1/master.m3u8
• Phoenix: https://zdf-hls-19.akamaized.net/hls/live/2016502/de/high/master.m3u8
• DeutscheWelle: https://dwamdstream107.akamaized.net/hls/live/2017968/dwstream107/index.m3u8

[bastimeyer]

Had a second look at the plugin and managed to fix the JSON data retrieval and validation, so that the correct stream URLs get found. That would be the diff (not submitting a PR yet):

diff --git a/src/streamlink/plugins/ard_mediathek.py b/src/streamlink/plugins/ard_mediathek.py
index c2c51c14..5cc1cdfd 100644
--- a/src/streamlink/plugins/ard_mediathek.py
+++ b/src/streamlink/plugins/ard_mediathek.py
@@ -33,14 +33,20 @@ class ARDMediathek(Plugin):
     def _get_streams(self):
         data_json = self.session.http.get(self.url, schema=validate.Schema(
             validate.parse_html(),
-            validate.xml_findtext(".//script[@id='fetchedContextValue'][@type='application/json']"),
+            validate.xml_findtext(".//script[@id='fetchedContextValue2'][@type='application/json']"),
             validate.any(None, validate.all(
                 validate.parse_json(),
-                {str: dict},
-                validate.transform(lambda obj: list(obj.items())),
-                validate.filter(lambda item: item[0].startswith("https://api.ardmediathek.de/page-gateway/pages/")),
-                validate.any(validate.get((0, 1)), [])
-            ))
+                [list],
+                validate.filter(lambda item: (
+                    len(item) == 2
+                    and type(item[0]) is str
+                    and type(item[1]) is dict
+                    and item[0].startswith("https://api.ardmediathek.de/page-gateway/pages/")
+                )),
+                validate.get((0, 1)),
+                {"data": dict},
+                validate.get("data"),
+            )),
         ))
         if not data_json:
             return

However, all the static streams I've listed earlier have a separate HLS audio playlist, and instead of using MPEG-TS containers for the audio segments, ADTS containers are used for the AAC audio data, and somehow this causes problems when muxing the two streams into the output.

From what it looks like, the audio stream alone is causing issues when trying to play it on the fly. Saving it and playing it back afterwards works though. @back-to, do you have any idea?

Video: https://mcdn.daserste.de/daserste/de/master_1920p_5000.m3u8
Audio: https://mcdn.daserste.de/daserste/de/master_audio1_128.m3u8

[bastimeyer]

https://datatracker.ietf.org/doc/html/rfc8216#section-3.4

#3534 (comment)