Nicht verfügbare Filme in Filmliste

[pidoubleyou]

Im Forum wurde gemeldet, dass einige Filme in ARD/MDR in der Liste enthalten sind, obwohl sie nicht mehr online sind.

Erste Analyse:
bei der Prüfung, ob das Video noch online ist, erfolgt seitens der Mediathek ein Redirect auf eine 404-Fehlerseite. Somit kommt beim Testrequest ein StatusCode 200 zurück, was als "Film ist verfügbar" interpretiert wird.

[pidoubleyou]

erste Idee: Redirects nicht folgen

muss aber geprüft werden, ob es andere Redirects gibt, die notwendig sind (z.B. http -> https)

[Georg-J]

Ich schlage vor, zur Prüfung den Content-Type heranzuziehen.
Die nächstbeste Möglichkeit wäre, den Dateityp der vom Server zurückgegebenen Redirect-Location zu betrachten.

Fehlerfall: Content-Type: text/html; charset=UTF-8

S:\>wget -S --spider https://odmdr-a.akamaihd.net/mp4dyn2/0/FCMS-03d44b3e-5cfa-42f5-9819-9a7ac79204b9-be7c2950aac6_03.mp4
Spider mode enabled. Check if remote file exists.
--2020-10-21 01:47:27--  https://odmdr-a.akamaihd.net/mp4dyn2/0/FCMS-03d44b3e-5cfa-42f5-9819-9a7ac79204b9-be7c2950aac6_03.mp4
Resolving odmdr-a.akamaihd.net (odmdr-a.akamaihd.net)... 23.55.161.146, 23.55.161.160
Connecting to odmdr-a.akamaihd.net (odmdr-a.akamaihd.net)|23.55.161.146|:443... connected.
HTTP request sent, awaiting response...
  HTTP/1.1 302 Moved Temporarily
  Server: Apache
  Location: https://www.mdr.de/404/index.html
  Content-Type: text/html; charset=iso-8859-1
  Strict-Transport-Security: max-age=31536000
  Date: Tue, 20 Oct 2020 23:48:10 GMT
  Connection: keep-alive
  Access-Control-Expose-Headers: *
  Access-Control-Max-Age: 86400
  Access-Control-Allow-Credentials: false
  Access-Control-Allow-Headers: *
  Access-Control-Allow-Methods: GET,HEAD,OPTIONS
  Access-Control-Allow-Origin: *
Location: https://www.mdr.de/404/index.html [following]
Spider mode enabled. Check if remote file exists.
--2020-10-21 01:47:28--  https://www.mdr.de/404/index.html
Resolving www.mdr.de (www.mdr.de)... 23.203.64.90
Connecting to www.mdr.de (www.mdr.de)|23.203.64.90|:443... connected.
HTTP request sent, awaiting response...
  HTTP/1.1 200 OK
  Server: Apache
  Content-Type: text/html; charset=UTF-8
  Strict-Transport-Security: max-age=31536000
  Cache-Control: max-age=35
  Date: Tue, 20 Oct 2020 23:48:10 GMT
  Connection: keep-alive
  Vary: Accept-Encoding
  Access-Control-Max-Age: 86400
  Access-Control-Allow-Credentials: false
  Access-Control-Allow-Headers: *
  Access-Control-Allow-Methods: GET,POST
  Access-Control-Allow-Origin: *
Length: unspecified [text/html]
Remote file exists and could contain further links,
but recursion is disabled -- not retrieving.

Normalfall: Content-Type: video/mp4

S:\>wget -S --spider https://pdvideosdaserste-a.akamaihd.net/int/2016/04/21/b9ed3e08-4830-46d6-9579-419c1ad58fb1/1280-3_711841.mp4
Spider mode enabled. Check if remote file exists.
--2020-10-21 01:49:22--  https://pdvideosdaserste-a.akamaihd.net/int/2016/04/21/b9ed3e08-4830-46d6-9579-419c1ad58fb1/1280-3_711841.mp4
Resolving pdvideosdaserste-a.akamaihd.net (pdvideosdaserste-a.akamaihd.net)... 23.55.161.156, 23.55.161.158
Connecting to pdvideosdaserste-a.akamaihd.net (pdvideosdaserste-a.akamaihd.net)|23.55.161.156|:443... connected.
HTTP request sent, awaiting response...
  HTTP/1.1 200 OK
  Accept-Ranges: bytes
  Content-Length: 2491985160
  Content-Type: video/mp4
  ETag: "9651f972377b3d0737f1f7395451561a:1595586190.997165"
  Last-Modified: Fri, 24 Jul 2020 10:19:39 GMT
  Server: AkamaiNetStorage
  X-Akamai-Path-Stats: [3:488:2512]
  Date: Tue, 20 Oct 2020 23:50:04 GMT
  Connection: keep-alive
  Access-Control-Max-Age: 86400
  Access-Control-Allow-Credentials: false
  Access-Control-Allow-Headers: *
  Access-Control-Allow-Methods: GET, HEAD, OPTIONS
  Access-Control-Allow-Origin: *
Length: 2491985160 (2.3G) [video/mp4]
Remote file exists.

Normalfall: Content-Type: application/vnd.apple.mpegurl

S:\>wget -S --spider https://apasfiis.sf.apa.at/ipad/cms-worldwide/2020-10-19_2015_tl_02_Die-Promi-Milli_Signation---Beg__14068603__o__1492935762__s14781060_0__ORF3HD_20180205P_20192502P_Q8C.mp4/playlist.m3u8
Spider mode enabled. Check if remote file exists.
--2020-10-21 01:46:07--  https://apasfiis.sf.apa.at/ipad/cms-worldwide/2020-10-19_2015_tl_02_Die-Promi-Milli_Signation---Beg__14068603__o__1492935762__s14781060_0__ORF3HD_20180205P_20192502P_Q8C.mp4/playlist.m3u8
Resolving apasfiis.sf.apa.at (apasfiis.sf.apa.at)... 185.85.29.131, 185.85.28.131, 185.85.28.129, ...
Connecting to apasfiis.sf.apa.at (apasfiis.sf.apa.at)|185.85.29.131|:443... connected.
HTTP request sent, awaiting response...
  HTTP/1.1 302 Found
  Date: Tue, 20 Oct 2020 23:46:51 GMT
  Server: Varnish
  X-Varnish: 618489176
  Location: /cms-worldwide_nas/_definst_/nas/cms-worldwide/online/2020-10-19_2015_tl_02_Die-Promi-Milli_Signation---Beg__14068603__o__1492935762__s14781060_0__ORF3HD_20180205P_20192502P_Q8C.mp4/playlist.m3u8
  Cache-Control: no-chache, public
  Access-Control-Allow-Origin: *
  Access-Control-Allow-Methods: OPTIONS, GET
  Access-Control-Allow-Headers: Authorization
  Content-Length: 0
  Connection: keep-alive
Location: /cms-worldwide_nas/_definst_/nas/cms-worldwide/online/2020-10-19_2015_tl_02_Die-Promi-Milli_Signation---Beg__14068603__o__1492935762__s14781060_0__ORF3HD_20180205P_20192502P_Q8C.mp4/playlist.m3u8 [following]
Spider mode enabled. Check if remote file exists.
--2020-10-21 01:46:08--  https://apasfiis.sf.apa.at/cms-worldwide_nas/_definst_/nas/cms-worldwide/online/2020-10-19_2015_tl_02_Die-Promi-Milli_Signation---Beg__14068603__o__1492935762__s14781060_0__ORF3HD_20180205P_20192502P_Q8C.mp4/pla
ylist.m3u8
Connecting to apasfiis.sf.apa.at (apasfiis.sf.apa.at)|185.85.29.131|:443... connected.
HTTP request sent, awaiting response...
  HTTP/1.1 200 OK
  Access-Control-Expose-Headers: Date, Server, Content-Type, Content-Length
  Access-Control-Allow-Credentials: true
  Date: Tue, 20 Oct 2020 22:42:48 GMT
  Content-Type: application/vnd.apple.mpegurl
  Content-Length: 126
  Cache-Control: no-chache, public
  Access-Control-Allow-Origin: *
  Access-Control-Allow-Methods: OPTIONS, GET
  Access-Control-Allow-Headers: Authorization
  Accept-Ranges: bytes
  Connection: keep-alive
Length: 126 [application/vnd.apple.mpegurl]
Remote file exists.