Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Support new RTE Player #18417
Support new RTE Player #18417
Comments
|
While I was able to start watching provided sample programme from a southern European location (i.e. outside of Ireland) and without the need to sign-in, things look pretty grim:
TL;DR: If this "beta" RTE player goes into production, you can probably forget about downloading RTE shows (with yt-dl or otherwise...); it's UKTVplay all over again... |
|
Hopefully, someone will make an open-source implementation of Widevine (although the odds of that happening seem low). |
|
This doesn't sound like good news, at all. No!! |
|
Obviously the beta stage is over now with RTE Player. My bug report below. I doubt anything has changed to make it easier to DL anything from RTE.
|
|
I don't know if this is of any help, but here goes...someone might be able to fill in the missing pieces between the player page URL and the actual video URL. OS: openSUSE Leap 15.0 Starting form here I was able to watch the adverts, but then ran up against a DRM error of some sort. To solve that error, I installed a further package chromium-plugin-widevinecdm 1.49.1076-lp150.1.1 from the Packman repository. This enable me to watch the main programme in the browser. Whilst playing the content in the browser, right-clicking and opening inspect element shows the browser console. From this I was able to pluck the correct video link:
Note: ip=xxx.xxx.xxx.xxx Irish IP address redacted. Copied link and trimmed down to the end of the IH number. Browsed this which has a selection of stream links. There is a massive .ismv stream link, but there is also a mp4 link with a [VID] tag. Copy this link and right-click and save. This link will download with youtube-dl, the page of links won't, nor will the link of the programme main page. Despite the size being marked 6.1M it was ~930MB, video plays fine in VLC. |
|
Seems like a hacky workaround but that MP4 appears to not have any DRM. |
|
Thanks @macplaxton . Just one thing to add for others. The URL must end with In my case RTE link: translated to DIR: This short film has only 2 days left so it'll be interesting if that FTP link is still active after that time. Edit: Are the ISMV files protected in any way? |
|
It is hacky, but a finer mind than mine might be able to suss out an automated way of retrieving the links from the site. I did download a massive (c.12GB) ismv and it played on VLC sluggishly and out of sync on VLC, but it did play. My machine isn't all at new (Athlon 64X2 c. 2007) and so I daren't try out a file conversion with FFmpeg. |
|
Working here for me with playing the Subtitles are also available in different formats as far as I can tell. They're found under the Here are the specs of that FULL HD file (which was the best available for this particular link):
|
|
It appears that if you possess a European Union (EU) IP address, you can still access streams Via Web Console (Basilisk web browser, a FirefoxESR 52 fork) I sniffed a lengthy "iframe" URI:
They are in fact using the <smil xmlns="http://www.w3.org/2005/SMIL21/Language">
<head>
<meta name="title" content="The Late Late Show E15"/>
<meta name="startingBitrate" content="2500000"/>
</head>
<body>
<seq>
<ref src="https://ads.freewheel.tv" no-skip="true" tags="preroll">
</ref>
<switch>
<video src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&expiry=1558305840&ip=<snipped>&token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&filter=systemBitrate%3C%3D7000000" system-bitrate="0" height="1080" width="1920"/>
<ref src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&expiry=1558305840&ip=<snipped>&token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&filter=systemBitrate%3C%3D7000000" title="1-1" dur="6524887ms" guid="IH000368289" type="application/dash+xml" height="1080" width="1920" clipBegin="0:00" clipEnd="25:54.985" security="commonEncryption">
<param name="fwVideoId" value="IH000368289"/>
</ref>
</switch>
<ref src="https://ads.freewheel.tv" no-skip="true" tags="midroll">
</ref>
<switch>
<video src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&expiry=1558305840&ip=<snipped>&token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&filter=systemBitrate%3C%3D7000000" system-bitrate="0" height="1080" width="1920"/>
<ref src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&expiry=1558305840&ip=<snipped>&token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&filter=systemBitrate%3C%3D7000000" title="The Late Late Show E15" dur="6524887ms" guid="IH000368289" type="application/dash+xml" height="1080" width="1920" clipBegin="25:54.985" security="commonEncryption">
<param name="fwVideoId" value="IH000368289"/>
</ref>
</switch>
<ref src="https://ads.freewheel.tv" no-skip="true" tags="postroll">
</ref>
</seq>
</body>
</smil>From that SMIL file you can take the .mpd URI up until the .ism part and substitute the .ism extension with .mp4: -https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism
+https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.mp4... and there you have the direct HTTPS link to the video file... What @macplaxton has discovered is the unencrypted SOURCE video file at the root of the directory, which is being streamed via encrypted (cenc) MPEG-DASH format Sadly, now that this is out in the open, I expect this loophole to be swiftly patched... Enjoy while you can |
|
Thanks, very useful. The .ismv files are not DRM protected and can be remuxed to mp4 or mkv using ffmpeg. Browsing around https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/XXX/ (replacing XXX with 3 digits, some combinations don't work) reveals a lot of unprotected content (both inside and outside Ireland). I guess "IH" at the start of some directory names might stand for "in-house", as it seems to be mostly news and weather bulletins in these folders. (Other directory names start with "AQ" or "IP") You can also find .vtt subtitle files inside many of the directories. |
|
Unfortunately, things aren't always that rosy
are in fact CORRUPTED The "huge" .ismv files are a totally different beast!
This suggests it's somewhat of a merge of 5 audio + 7 video streams, but I was unsuccessful in getting anything to download as separate streams via, e.g. TL;DR : for files under 45min (to, maybe, 1h), the "hack" should work; for anything longer, YMMV - but my experience thus far has shown you'll just waste bandwidth and end up with partially playable video files... |
|
Your One Nikita, might be more suitable for testing, as they are short animations. Might yield some correlation to the amount of audio drift? |
|
@Vangelis66 yep I see the same issue with the mp4 going out of sync. It seems it is not a gradual audio drift throughout the file, but rather something that happens suddenly at one point in the video. I tried with the 19th April episode, it happens at 10:46, you'll see they go to show a brief clip of a movie, which they have removed from the stream for licensing reasons I suppose. It goes out of sync after this cut. The RTE Player itself has some issues at this point in the video too (it pauses, and I need to skip ahead in the video to see more, but in the RTE Player there is no loss of av sync after that point). I downloaded the full 12GB ismv. In many of the directories, it seems there is a separate ISMV for each quality (1080p, 720p, etc.) but in this one, all those video streams are in the one file. I used ffmpeg to copy the 1080p video stream and one of the audio streams to an mkv file. The mkv is complete, and it seems to play OK all the way through, apart from the audio going out of sync after 10:46, but I think this is because it was cut incorrectly, rather than it being an issue that only affects large / long shows. |
|
@outhud wrote:
... OK, I caved in and downloaded all 11.67 GiB of the (full) .ISMV file that corresponds to the
That got me a 3.49 GiB matroska file with video+audio throughout its full duration Audio/Video sync is retained until the end of Part Two (ca. 01:07:54); in Part Three, the video precedes audio by at least 500ms; obviously, during editing the commercials out, they left 0.5sec worth of audio stream in, relative to edited-out video stream Things get even worse during Part Four (starting at ca. 01:30:25); from that point on, audio lags even more compared to video by at least 800ms, so, again, a cock-up during editing-out the commercial break between Parts Three & Four The easiest solution I found for rectifying the loss of sync in Parts 3+4 was to use VLC, which has a feature - not present in MPC-BE - which allows one to manually set an audio offset compared to the video stream:
and set value Returning on topic (well, sort of...), I still think it's impractical to download (via youtube-dl or other app) an obscenely sized file to then extract the resolution you want; especially when more tinkering is needed for a proper playback... The case of standalone resolution .ismv files (offered for other programs), that could be looked at, I suppose...
I was referring to the .MP4 links; please, be my guest: Choose a long program (e.g. Friday Night Soccer), download the MP4 file under the [VID] tag and check whether it plays in full (i.e. till the end); my bet is it only plays up to a point (usually < 1h) |
|
I have a nasty hack way to download the mp4 using a combination of a javascript bookmarklet and python Javascript bookmarket: https://gist.github.com/philroche/dc9fb6d148d2bdc667aa063b00a86438 Add this bookmarklet as a bookmark on your bookmark bar (see https://help.crossbrowsertesting.com/live-testing/getting-started/installing-the-bookmarklet/). Once you start playing an episode on rte player click on your new bookmarklet and it will print a url to the javascript console with starts with "https://link.eu.theplatform.com". Copy this to your clipboard. You then need the second part of my hack which is the python script - https://gist.github.com/philroche/52a907d8d7b15e87f8c1d29599910b92 Install the python requirements requests, BeautifulSoup and youtube_dl then run
This will result in a correctly named mp4 in your current directory. It's a hack but it has worked for me and have had no issues with the mp4 - but I have not tried it with programmes with running length greater than 1 hour. |
|
I have now updated the downloader script to a proper python package
I've also updated the bookmarklet https://gist.github.com/philroche/dc9fb6d148d2bdc667aa063b00a86438 to use a javascript prompt instead of just writing to the javascript console. See https://rteplayer-dl.readthedocs.io/en/latest/usage.html for more info |
|
The ismvs that we discussed above and that are used in https://github.com/philroche/rteplayer_dl are now all returning HTTP 415 Unsupported Media Type. I have opened philroche/rteplayer_dl#6 to try and investigate but at first glance it does not look promising. If anyone knows why they have started returning HTTP 415 now please share. |
Please follow the guide below
xinto all the boxes [ ] relevant to your issue (like this:[x])Make sure you are using the latest version: run
youtube-dl --versionand ensure your version is 2018.12.03. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.Before submitting an issue make sure you have:
What is the purpose of your issue?
Sample url: https://beta.rte.ie/player/series/whistleblower--the-maurice-mccabe-story/SI0000004409?epguid=IH000374544