Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

extractor medici (medici.tv) #27208

Open
1 task done
switch6343 opened this issue Nov 26, 2020 · 18 comments
Open
1 task done

extractor medici (medici.tv) #27208

switch6343 opened this issue Nov 26, 2020 · 18 comments

Comments

@switch6343
Copy link

cmd<!--

######################################################################
WARNING!
IGNORING THE FOLLOWING TEMPLATE WILL RESULT IN ISSUE CLOSED AS INCOMPLETE
######################################################################

-->

Checklist

  • I'm reporting a broken site support
  • [ x] I've verified that I'm running youtube-dl version 2020.11.26
  • [ x] I've checked that all provided URLs are alive and playable in a browser
  • [ x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • [ x] I've searched the bugtracker for similar issues including closed ones

Verbose log

Microsoft Windows [Version 10.0.19042.630]
(c) 2020 Microsoft Corporation. All rights reserved.

C:\WINDOWS\system32>youtube-dl -v --hls-prefer-native https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '--hls-prefer-native', 'https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2020.11.26
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg N-100029-g040e989223, ffprobe N-100029-g040e989223
[debug] Proxy map: {}
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Requesting header
WARNING: Falling back on generic information extractor.
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Downloading webpage
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Extracting information
[generic] m: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=4933000.m3u8'
[download] Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4 has already been downloaded
[download] 100% of 204.47MiB
[debug] ffmpeg command line: ffprobe -show_streams "file:Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4"

C:\WINDOWS\system32>

Description

WRITE DESCRIPTION HERE
The concert I try to download has a size of 3 - 5 GB and is 1 hour and 45 minutes long. The download however has a size of 204.47 MiB, which is about 2 minutes long. Interestingly, the part which is downloaded does not represent the beginning of the concert, but only when Anne-Sophie Mutter is in the middle of playing her Stradivarius. It is saved with the extension mp4.part.

I have a valid and current one-year subscription on www.medici.tv. I also attempted to use in the command line my Username and Password, youtube-dl --hls-prefer-native -u USERNAME -p PASSWORD, but to no avail. Please note that I used my proper Username and proper Password, which I don't want to share on any public forum. I trust you understand.

I add to this, that I initally started to download with the command line: youtube-dl https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw, but that returned a lot of hls errors and no download at all. That is when I added the switch in the command line "--hold-prefer-native".

medici.tv is the only site which doesn't work for me. ARTE.TV and YouTube.com work like a charm. The extractor medici, as I read in the ChangeLog dates back to 2017. So, may be medici.tv changed something on their site?

Please don't hesitate to contact me if you have any questions.

Kind regards,
switch6332

@october262
Copy link

noticed this word drm in your link - https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=4933000.m3u8

do you get a popup message saying something about installing widedevine DRM ??
if yes, then it is likely that the video cannot be downloaded. youtube-dl does not support
the removal of DRM protected content.

@switch6343
Copy link
Author

Thanks for your feedback. No, I did not get a popup message stating something about installing widevine DRM.

@switch6343
Copy link
Author

I just found out, that the sequence which is downloaded, is identical to the Video of this concert, when I'm NOT logged in, which is a 2.38 minutes video.

As soon as I log in as a subscriber, I am able to watch the full concert of 1 hour, 42 minutes and 47 seconds. As I informed you before, I tried to download the full concert with the -u USERNAME and -p PASSWORD switches, but that did not work. Would you like me to try that once more with the -v (Verbose) switch, so as to be able to see the communication of Y-DL in verbose? Pls advise.

@switch6343
Copy link
Author

Verbose Log

Microsoft Windows [Version 10.0.19042.630]
(c) 2020 Microsoft Corporation. All rights reserved.

C:\WINDOWS\system32>youtube-dl -v --hls-prefer-native -u USERNAME -p PASSWORD https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '--hls-prefer-native', '-u', 'PRIVATE', '-p', 'PRIVATE', 'https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2020.11.26
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg N-100029-g040e989223, ffprobe N-100029-g040e989223
[debug] Proxy map: {}
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Requesting header
WARNING: Falling back on generic information extractor.
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Downloading webpage
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Extracting information
[generic] m: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=4933000.m3u8'
[download] Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4 has already been downloaded
[download] 100% of 204.47MiB
[debug] ffmpeg command line: ffprobe -show_streams "file:Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4"

C:\WINDOWS\system32>

Please note that I replaced my proper Usename and my proper Password, and highlighted these in Bold in above Verbose log.

@october262
Copy link

install the firefox addon called the stream detector and see if that'll
work on this video.

@switch6343
Copy link
Author

I copied the visible URLs from within the Addon Stream Detector.

When I'm NOT logged-in in www.medici.tv - 3 URLs:

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=1927000.m3u8

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=160000-video=554000.m3u8

https://playout.prod.medicitv.fr/satie/vod/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1cmwiOiJodHRwczovL3Nkbi1nbG9iYWwtc3RyZWFtaW5nLWNhY2hlLjNxc2RuLmNvbS85Mzc4L2ZpbGVzLzIwLzExLzIyMjA3OTcvOTM3OC1YUVdwZ0xmNkRoUEhWalQtZHJtLWFlcy5pc20vbWFuaWZlc3QubTN1OCIsImlhdCI6MTYwNjQ0MTc0NiwiZXhwIjoxNjA3MDQ2NTQ2fQ.ltFnB32-nN1GoLoJisjLv6GSrWEI6I9T4cd7Kv9T878/m.m3u8

The 3rd URL is inexplicable to me, because reference is made to Satie, which is a French composer of the beginning of the last century and in not way has anything to do with the concert

When I'm Logged-in in www.medici.tv - 5 URLs:

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/08/1814608/9378-Fc2BRwHyK3CZvrY-drm-aes.ism/9378-Fc2BRwHyK3CZvrY-drm-aes-audio=320000-video=1949000.m3u8

https://playout.prod.medicitv.fr/satie/vod/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1cmwiOiJodHRwczovL3Nkbi1nbG9iYWwtc3RyZWFtaW5nLWNhY2hlLjNxc2RuLmNvbS85Mzc4L2ZpbGVzLzIwLzA4LzE4MTQ2MDgvOTM3OC1GYzJCUndIeUszQ1p2clktZHJtLWFlcy5pc20vbWFuaWZlc3QubTN1OCIsImlhdCI6MTYwNjQ0MjMxNiwiZXhwIjoxNjA3MDQ3MTE2fQ.RHDxMvF1s1Z_O32MyzL4_mLo4D3kezKdHhla6I_hC7k/m.m3u8

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=1927000.m3u8

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=160000-video=554000.m3u8

https://playout.prod.medicitv.fr/satie/vod/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1cmwiOiJodHRwczovL3Nkbi1nbG9iYWwtc3RyZWFtaW5nLWNhY2hlLjNxc2RuLmNvbS85Mzc4L2ZpbGVzLzIwLzExLzIyMjA3OTcvOTM3OC1YUVdwZ0xmNkRoUEhWalQtZHJtLWFlcy5pc20vbWFuaWZlc3QubTN1OCIsImlhdCI6MTYwNjQ0MTc0NiwiZXhwIjoxNjA3MDQ2NTQ2fQ.ltFnB32-nN1GoLoJisjLv6GSrWEI6I9T4cd7Kv9T878/m.m3u8

Again, two URLs refer to Eric Satie, the French composer, for no reason.

@switch6343
Copy link
Author

Please note that I can see the full concert when I'm logged in, which is a 1 hour and 43 minutes live concert with excellent video.

When I'm NOT logged in, the "concert" lasts only 2 minutes 38 seconds.

@switch6343
Copy link
Author

The latter, in my previous posting, applies to when I watch the concert in Firefox, with the addon Stream Detector installed. However in both cases Y-DL downloads the 2 minutes 38 seconds "concert" only. It appears that logging-in during Y-DL into www.medici.tv is successful.

I add to this, that I'm not able to watch this concert on my Android Smart TV (with built-in Google Chromecast), because Google Play store does not offer a medici.tv App. But Google Play store does offer an Arte.tv app. It would be possible to watch the concert using the Webbrowser built-in the Android Smart TV, but that is a very and cumbersome process.

What I do is to (Google) Chromecast the concerts from my PC to my Android TV, using BubbleUPnP Server installed on my PC and JRiver Media Center. Archived concerts in my library on my PC I chromecast to my Adroid TV.

@switch6343
Copy link
Author

I have noticed, that during the download a warning message appears:. See the verbose download logs.
"WARNING: Falling back on generic information extractor".

Does this mean that the specific medici extractor does not work (anymore)? And if so, what could be the culprit?

@october262
Copy link

try this, play the concert video and press F12 on your keyboard select NETWORK
and then XHR , you should see a file called m.m3u8 (may have to refresh the page for it to show)
copy the URL / LINK and then paste it into youtube-dl .
TESTED, does work on the sample 2:38 video

@switch6343
Copy link
Author

october262, so far not luck. I didn't find a m.m3u8 file, yet. But hang on, pls give me some more time to find out. I will expectedly be back sometime tomorrow. Need to dig into this further first. I am greatful to you and for your patience and efforts in helping me to find a solution. Stay tuned.

@switch6343
Copy link
Author

Another problem. I am able to download the concert in mp4, but I can't find to where the downloaded file is saved to. It used to save by default in C: \Program Files\Youtube DL\ (this is the path where youtube-dl.exe is stored). Explorer search didn't give me a positive hit/return. I once more restarted the indexing process in Windows 10, but to no avail as well.

I looked for a switch in Man Pages which would allow me to send the MP4 file to a specified folder, but I could not find such switch. Could you please advise how I can achieve that, october262?

@october262
Copy link

Another problem. I am able to download the concert in mp4, but I can't find to where the downloaded file is saved to. It used to save by default in C: \Program Files\Youtube DL\ (this is the path where youtube-dl.exe is stored). Explorer search didn't give me a positive hit/return. I once more restarted the indexing process in Windows 10, but to no avail as well.

I looked for a switch in Man Pages which would allow me to send the MP4 file to a specified folder, but I could not find such switch. Could you please advise how I can achieve that, october262?

try redownloading the file again, it should say where the file is saved
On Windows, the user wide configuration file locations are %APPDATA%\youtube-dl\config. txt or C:\Users<user name>\youtube-dl.

@switch6343
Copy link
Author

OK, I got lost. So, I decided to use Youtube-DLG (a GUI version), which as I understand is not maintained since 2017 anymore.
This is what I did:

  1. I logged-in in www.medici.tv
  2. searched under Concerts for "Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter"
  3. Started playing this concert
    4 clicked on the Firefox addon The Stream Detector and copied the m3u8 file with the longest file name (so, not m.m3u8), which looks like this: "https://sdn-global-streaming-cache.........m3u8)
  4. I started Youtube-DLG, pasted the long file name and added it for download and I pressed the Download button.
  5. The mp4 file, with a size of 1.7 GB, was saved to the folder I had defined/set in Y-DLG.
  6. I had to change the (long) file name of the mp4 file to "Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter.mp4".

I opened my Media Center et voilà, I could (have) watch(ed) the concert in Full length.

Do you possibly know which switches are used/configured/set in Youtube-DLG? I'd like to know, because it would allow me to keep up-to-date with the original Youtube-DL command line but using de Y-DLG switches which are (for me) hidden under the hood of Youtube-DLG.

@switch6343
Copy link
Author

I saw in a verbose download attempt from the medici.tv site, a reference toe ffprobe (one of the three executables in the ffmpeg "suite").
Instead of using the information from The Stream Detector, would it be possible to include e.g. -ffprobe (or similar) as a switch in the command line of y-dl, to invoke ffprobe? As I understand, ffprobe is also a multimedia stream analyzer. Maybe ffprobe is used and hidden under the hood of Y-DLG? What is your opinion, october262?

@switch6343
Copy link
Author

I think I found all of the switches/options for the configuration of Y-Dl, used in Y-DLG:
Default switches:

-i or --ignore-errors
--ignore-config
--hls-prefer-native

Save all videos under Movies directory in your home directory

-o ~/Movies/%(title)s.%(ext)s

When I initially attemtped to download a video from medici.tv in the command line without any switches, reference was made that ffmpeg was missing. SO, I guess under the hood of Y-DL could be hidden the following switch:

--ffmpeg-location PATH

october272, have I forgotten any?

In any case, a download has first to be made, logged-in in medici.tv, in verbose, to catch the correct URL in the form of "https://sdn-global-streaming-cache.........m3u8".

In Y-DLG one can update youtube-dl.exe to the latest version. I cannot check if that really is the case. What is your opinion?

Thanks for all your efforts and advise. No doubt, without your expert feedback I would never have come to where I am now. A great many thanks. Keep on keeping up. You're the best.

@switch6343
Copy link
Author

Sorry, that line "Save all videos under Movies directory in your home directory" was unintentional. I did not want to scream.

@switch6343
Copy link
Author

Just for your information: I checked if Y-DLG downloads the latest Y-DL version when one selects Update under Settings. I can confirm that it does download the latest youtube-dl version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants