Waiting in a queue - metopera.com

[superian]

Checklist

• I'm reporting a site feature request
• I've verified that I'm running youtube-dl version 2020.03.08
• I've searched the bugtracker for similar site feature requests including closed ones

Description

MetOpera.com is freely streaming some of its back catalogue at the moment.

Unsurprisingly, it's been very popular. The demand meant I had difficulty getting the first one, Carmen, to play in a browser and was delighted to see that youtube-dl worked fine in getting it.

As a result of the demand, they've added an automated queuing system. Requests are redirected to queue-it.net before coming back to the Met. In a browser, I get access to the second stream, La Boheme, in a few seconds, but youtube-dl is stopped by the queue page, every time:

:~/Videos/opera$ youtube-dl "https://www.metopera.org/season/on-demand/opera/?upc=811357011737" -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://www.metopera.org/season/on-demand/opera/?upc=811357011737', u'-v']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.03.08
[debug] Python version 2.7.17 (CPython) - Linux-5.3.0-42-generic-x86_64-with-Ubuntu-19.10-eoan
[debug] exe versions: ffmpeg 4.1.4-1build2, ffprobe 4.1.4-1build2, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[generic] ?upc=811357011737: Requesting header
[redirect] Following redirect to https://metopera.queue-it.net/?c=metopera&e=testevent&ver=v3-aspnet-3.6.1&cver=7&man=Production%20Queue&t=https%3A%2F%2Fwww.metopera.org%2Fseason%2Fon-demand%2Fopera%2F%3Fupc%3D811357011737
[generic] ?c=metopera&e=testevent&ver=v3-aspnet-3.6.1&cver=7&man=Production Queue&t=https://www.metopera: Requesting header
WARNING: Falling back on generic information extractor.
[generic] ?c=metopera&e=testevent&ver=v3-aspnet-3.6.1&cver=7&man=Production Queue&t=https://www.metopera: Downloading webpage
[generic] ?c=metopera&e=testevent&ver=v3-aspnet-3.6.1&cver=7&man=Production Queue&t=https://www.metopera: Extracting information
ERROR: Unsupported URL: https://metopera.queue-it.net/?c=metopera&e=testevent&ver=v3-aspnet-3.6.1&cver=7&man=Production%20Queue&t=https%3A%2F%2Fwww.metopera.org%2Fseason%2Fon-demand%2Fopera%2F%3Fupc%3D811357011737
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 2375, in _real_extract
doc = compat_etree_fromstring(webpage.encode('utf-8'))
File "/usr/local/bin/youtube-dl/youtube_dl/compat.py", line 2551, in compat_etree_fromstring
doc = _XML(text, parser=etree.XMLParser(target=_TreeBuilder(element_factory=_element_factory)))
File "/usr/local/bin/youtube-dl/youtube_dl/compat.py", line 2540, in _XML
parser.feed(text)
File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1659, in feed
self._raiseerror(v)
File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1523, in _raiseerror
raise err
ParseError: undefined entity: line 19, column 0
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 797, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
ie_result = self._real_extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 3351, in _real_extract
raise UnsupportedError(url)
UnsupportedError: Unsupported URL: https://metopera.queue-it.net/?c=metopera&e=testevent&ver=v3-aspnet-3.6.1&cver=7&man=Production%20Queue&t=https%3A%2F%2Fwww.metopera.org%2Fseason%2Fon-demand%2Fopera%2F%3Fupc%3D811357011737

[superian]

I have tried copying cookies from the browser to youtube-dl, but this generates an error:
cookies.txt

youtube-dl "https://www.metopera.org/season/on-demand/opera/?upc=811357011737" --cookies cookies.txt
/usr/lib/python2.7/_MozillaCookieJar.py:109: UserWarning: cookielib bug!
Traceback (most recent call last):
File "/usr/lib/python2.7/_MozillaCookieJar.py", line 71, in _really_load
line.split("\t")
ValueError: too many values to unpack

_warn_unhandled_exception()
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/bin/youtube-dl/main.py", line 19, in
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 474, in main
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 441, in _real_main
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 419, in init
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2329, in _setup_opener
File "/usr/local/bin/youtube-dl/youtube_dl/utils.py", line 2762, in load
File "/usr/lib/python2.7/_MozillaCookieJar.py", line 111, in _really_load
(filename, line))
cookielib.LoadError: invalid Netscape format cookies file u'cookies.txt': u'www.metopera.org\tFALSE\t/\tFALSE\t0\tcurrentinfo\tSessID=76e80c5468f911ea80df00505685612f00000000000000000000000000000000&LASTACCESS=03/18/20\t5:18:45'

cookies.txt

[superian]

They've switched to a provider who can cope with the demand, but it's possibly still an interesting issue.