[extractor/sbs] Overhaul extractor for new APIs

[vidiot720]

Description of your pull request and other information

From dirkf's PR: Australian provider SBS has changed its hosting arrangements and APIs, breaking the existing extractor.

The PR is intended to deal with the new APIs.

Some specialisations of extractor methods are included:

• _download_webpage_handle() detects geo-restriction
• _extract_m3u8_formats() defaults to the native downloader.

That PR was developed for upstream, so adjusted for deprecations and other legacy compatibility inclusions. It also addresses issue with extracting and converting dxfp subtitles to other formats, since SBS deliver their UTF-8 encoded files with encoding='UTF-16', in error. The workaround is included in utils.py. Note that it will not be triggered where a file actually encoded with UTF-16 is downloaded.

Fixes #6543. Adapt dirkf's PR ytdl-org/youtube-dl#31880, with adjustments:

• Use media['name'] for title;
• Support urls including 'tv-program', and add a test url;
• Remove deprecated sort_formats() call;
• Support for capture and return of subtitles, with UTF-16 coding issue work-around when converting dfxp subs to srt.

See also ytdl-org/youtube-dl#31841.

There are a few TODOs such as handling metadata for episode titles more nicely, and the downloaded subtitles (if not converted) will still have the wrong encoding. However these can be worked-around and don't cause exceptions during yt-dlp processing, so have raised this PR in order to get core extractor functions back ASAP.

Boilerplate: bug fix, derived code, own tweaks.

Before submitting a pull request make sure you have:

• At least skimmed through contributing guidelines including yt-dlp coding conventions
• Searched the bugtracker for similar pull requests
• Checked the code with flake8 and ran relevant tests

In order to be accepted and merged into yt-dlp each piece of code must be in public domain or released under Unlicense. Check all of the following options that apply:

• I am the original author of this code and I am willing to release it under Unlicense
• I am not the original author of this code but it is in public domain or released under Unlicense See dirkf's release in ytdl-org/youtube-dl#31880.

What is the purpose of your pull request?

• Fix or improvement to an extractor (Make sure to add/update tests)
• New extractor (Piracy websites will not be accepted)
• Core bug fix/improvement
• New feature (It is strongly recommended to open an issue first)

[bashonly]

I've tested my fixes to the geo-bypass/geo-restricted code and everything's working now

[bossanova808]

Thank you very much for this, things working very well again.

[VampiricAlien]

@vidiot720 or @bashonly
I am trying to grab Audio Described file but since this update I am unable to find or download anything with more then one audio file attached to it and wanted to know if it could be because of this update?

-f all[vcodec=none] --audio-multistream or --audio-multistream or --audio-multistreams', '-f', 'bestvideo+mergeall[vcodec=none] all gives Requested format is not available. Use --list-formats for a list of available formats

The program pages says AD and other shows that is supposed to support it is Home Is Where The Art Is Series 1 (Ep.11) but --list-formats doesn't show any other audio.

`[SBS] Extracting URL: https://www. sbs. com.au /ondemand/movie/ the-lost-city-of-melbourne/2264088643618

[info] Available formats for 2264088643618:
ID EXT RESOLUTION FPS │ FILESIZE TBR PROTO │ VCODEC ACODEC
────────────────────────────────────────────────────────
hls-439 mp4 398x224 25 │ ~272.42MiB 439k m3u8 │ avc1.4D401E mp4a.40.2
hls-870 mp4 640x360 25 │ ~540.06MiB 871k m3u8 │ avc1.4D401E mp4a.40.2
hls-1419 mp4 1024x576 25 │ ~880.17MiB 1419k m3u8 │ avc1.4D4029 mp4a.40.2
hls-1981 mp4 1280x720 25 │ ~ 1.20GiB 1981k m3u8 │ avc1.4D4029 mp4a.40.2`

[vidiot720]

The program pages says AD and other shows that is supposed to support it is Home Is Where The Art Is Series 1 (Ep.11) but --list-formats doesn't show any other audio.

The on-demand program pages are a bit misleading to include the AD symbol; per https://www.sbs.com.au/aboutus/audio-description-services/#faqs-about-audio-description,

Is audio description available on SBS On Demand and SBS’s online services?

Audio description is not currently available on SBS On Demand or SBS’s online and social media services.

Currently, audio description is only available via SBS’s broadcast television. If you are watching SBS programs on SBS On Demand, including streaming SBS channels live, audio description will not be available. We suggest that you switch to broadcast television, if possible, in order to hear audio description.

I'd keep an eye on the FAQ to see if AD becomes available on On Demand; it's probably non-trivial for SBS to add support for multiple audio streams since an interface for stream selection would need to be added. There may be some hope given the use of "Currently, ...".