ITV/ITV4 <=> ITV Hub apparently use geo-restriction on youtube-dl

[St-Galaad]

Please follow the guide below

• You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
• Put an x into all the boxes [ ] relevant to your issue (like this: [x])
• Use the Preview tab to see what your issue will actually look like

---

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.06.25. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

• I've verified and I assure that I'm running youtube-dl 2018.06.25

Before submitting an issue make sure you have:

• At least skimmed through the README, most notably the FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones
• Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

---

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

---

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

E:\>youtube-dl -F https://www.itv.com/hub/isle-of-man-tt/1a7918a0129 -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-F', 'https://www.itv.com/hub/isle-of-man-tt/1a7918
a0129', '-v']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2018.06.25
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-86723-g3b3501f, ffprobe N-86723-g3b3501f, rtmpdum
p 2.4
[debug] Proxy map: {}
[debug] Using fake IP 25.218.223.104 (GB) as X-Forwarded-For.
[ITV] 1a7918a0129: Downloading webpage
[ITV] 1a7918a0129: Downloading XML
WARNING: Unable to download XML: HTTP Error 503: Service Unavailable
[ITV] 1a7918a0129: Downloading JSON metadata
[ITV] 1a7918a0129: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug
 . Make sure you are using the latest version; type  youtube-dl -U  to update. B
e sure to call youtube-dl with the --verbose flag and include its complete outpu
t.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpkc931nsv\bu
ild\youtube_dl\YoutubeDL.py", line 792, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpkc931nsv\bu
ild\youtube_dl\extractor\common.py", line 501, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpkc931nsv\bu
ild\youtube_dl\extractor\itv.py", line 259, in _real_extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpkc931nsv\bu
ild\youtube_dl\extractor\common.py", line 1281, in _sort_formats
youtube_dl.utils.ExtractorError: No video formats found; please report this issu
e on https://yt-dl.org/bug . Make sure you are using the latest version; type  y
outube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and
include its complete output.

---

### Description of your *issue*, suggested solution and other information

Explanation of your *issue* in arbitrary form goes here. Please make sure the [description is worded well enough to be understood](https://github.com/rg3/youtube-dl#is-the-description-of-the-issue-itself-sufficient). Provide as much context and examples as possible.
If work on your *issue* requires account credentials please provide them or explain how one can obtain them.
So since one week I can't download any video from ITVHub (essentialy itv4).
First the itv4 server's answer was:
"E:\>youtube-dl -F https://www.itv.com/hub/isle-of-man-tt/1a7918a0129
[ITV] 1a7918a0129: Downloading webpage
[ITV] 1a7918a0129: Downloading XML
WARNING: Unable to download XML: HTTP Error 503: Service Unavailable
[ITV] 1a7918a0129: Downloading JSON metadata
[ITV] 1a7918a0129: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug. 
Make sure you are using the latest version; type  youtube-dl -U  to update. 
Be sure to call youtube-dl with the --verbose flag and include its complete output."

OK so that mean that no request was found: geo-restriciton ? server down ? 
I tried different urls on itvhub with the same result: no m3u8 extraction so no format found !
As i read many issues on itv I thought this could be a geo-restriction resulting on a security change.
So I tried with a free UK proxy (like I do with bbc get_iplayer) and that worked but with many retries (proxy settings ? communication with the itv server ?):
E:\>youtube-dl -F "https://www.itv.com/hub/isle-of-man-tt/1a7918a0129" --proxy 88.208.244.136:80
[ITV] 1a7918a0129: Downloading webpage
[ITV] 1a7918a0129: Downloading XML
WARNING: Unable to download XML: HTTP Error 503: Service Unavailable
[ITV] 1a7918a0129: Downloading JSON metadata
[ITV] 1a7918a0129: Downloading m3u8 information
[info] Available formats for 1a7918a0129:
format code  extension  resolution note
hls-136      mp4        audio only  136k , mp4a.40.2@128k
hls-582      mp4        512x288     582k , avc1.64001F@ 420k, 25.0fps, mp4a.40.2@128k
hls-770      mp4        512x288     770k , avc1.64001F@ 597k, 25.0fps, mp4a.40.2@128k
hls-1068     mp4        896x504    1068k , avc1.64001F@ 879k, 25.0fps, mp4a.40.2@128k
hls-1353     mp4        896x504    1353k , avc1.64001F@1148k, 25.0fps, mp4a.40.2@128k
hls-1637     mp4        896x504    1637k , avc1.64001F@1416k, 25.0fps, mp4a.40.2@128k (best)
Now it appears that ITVHub changed the security settings in order to block "x-forwarded fake url"
i.e. "Using fake IP 25.140.157.9 (GB) as X-Forwarded-For."
So I was able to DL using "E:\>youtube-dl -f hls-1637 https://www.itv.com/hub/isle-of-mantt/1a7918a0129 --proxy 80.229.84.33:80
[ITV] 1a7918a0129: Downloading webpage"
BUT the DL  stopped after ~3% cause the free proxy is not "stable" i.e. "time out".
The solution while waiting for the dev to fix this geo-restriction is to test with a free trial UK VPN cause the video i want to DL  ended tonight !
So the alternative solution is to bypass the geo-restriction by using a relaible uk proxy / vpn.

[dstftw]

It's geo restricted now.

[St-Galaad]

The code of Youtube-dl will be modified or not ?

[dstftw]

Modified for what?

[St-Galaad]

To work like it was until the last week.

[dstftw]

Again: it's a true geo restriction now. It can't by bypassed.

[St-Galaad]

what is the difference now <=> "true geo restriction" ?

[Vangelis66]

This is, in essence, a duplicate of #15925; the ITVHub people have killed the legacy API that used to provide non-geofenced RTMPE streams (for some of their offerings, mostly older stuff) and that change was the root cause of #16780); overseas users are now confronted with the "predicament" I talked about in #15925 (comment), having to resort to full-blown geo-location spoofing methods 😞 ...