Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
[scrippsnetworks] Unable to download JSON metadata: HTTP Error 403: Forbidden #15102
Comments
|
|
Using Ubuntu 16.04 with python 2.7, I found out somewhere between 2017.12.14 -> 2017.12.23 broke the Json parsing $ ./youtube-dl2017.12.14 --version
2017.12.14
$ ./youtube-dl2017.12.14 --verbose http://watch.foodnetwork.com/show/WU/The-Pioneer-Woman/3619699/How-the-Cookie-Crumbles/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'http://watch.foodnetwork.com/show/WU/The-Pioneer-Woman/3619699/How-the-Cookie-Crumbles/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.12.14
[debug] Python version 2.7.12 - Linux-4.4.0-101-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.11-0ubuntu0.16.04.1, ffprobe 2.8.11-0ubuntu0.16.04.1
[debug] Proxy map: {}
[scrippsnetworks:watch] 3619699: Downloading JSON metadata
[scrippsnetworks:watch] 3619699: Downloading XML
[scrippsnetworks:watch] 3619699: Downloading JSON metadata
[debug] Using fake IP 3.91.53.215 (US) as X-Forwarded-For.
[Anvato] 4256638: Fetching server time
[Anvato] 4256638: Downloading JSON metadata
[Anvato] 4256638: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'http://dcs-vod.apis.anvato.net/vod/p/4576400/prog.m3u8?i=i176816131-nd0ef66e1-20da-44c7-a506-5c5b828326ee'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 144 (not including 2 ad)
[download] Destination: How the Cookie Crumbles-4256638.mp4
[download] 6.5% of ~627.92MiB at 10.58MiB/s ETA 01:03^C
ERROR: Interrupted by user
$ ./youtube-dl2017.12.23 --version
2017.12.23
$ ./youtube-dl2017.12.23 --verbose http://watch.foodnetwork.com/show/WU/The-Pioneer-Woman/3619699/How-the-Cookie-Crumbles/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'http://watch.foodnetwork.com/show/WU/The-Pioneer-Woman/3619699/How-the-Cookie-Crumbles/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.12.23
[debug] Python version 2.7.12 - Linux-4.4.0-101-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.11-0ubuntu0.16.04.1, ffprobe 2.8.11-0ubuntu0.16.04.1
[debug] Proxy map: {}
[scrippsnetworks:watch] 3619699: Downloading JSON metadata
[scrippsnetworks:watch] 3619699: Downloading XML
[scrippsnetworks:watch] 3619699: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "./youtube-dl2017.12.23/youtube_dl/extractor/common.py", line 517, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "./youtube-dl2017.12.23/youtube_dl/YoutubeDL.py", line 2198, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 473, in error
return self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
$ ./youtube-dl2017.12.28 --version
2017.12.28
$ ./youtube-dl2017.12.28 --verbose http://watch.foodnetwork.com/show/WU/The-Pioneer-Woman/3619699/How-the-Cookie-Crumbles/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'http://watch.foodnetwork.com/show/WU/The-Pioneer-Woman/3619699/How-the-Cookie-Crumbles/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.12.28
[debug] Python version 2.7.12 - Linux-4.4.0-101-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.11-0ubuntu0.16.04.1, ffprobe 2.8.11-0ubuntu0.16.04.1
[debug] Proxy map: {}
[scrippsnetworks:watch] 3619699: Downloading JSON metadata
[scrippsnetworks:watch] 3619699: Downloading XML
[scrippsnetworks:watch] 3619699: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "./youtube-dl2017.12.28/youtube_dl/extractor/common.py", line 517, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "./youtube-dl2017.12.28/youtube_dl/YoutubeDL.py", line 2198, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 473, in error
return self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) |
|
Thanks @remitamine and @VietTPham ! I temporarily reverted to 2017.12.02 and its working just fine. |
|
Same issue/error still occurring with the latest release (2018.04.03) when using Workaround: run the command with a single URL (ie. youtube-dl www.test.com instead youtube-dl --batch-file test_url.txt) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Please follow the guide below
xinto all the boxes [ ] relevant to your issue (like this:[x])Make sure you are using the latest version: run
youtube-dl --versionand ensure your version is 2017.12.28. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.Before submitting an issue make sure you have:
What is the purpose of your issue?
The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue
If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the
-vflag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):
Description of your issue, suggested solution and other information
Extractor is no longer downloading JSON metadata, nor is it finding the video stream. I have verified the same error exists on watch.foodnetwork.com, watch.hgtv.com and watch.cookingchanneltv.com.
I have also verified that the error exists with both an --ap-mso login and without.
Thanks.