Skip to content

/ youtube-dl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Inability to download JSON metadata #18442

Open
HankMike opened this issue Dec 7, 2018 · 3 comments
Open

Inability to download JSON metadata #18442

HankMike opened this issue Dec 7, 2018 · 3 comments

Comments

@HankMike
Copy link

@HankMike HankMike commented Dec 7, 2018

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like this: [x])
  • Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.12.03. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2018.12.03

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones
  • Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

hanraoi@hanraoi-ME051:~/Videos$ sudo youtube-dl -U 
Updating to version 2018.12.03 ... 
Updated youtube-dl. Restart youtube-dl to use the new version. 
hanraoi@hanraoi-ME051:~/Videos$ sudo youtube-dl --verbose https://watch.liberty.edu/media/t/1_iwo3bklf 
[debug] System config: [] 
[debug] User config: [] 
[debug] Custom config: [] 
[debug] Command-line args: [u'--verbose', u'https://watch.liberty.edu/media/t/1_iwo3bklf'] 
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8 
[debug] youtube-dl version 2018.12.03 
[debug] Python version 2.7.6 (CPython) - Linux-4.4.0-139-generic-i686-with-Ubuntu-14.04-trusty 
[debug] exe versions: avconv 11.3-6, avprobe 11.3-6 
[debug] Proxy map: {} 
[generic] 1_iwo3bklf: Requesting header 
WARNING: Falling back on generic information extractor. 
[generic] 1_iwo3bklf: Downloading webpage 
[generic] 1_iwo3bklf: Extracting information 
[Kaltura] 1_iwo3bklf: Downloading video info JSON 
ERROR: Unable to download JSON metadata: HTTP Error 500: Internal Server Error (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. 
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 605, in _request_webpage 
    return self._downloader.urlopen(url_or_request) 
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2211, in urlopen 
    return self._opener.open(req, timeout=self._socket_timeout) 
  File "/usr/lib/python2.7/urllib2.py", line 410, in open 
    response = meth(req, response) 
  File "/usr/lib/python2.7/urllib2.py", line 523, in http_response 
    'http', request, response, code, msg, hdrs) 
  File "/usr/lib/python2.7/urllib2.py", line 442, in error 
    result = self._call_chain(*args) 
  File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain 
    result = func(*args) 
  File "/usr/lib/python2.7/urllib2.py", line 629, in http_error_302 
    return self.parent.open(new, timeout=req.timeout) 
  File "/usr/lib/python2.7/urllib2.py", line 410, in open 
    response = meth(req, response) 
  File "/usr/lib/python2.7/urllib2.py", line 523, in http_response 
    'http', request, response, code, msg, hdrs) 
  File "/usr/lib/python2.7/urllib2.py", line 442, in error 
    result = self._call_chain(*args) 
  File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain 
    result = func(*args) 
  File "/usr/lib/python2.7/urllib2.py", line 629, in http_error_302 
    return self.parent.open(new, timeout=req.timeout) 
  File "/usr/lib/python2.7/urllib2.py", line 410, in open 
    response = meth(req, response) 
  File "/usr/lib/python2.7/urllib2.py", line 523, in http_response 
    'http', request, response, code, msg, hdrs) 
  File "/usr/lib/python2.7/urllib2.py", line 448, in error 
    return self._call_chain(*args) 
  File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain 
    result = func(*args) 
  File "/usr/lib/python2.7/urllib2.py", line 531, in http_error_default 
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) 
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information

I have inquired with Liberty University, and have been told that there is no copyright issue for the video above.
The issue is the failure to download JSON metadata as shown in the verbose log shown above.
There was an apparently identical bug report #18374, however, the youtube-dl version there was outdated.
I am running on 32 bit Lubuntu version 14.04 and Python 2.7.6
I have not tried to download from this site before, and have no idea why the download attempt failed
I had tried with an earlier version of youtube-dl, and thought the newer version would resolve the issue. However, the new version also failed, as shown in the log.

If you need further information, please let me know. Thank you
@HankMike
Copy link
Author

@HankMike HankMike commented Dec 8, 2018

Note: I can view the video in question with no difficulty on this system
@Steffo99
Copy link

@Steffo99 Steffo99 commented Dec 26, 2018 •
edited

I think there are multiple problems in the Kaltura extractor:
the first is a buggy regex at https://github.com/rg3/youtube-dl/blob/9b27a78a881bceb9d62f3364399d7572e8e2be24/youtube_dl/extractor/kaltura.py#L151

the second is that no dataUrl gets produced by the extractor, so the extraction fails at https://github.com/rg3/youtube-dl/blob/9b27a78a881bceb9d62f3364399d7572e8e2be24/youtube_dl/extractor/kaltura.py#L283 .

I managed to fix the first one (https://github.com/Steffo99/youtube-dl/commit/7a879c247855c8cc4c7637254cf24721b1b8904b), but I'm not able to figure out how to solve the second.
I'm pinging @dstftw, since he wrote most of the extractor; he may be able to figure it out.
@HankMike
Copy link
Author

@HankMike HankMike commented Jan 10, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
@Steffo99 @HankMike
You can’t perform that action at this time.