Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Roostereeth extractor fails to download JSON metadata for bonus features #23590

Open
Qyriad opened this issue Jan 1, 2020 · 1 comment · May be fixed by #23708
Open

Roostereeth extractor fails to download JSON metadata for bonus features #23590

Qyriad opened this issue Jan 1, 2020 · 1 comment · May be fixed by #23708

Comments

@Qyriad
Copy link

@Qyriad Qyriad commented Jan 1, 2020

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2020.01.01
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://roosterteeth.com/watch/rwby-bonus-10', '-o', 'RWBY Volume 1 Opening.%(ext)s', '-v']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2020.01.01
[debug] Python version 3.8.1 (CPython) - Linux-4.19.91-1-lts-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.2.1, ffprobe 4.2.1, rtmpdump 2.4
[debug] Proxy map: {}
[RoosterTeeth] rwby-bonus-10: Downloading video JSON metadata
[RoosterTeeth] rwby-bonus-10: Downloading m3u8 information
[RoosterTeeth] rwby-bonus-10: Downloading episode JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/lib/python3.8/site-packages/youtube_dl/extractor/common.py", line 627, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/lib/python3.8/site-packages/youtube_dl/YoutubeDL.py", line 2237, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.8/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.8/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

Description

Similar to previous issues with the Roosterteeth extractor, attempting to download bonus feature episode from Roosterteeth's site fails as it fails to get the relevant metadata. Manually extracting the m3u8 and providing that to youtube-dl works fine.

@Zocker1999NET
Copy link
Contributor

@Zocker1999NET Zocker1999NET commented Jan 11, 2020

I've implemented a fix to this issue. I will submit a pull request in the next time.

youtube-dl was still able to extract the m3u8 just fine, only gathering the metadata has failed.

The website now uses another API endpoint to gather the metadata of the videos like title and thumbnails. It seems that the old endpoint used by youtube-dl only covers "real episodes", but the new endpoint seems to cover "real episodes" and bonus too.

@Zocker1999NET Zocker1999NET linked a pull request that will close this issue Jan 11, 2020
5 of 9 tasks complete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

2 participants
You can’t perform that action at this time.