Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Suggestion/Request: Treat BBC.co.uk "topic pages" as playlist #14690
Comments
Trial 3: Simplest possible command request (Same result)C:\Users\jlazarus\Media\Video\bbc>youtube-dl.exe --verbose http://www.bbc.co.uk/programmes/p01lfwtd Trial 4: Download bbc's "Program" rather than a "catagory" or "sub-category" (works as desired and expected, like youtube playlist)C:\Users\jlazarus\Media\Video\bbc>youtube-dl http://www.bbc.co.uk/programmes/b006tnxf/episodes/player C:\Users\jlazarus\Media\Video\bbc> |
Make sure you are using the latest version: run
youtube-dl --versionand ensure your version is 2017.11.06.Result:
C:\Users\jlazarus\Media\Video\bbc>youtube-dl --version
2017.11.06
What is the purpose of your issue?
The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue
If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Request youtube-dl.exe download all the videos referenced by a "Table of Contents" page, just like ytdl would process a Youtube playlist:
C:\Users\jlazarus\Media\Video\bbc>ytdl --verbose http://www.bbc.co.uk/programmes/p01lfwtd
C:\Users\jlazarus\Media\Video\bbc>youtube-dl -i -R 3 --write-info-json --write-all-thumbnails --embed-thumbnail --ignore-errors --verbose http://www.b
bc.co.uk/programmes/p01lfwtd
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-i', '-R', '3', '--write-info-json', '--write-all-thumbnails', '--embed-thumbnail', '--ignore-errors', '--verbose', 'http
://www.bbc.co.uk/programmes/p01lfwtd']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2017.11.06
[debug] Python version 3.4.4 - Windows-7-6.1.7601-SP1
[debug] exe versions: rtmpdump 2.3
[debug] Proxy map: {}
[bbc.co.uk] p01lfwtd: Downloading video page
[bbc.co.uk] p01lfwtd: Downloading playlist JSON
[bbc.co.uk] p01lfwtd: Downloading legacy playlist XML
ERROR: Unable to download XML: HTTP Error 404: Not Found (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you ar
e using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp1ogvhjus\build\youtube_dl\extractor\common.py", line 506, in _request_webpage
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp1ogvhjus\build\youtube_dl\YoutubeDL.py", line 2195, in urlopen
File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
C:\Users\jlazarus\Media\Video\bbc>
try it again, but include the "playlist" flag.
C:\Users\jlazarus\Media\Video\bbc>ytdl-dopl --verbose http://www.bbc.co.uk/programmes/p01lfwtd
C:\Users\jlazarus\Media\Video\bbc>youtube-dl -i -R 3 --yes-playlist --write-all-thumbnails --autonumber-size 3 --output ".%(playlist_title)s%(auton
umber)s-%(title)s-%(id)s.%(ext)s" --verbose http://www.bbc.co.uk/programmes/p01lfwtd
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-i', '-R', '3', '--yes-playlist', '--write-all-thumbnails', '--autonumber-size', '3', '--output', '.\%(playlist_title)s
%(autonumber)s-%(title)s-%(id)s.%(ext)s', '--verbose', 'http://www.bbc.co.uk/programmes/p01lfwtd']
WARNING: --autonumber-size is deprecated. Use output template with %(autonumber)0Nd, where N in the number of digits instead.
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2017.11.06
[debug] Python version 3.4.4 - Windows-7-6.1.7601-SP1
[debug] exe versions: rtmpdump 2.3
[debug] Proxy map: {}
[bbc.co.uk] p01lfwtd: Downloading video page
[bbc.co.uk] p01lfwtd: Downloading playlist JSON
[bbc.co.uk] p01lfwtd: Downloading legacy playlist XML
ERROR: Unable to download XML: HTTP Error 404: Not Found (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you ar
e using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp1ogvhjus\build\youtube_dl\extractor\common.py", line 506, in _request_webpage
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp1ogvhjus\build\youtube_dl\YoutubeDL.py", line 2195, in urlopen
File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
Description of your issue, suggested solution and other information
Summary: individual downloads work properly at bbc.co.uk, but requests to return multiple video files produces unhandled errors, shown below.
e.g. At youtube.com, requesting ytdl process a playlist is EXTREMELY well supported. Youtube searches are equally well supported. However, the equivalent functionality appears lacking for bbc.co.uk.
qed: Since BBC is an extremely important content producer and publisher, arguably as important as youtube, consider supporting multi-video downloads from bbc.co.uk with options comparable to youtube playlists and searches.
(btw: I'm uncertain where this should be categorized as an "enhancement request" or "a bug report". The error messages suggest some of both.)