Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot download YouTube playlist with more than 100 videos #14076

Closed
VladimirGaristov opened this issue Aug 31, 2017 · 12 comments
Closed

Cannot download YouTube playlist with more than 100 videos #14076

VladimirGaristov opened this issue Aug 31, 2017 · 12 comments
Labels

Comments

@VladimirGaristov
Copy link

@VladimirGaristov VladimirGaristov commented Aug 31, 2017

  • I've verified and I assure that I'm running youtube-dl 2017.08.27.1
  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

I get this error when attempting to download this playlist (don't judge the poor taste in music, a friend asked me to download it for him):
https://www.youtube.com/playlist?list=PLrSr3DDuAc85RUDL2v3woC_fyaRHGIgta

 youtube-dl -v "https://www.youtube.com/playlist?list=PLrSr3DDuAc85RUDL2v3woC_fyaRHGIgta"
[debug] System config: [u'-f', u'bestaudio[ext=m4a]/135+bestaudio[ext=m4a]/136+bestaudio[ext=m4a]/best[ext=mp4]', u'-o', u'/home/cartogan/Videos/%(playlist)s/%(title)s-%(id)s.%(ext)s', u'--yes-playlist']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.youtube.com/playlist?list=PLrSr3DDuAc85RUDL2v3woC_fyaRHGIgta']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.08.27.1
[debug] Python version 2.7.12 - Linux-4.4.0-77-generic-x86_64-with-LinuxMint-18-sarah
[debug] exe versions: ffmpeg 2.8.11-0ubuntu0.16.04.1, ffprobe 2.8.11-0ubuntu0.16.04.1
[debug] Proxy map: {}
[youtube:playlist] PLrSr3DDuAc85RUDL2v3woC_fyaRHGIgta: Downloading webpage
[download] Downloading playlist: Чалга 2016-2017
[youtube:playlist] PLrSr3DDuAc85RUDL2v3woC_fyaRHGIgta: Downloading page #1
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/bin/youtube-dl/__main__.py", line 19, in <module>
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 465, in main
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 455, in _real_main
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1958, in download
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 787, in extract_info
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 939, in process_ie_result
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/youtube.py", line 272, in _entries
KeyError: u'content_html'
<end of log>

At first I thought the slashes in video titles were causing the issue but individual videos can be downloaded without errors. The slashes are replaced with underscores.
Then I tried downloading the first three songs by adding them to new playlists to determine if the name of the playlist can cause an issue. I tried names that included latin and cyrilic letters, numbers, spaces and dashes. The new playlists were downloaded without errors.

Any help is appreciated.

EDIT:
I created a new playlist with the same name and I noticed that the line
[youtube:playlist] PLrSr3DDuAc85RUDL2v3woC_fyaRHGIgta: Downloading page #1
changed to
[youtube:playlist] playlist Чалга 2016-2017: Downloading 2 videos
The new playlist downloads with no issues.

@VladimirGaristov
Copy link
Author

@VladimirGaristov VladimirGaristov commented Aug 31, 2017

Turns out the playlist is too long. I get the same error on other playlists of more than 100 videos.

@VladimirGaristov VladimirGaristov changed the title Cannot download specific playlist from YouTube, cyrilic letters and "/" in titles Cannot download YouTube playlist with more than 100 videos Aug 31, 2017
@wellivea1
Copy link

@wellivea1 wellivea1 commented Aug 31, 2017

I am getting the same error, but I did not get it before. It has been over 100 videos for a long time.

@HPP8140
Copy link

@HPP8140 HPP8140 commented Aug 31, 2017

Seems to happen when the playlist has more than 100 items, the "Load more" is not working

@Aioxas
Copy link

@Aioxas Aioxas commented Aug 31, 2017

Agreed, I get a key error regarding "content_html = more["content_html"]" with content_html not being found. Either 1. that key got changed, 2. Something else changed.

@Hrxn
Copy link

@Hrxn Hrxn commented Aug 31, 2017

Yeah, I noticed some smaller (mostly cosmetic) changes on the YouTube site as well in the last days, and a site redesign has been planned (and is in the works) for some time now, so I definitely think this is some site change.

@xsteadfastx
Copy link

@xsteadfastx xsteadfastx commented Aug 31, 2017

i dont get the python traceback but have the same problem.

@realspencerdupre
Copy link

@realspencerdupre realspencerdupre commented Aug 31, 2017

I'm a youtube-dl n00b, but I'm on the latest version via the curl command a couple minutes ago. Same issue. Seems like in the web interface the get param "&disable_polymer=true" produces the old-school playlist page. Dunno if that helps.

@lukaskollmer
Copy link

@lukaskollmer lukaskollmer commented Aug 31, 2017

Same here. It's probably related to the site redesign they're rolling out atm

@rocawhey
Copy link

@rocawhey rocawhey commented Aug 31, 2017

as a temporary workaround of slightly less inconvenience, one can order their playlist by date added or add videos to the top of the playlist, and then use flags --playlist-start 1 --playlist-end 100. anything above 100 still won't work.

@Rayniax
Copy link

@Rayniax Rayniax commented Sep 1, 2017

Hello,
Exactly got the same problem from today, i just upgraded and I cannot download anymore from my playlist with about 200 videos. It was working very well before, just got "ERROR: u'content_html'
Thank you very much for the work of the community.

@synergiance
Copy link

@synergiance synergiance commented Sep 1, 2017

My 700+ video playlist was working just fine the other day with youtube-dl I wonder what happened

@Hrxn
Copy link

@Hrxn Hrxn commented Sep 1, 2017

Site redesign, as mentioned earlier.

@dstftw dstftw closed this Sep 1, 2017
@dstftw dstftw added the duplicate label Sep 1, 2017
@ytdl-org ytdl-org locked and limited conversation to collaborators Sep 1, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
You can’t perform that action at this time.