Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--sleep-interval is ignored when paired with --skip-download #26287

Closed
5 of 6 tasks
petersjt014 opened this issue Aug 9, 2020 · 1 comment
Closed
5 of 6 tasks

--sleep-interval is ignored when paired with --skip-download #26287

petersjt014 opened this issue Aug 9, 2020 · 1 comment
Labels

Comments

@petersjt014
Copy link

Checklist

  • I'm reporting a broken site support issue
  • I've verified that I'm running youtube-dl version 2020.07.28
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar bug reports including closed ones
  • I've read bugs section in FAQ

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '--sleep-interval', '5', '--write-info-json', '--skip-download', 'https://www.youtube.com/user/T
heLinuxFoundation']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.07.28
[debug] Lazy loading extractors enabled
[debug] Python version 3.7.6 (CPython) - Linux-5.4.33-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.2.3, ffprobe 4.2.3, rtmpdump 2.4
[debug] Proxy map: {}
[youtube:user] TheLinuxFoundation: Downloading channel page
[youtube:playlist] UUfX55Sx5hEFjoC3cNs6mCUQ: Downloading webpage
[download] Downloading playlist: Uploads from The Linux Foundation
[youtube:playlist] UUfX55Sx5hEFjoC3cNs6mCUQ: Downloading page #1
[youtube:playlist] UUfX55Sx5hEFjoC3cNs6mCUQ: Downloading page #2
[youtube:playlist] UUfX55Sx5hEFjoC3cNs6mCUQ: Downloading page #3
[...]
[youtube:playlist] UUfX55Sx5hEFjoC3cNs6mCUQ: Downloading page #23
[youtube:playlist] playlist Uploads from The Linux Foundation: Downloading 2361 videos
[download] Downloading video 1 of 2361
[youtube] 9mT6Nf_nQ5c: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 429: Too Many Requests (caused by <HTTPError 429: 'Too Many Requests'>); please repo
rt this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to upda
te. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/nix/store/8mkxhcdg5z2ndw574qvnfdw7ij99vrwl-python3.7-youtube-dl-2020.07.28/lib/python3.7/site-packages/youtube_dl/extract
or/common.py", line 627, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/nix/store/8mkxhcdg5z2ndw574qvnfdw7ij99vrwl-python3.7-youtube-dl-2020.07.28/lib/python3.7/site-packages/youtube_dl/Youtube
DL.py", line 2238, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 563, in error
    result = self._call_chain(*args)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 755, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/nix/store/r94aa2gj4drkhfvkm2p4ab6cblb6kxlq-python3-3.7.6/lib/python3.7/urllib/request.py", line 649, in http_error_defaul
t
    raise HTTPError(req.full_url, code, msg, hdrs, fp)


[exited with status 1.]

Description

Youtube-DL ignores both --sleep-interval and --max-sleep-interval when --skip-download is passed. Try this command (ideally not on a main/personal device for obvious reasons):

youtube-dl --sleep-interval 5 --write-info-json --skip-download https://www.youtube.com/user/TheLinuxFoundation

This will work until you (of course) get a 429 error.

I'm filing this as a bug instead of a feature request because it seems like unexpected behavior. Since the flag acts as rate limiting feature, it makes sense that it should do that for any kind of activity that can cause a 429 error.

@dstftw
Copy link
Collaborator

dstftw commented Aug 12, 2020

This is expected behavior.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants