Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem with YouTube and Docker 429 #25805

Closed
vonProteus opened this issue Jun 27, 2020 · 0 comments
Closed

Problem with YouTube and Docker 429 #25805

vonProteus opened this issue Jun 27, 2020 · 0 comments
Labels

Comments

@vonProteus
Copy link

@vonProteus vonProteus commented Jun 27, 2020

Checklist

  • I'm reporting a broken site support issue
  • I've verified that I'm running youtube-dl version 2020.06.16.1
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar bug reports including closed ones
  • I've read bugs section in FAQ

Verbose log

+ '[' '!' -f /data/youtube-arhive-file.txt ']',
+ youtube-dl https://www.youtube.com/channel/UChS9wazLlTUHSTeKVG39hZw --download-archive /data/youtube-arhive-file.txt --yes-playlist --limit-rate 1.5M --cookies /data/cookie.txt --write-info-json --sleep-interval 30 --max-sleep-interval 120 -x --audio-format mp3 --id --exec './process-video.sh {}' --verbose,
[debug] System config: [],
[debug] User config: [],
[debug] Custom config: [],
[debug] Command-line args: ['https://www.youtube.com/channel/UChS9wazLlTUHSTeKVG39hZw', '--download-archive', '/data/youtube-arhive-file.txt', '--yes-playlist', '--limit-rate', '1.5M', '--cookies', '/data/cookie.txt', '--write-info-json', '--sleep-interval', '30', '--max-sleep-interval', '120', '-x', '--audio-format', 'mp3', '--id', '--exec', './process-video.sh {}', '--verbose'],
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8,
[debug] youtube-dl version 2020.06.16.1,
[debug] Python version 3.8.3 (CPython) - Linux-4.19.118-v7l+-armv7l-with,
[debug] exe versions: ffmpeg 4.3, ffprobe 4.3,
[debug] Proxy map: {},
[youtube:channel] UChS9wazLlTUHSTeKVG39hZw: Downloading channel page,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading webpage,
[download] Downloading playlist: Uploads from Arch Warhammer,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #1,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #2,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #3,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #4,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #5,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #6,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #7,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #8,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #9,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #10,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #11,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #12,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #13,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #14,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #15,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #16,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #17,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #18,
[youtube:playlist] UUhS9wazLlTUHSTeKVG39hZw: Downloading page #19,
[youtube:playlist] playlist Uploads from Arch Warhammer: Downloading 1911 videos,
[download] Downloading video 1 of 1911,
[youtube] agyqrAvo-jM: Downloading webpage,
ERROR: Unable to download webpage: HTTP Error 429: Too Many Requests (caused by <HTTPError 429: 'Too Many Requests'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.,
  File "/usr/lib/python3.8/site-packages/youtube_dl/extractor/common.py", line 627, in _request_webpage,
    return self._downloader.urlopen(url_or_request),
  File "/usr/lib/python3.8/site-packages/youtube_dl/YoutubeDL.py", line 2238, in urlopen,
    return self._opener.open(req, timeout=self._socket_timeout),
  File "/usr/lib/python3.8/urllib/request.py", line 531, in open,
    response = meth(req, response),
  File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response,
    response = self.parent.error(,
  File "/usr/lib/python3.8/urllib/request.py", line 569, in error,
    return self._call_chain(*args),
  File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain,
    result = func(*args),
  File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default,
    raise HTTPError(req.full_url, code, msg, hdrs, fp),
,

Description

as of environment i'm using raspberry pi 4 with docker swarm and this stack

version: '3.4'

services:
  podcastgenerator:
    image: vonproteus/podcast-generator
    volumes:
      - app_data:/app/PodcastGenerator/appdata
    networks:
      - internal
      - external
      - traefik-net
    deploy:
      mode: replicated
      replicas: 1
      restart_policy:
        condition: on-failure
        delay: 5s
      labels:
        traefik.enable: "true"
        traefik.frontend.rule: "Host:${HOST}"
        traefik.port: 80
        traefik.frontend.auth.basic.users: "${BASICAUTHUSERS}"
        traefik.docker.network: traefik-net
        traefik.frontend.headers.STSSeconds: 63072000
        traefik.frontend.headers.STSIncludeSubdomains: "true"
        traefik.frontend.headers.STSPreload: "true"
  yt2p:
    image: vonproteus/youtube-to-podcast
    environment:
      YTURL: $YTURL
      PGREGENERATERSSURL: "http://podcastgenerator/pg-cron.php?key=${REGENERATERSSKEY}"
    volumes:
      - app_data:/data
    networks:
      - external
    deploy:
      mode: replicated
      replicas: 1
      restart_policy:
        condition: any
        delay: 24h

volumes:
  app_data:

networks:
  external:
  internal:
    driver: overlay
    internal: true
  traefik-net:
    external: true

i copied content of cookies from /data/cookie.txt to firefox and there was no capta

@dstftw dstftw closed this Jun 27, 2020
@dstftw dstftw added the duplicate label Jun 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.