Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sergey, I have wrote to you email, I would like to develop workaround limiting https://www.youtube.com/get_video_info?video_id={videoId}. call. Please stop closing this and communicate. youtube-dl needs refactoring to be able to use with youtube #23635

Closed
janblaha opened this issue Jan 5, 2020 · 1 comment
Labels

Comments

@janblaha
Copy link

@janblaha janblaha commented Jan 5, 2020

Current concept of youtube download is completely useless for archiving youtube channel, which is funny, when using name youtube-dl :)

Current version 2020.01.01 downloads webpage a than sequentially downloads video info page and than by dates or name of the video file set by -o selecting, if video should be downloaded or not. This concept leads to too many request error, it is only matter of time, when your ip start to be blocked by google.

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-f', 'bestvideo+bestaudio', '--verbose', '--restrict-filenames', '--playlist-reverse', '-i', '--no-mtime', '-o', '%(uploader)s [%(channel_id)s]/%(upload_date)s - %(title)s [%(id)s].%(ext)s', '-ci', 'https://www.youtube.com/watch?v=VoaY8YRberk']
[debug] Encodings: locale cp1250, fs utf-8, out utf-8, pref cp1250
[debug] youtube-dl version 2020.01.01
[debug] Python version 3.7.0b4 (CPython) - Windows-10-10.0.18362-SP0
[debug] exe versions: ffmpeg git-2019-10-28-68f623d, ffprobe git-2019-10-28-68f623d
[debug] Proxy map: {}
[youtube] VoaY8YRberk: Downloading webpage
[youtube] VoaY8YRberk: Downloading video info webpage
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests

Using browser (chrome, firefox) same machine same time everything is OK, youtube plays video and show all information.

youtube-dl needs to refactor and use for grabbing video information JSON google API (in which case is possible to pay for increasing quota and free qouta is in ten of thousands videos information querry per day) or have to much more properly simulate real person usage and grab necessary new video info from

https://www.youtube.com/watch?v={youtube video ID}

and list of channel new videos ID grab from

https://www.youtube.com/channel/{youtube channel ID}/videos

Current version (usage of everyday checking of list of channels for new videos and archive them) is broken for youtube, or functioning only few days with luck (i am checking last 5 videos in about 40 channels once per a day and it took about 2-3 weeks to be blocked).

youtube-dl -v -f bestvideo+bestaudio --restrict-filenames --playlist-reverse --playlist-end 5 -i --no-mtime --dateafter now-7days -o "%(uploader)s [%(channel_id)s]/%(upload_date)s - %(title)s [%(id)s].%(ext)s" -ci --batch-file=download.txt

@koznov
Copy link

@koznov koznov commented Jan 5, 2020

Same here, there is problem with playing with youtube-dl.
When i'm using Firefox - it is going well - video is playing, when i'm trying to play with youtube-dl i'm getting

root@music:/home/user# youtube-dl https://www.youtube.com/watch?v=Y2u95GYuFUI
[youtube] Y2u95GYuFUI: Downloading webpage
[youtube] Y2u95GYuFUI: Downloading video info webpage
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
@ytdl-org ytdl-org locked and limited conversation to collaborators Jan 5, 2020
@dstftw dstftw closed this Jan 5, 2020
@dstftw dstftw added the duplicate label Jan 5, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.