Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can not search more than 20 result with youtube-dl in Google colab (next page problem!) #26623

Open
soheilpaper opened this issue Sep 18, 2020 · 0 comments
Labels

Comments

@soheilpaper
Copy link

@soheilpaper soheilpaper commented Sep 18, 2020

Checklist

Question

I have tried to download the audio with Farsi subtitle for building the speech to text database for this project , so i am using the YouTube-dl.

The colab youtube-dl -v ... is:

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'http://www.youtube.com/watch?v=WKsjaOqDXgg']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.09.14
[debug] Python version 3.6.9 (CPython) - Linux-4.19.112+-x86_64-with-Ubuntu-18.04-bionic
[debug] exe versions: ffmpeg 3.4.8, ffprobe 3.4.8
[debug] Proxy map: {}
[youtube] WKsjaOqDXgg: Downloading webpage

But it don't search is limited to less that 30 result and stop suddenly form searching, my code is like this (the colab link could be seen here):

!youtube-dl --write-auto-sub --list-subs --sub-lang 'fa-IR' --sub-format=srv --extract-audio --audio-format mp3 -o '%(title)s by %(uploader)s on %(upload_date)s in %(playlist)s.%(ext)s' --restrict-filenames --audio-quality '128K' -i "ytsearch2000:art" >> Youtube_dl_links.txt

so i have seen this page :

Not downloading the entire playlist

and tried to change it by adding --sleep-interval 1 and , --playlist-start X --playlist-end X like said there, but is spot again and don't continue, which i don't know why this happen?
if there be some method to limit the youtube-dl into one loop with resume capability maybe the problem become solved.

the code and results:

!youtube-dl  -ciw --playlist-start 1 --playlist-end 1000 --sleep-interval '1' --skip-download --get-url --write-auto-sub  --list-subs  --sub-lang 'fa-IR' --sub-format=srv  --default-search "ytsearch2000:" "art"   >> Youtube_dl_links.txt 

enter image description here
So maybe the Youtube-dl is not proper for this usage, I have tried the java youtube-dl version in colab ( that can not use it because of being java and ... !)

So, I would appreciate, if you solve the youtube-dl search limit to search high amount of video via YouTube to find video with Persian default language and its subtitle, or example searching 1000 search result of art search key word in YouTube site.

Also asked here:

https://unix.stackexchange.com/questions/610143/can-not-search-more-than-20-result-with-youtube-dl-in-google-colab-next-page-pr

Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
1 participant
You can’t perform that action at this time.