Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is youtube-dl able to make use of multiple cores ? #3852

Closed
TheGr33k opened this issue Sep 29, 2014 · 2 comments
Closed

Is youtube-dl able to make use of multiple cores ? #3852

TheGr33k opened this issue Sep 29, 2014 · 2 comments

Comments

@TheGr33k
Copy link

@TheGr33k TheGr33k commented Sep 29, 2014

It would have been awesome if youtube-dl can generate direct url while making use of multiple cores .I believe this can really speed things up .

On a side note youtube-dl uses a lot of cpu on my cpu (20-25% per process) and i use a Dual Xeon E5-2620.I would love some optimization on that front to make the cpu usage lower

I am using python 2.7 atm :)

@phihag
Copy link
Contributor

@phihag phihag commented Sep 29, 2014

cpython 2.7 limits youtube-dl to 1 CPU without multiprocessing. While multiprocessing is definitely an option we would consider (to download multiple videos in parallel), it won't help if bandwidth is your limit. Note that you can run as many instances of youtube-dl as you want. youtube-dl explicitly supports this.

We are pursuing speedups by compiling, for example with pyston (see #3029 ). There is also the possibility that the http downloader and youtube-dl core can be sped up significantly by changing the youtube-dl code (as opposed to its interpretation) directly. Pull requests to that effect are welcome.

@phihag phihag closed this Sep 29, 2014
@STonEDSTonE
Copy link

@STonEDSTonE STonEDSTonE commented Nov 20, 2018

This is a very old post, but i did not find a newer one regarding this topic.
Since 4 years have passed, is there a posibility to use multiple cores now? Or will there be one in the future? Or is this sth. that will never happen?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.