Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Is youtube-dl able to make use of multiple cores ? #3852
Comments
|
cpython 2.7 limits youtube-dl to 1 CPU without multiprocessing. While multiprocessing is definitely an option we would consider (to download multiple videos in parallel), it won't help if bandwidth is your limit. Note that you can run as many instances of youtube-dl as you want. youtube-dl explicitly supports this. We are pursuing speedups by compiling, for example with pyston (see #3029 ). There is also the possibility that the http downloader and youtube-dl core can be sped up significantly by changing the youtube-dl code (as opposed to its interpretation) directly. Pull requests to that effect are welcome. |
|
This is a very old post, but i did not find a newer one regarding this topic. |
It would have been awesome if youtube-dl can generate direct url while making use of multiple cores .I believe this can really speed things up .
On a side note youtube-dl uses a lot of cpu on my cpu (20-25% per process) and i use a Dual Xeon E5-2620.I would love some optimization on that front to make the cpu usage lower
I am using python 2.7 atm :)