Simple solution to make parallel download with Python
Sometimes we need to download a lot of files and by default Python runs all procedurally, what can take long time for end.
The library is a solution to that problem, pyrallelize downloads all files in parallel using multiprocessing.
To install pyrallelize, simply:
$ pip install pyrallelizeFollow an example:
from pyrallelize import pyrallelize
pyrallelize([
'http://example.com/image-1.jpg',
'http://example.com/image-2.jpg',
'http://example.com/image-3.jpg',
'http://example.com/image-4.jpg',
'http://example.com/image-5.jpg'
])- url_list
list - directory
str
$ make install_dependencies$ make test