Little process-based workers to do your bidding.
Deliberately minimalist, you provide the number of workers to use & a list of commands (to be executed at the shell) & littleworkers will eat through the list as fast as it can.
littleworkers shines when you just want to parallelize something without a lot of fuss & when you care more about the data/commands to be run.
- Tiny source
- Easy to queue a set of actions
- Works with any runnable commands
- Uses processes
Seriously, it's not a replacement for threading or multiprocessing if your application needs to share a ton of data with the children.
Usage is trivial:
from littleworkers import Pool # Define your commands. commands = [ 'ls -al', 'cd /tmp && mkdir foo', 'date', 'echo "Hello There."', 'sleep 2 && echo "Done."' ] # Setup a pool. Since I have two cores, I'll use two workers. lil = Pool(workers=2) # Run! lil.run(commands)
For more advanced uses, please see the API documentation.
- Python 2.6+