Skip to content
This repository has been archived by the owner on Sep 30, 2020. It is now read-only.

mbarkhau/pb-job-manager

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

38 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Plumbum Job Manager

A utility class to run plumbum commands concurrently

image

Fire and forget Multiple Commands

import plumbum as pb
from pb_job_manager import PBJobManager
pbjm = PBJobManager(max_procs=4)
pbjm.add_job(pb.cmd.grep["foo", "input.txt"] | pb.cmd.sort > "foo.txt")
pbjm.add_job(pb.cmd.grep["bar", "input.txt"] | pb.cmd.sort > "bar.txt")
pbjm.add_job(pb.cmd.grep["baz", "input.txt"] | pb.cmd.sort > "baz.txt")
pbjb.run()   # run until all jobs are finished

Creating Jobs with Callbacks

::

TODO: Example

Jobs with dependencies

::

TODO: Example

Result Iteration

::

TODO: Example

About

A utility class to run plumbum commands in parallel

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published