Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Python library to distribute jobs and pipelines among a cluster
Branch: develop
Pull request Compare This branch is 92 commits behind NAMD:develop.

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
pypelinin
tests
README.markdown

README.markdown

pypelinin

Python library to distribute jobs and pipelines among a cluster.

Usage

Pypelinin will provide a high level python dsl to describe your workflow.

Example 1:

pipeline = Worker('do a task') | [Worker('parallel task 1'),
                                  Worker('parallel task 2')] | Worker('finalizer')

Example 2:

pipeline = Worker('do a task') | [Worker('parallel task 1') | Worker('after 1'),
                                  Worker('parallel task 2')] | Worker('finalizer')

After defined, you just have to start your pipeline.

Pipeliner.start(pipeline)
Something went wrong with that request. Please try again.