Skip to content
This repository has been archived by the owner on Jun 20, 2024. It is now read-only.

Idea: run multiple independent pipelines simulataneously #301

Open
nh13 opened this issue Jun 15, 2017 · 0 comments
Open

Idea: run multiple independent pipelines simulataneously #301

nh13 opened this issue Jun 15, 2017 · 0 comments

Comments

@nh13
Copy link
Member

nh13 commented Jun 15, 2017

For example, we could have an dagr option that specifies a file in which there are multiple pipeline-and-arguments specified (say one-per-line, or colon delimited (removing whitespaces and end-of line backslashes?)). I have many cases where I want to run the same pipeline N ways but with different options, yet I don't want to write a new "aggregate" pipeline (etc.). Seems like this would be easy and convenient. We could even have a "watch directory" where new "dagr" scripts are put and loaded by "dagr". Perhaps that's a separate tool.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant