Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run distributed versions of pipelines #11

Closed
nvasilakis opened this issue Dec 28, 2019 · 2 comments
Closed

Run distributed versions of pipelines #11

nvasilakis opened this issue Dec 28, 2019 · 2 comments
Assignees

Comments

@nvasilakis
Copy link
Collaborator

For the sets of pipelines that we have, it would be great to run experiments with distributed execution. For now, Dish can rewrite pipelines using a custom wrapper around nc, and custom network-aware splitters and mergers similar to the single-nodes ones we have now.

@nvasilakis
Copy link
Collaborator Author

@angelhof We should also try to apply Dish on all the new pipelines (total about 15); if a missing feature is blocking any of the pipelines, we should note it in the scripts overview table (it will help us direct focus).

nvasilakis added a commit that referenced this issue Jan 9, 2020
@angelhof
Copy link
Member

Closing since we are not doing this in the near future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants