Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

advanced job dependencies #2

Open
SteVwonder opened this issue Jul 10, 2018 · 3 comments
Open

advanced job dependencies #2

SteVwonder opened this issue Jul 10, 2018 · 3 comments

Comments

@SteVwonder
Copy link
Member

Add support to both the interfaces and the scheduling logic for dependencies between jobs.

In terms of interfaces:

  • when users submit a job, they will need a way to specify dependencies, which will probably require co-development with #1570 and potentially #1332
  • command line interfaces for job dependency modification while the job is still in the pending queue

In terms of scheduling logic:

  • We should look into how other schedulers handle job dependency logic
  • We should perform performance testing based on the expected behavior of our users to ensure that long chains of dependencies do not place an undue burden on the scheduler
@dongahn
Copy link
Member

dongahn commented Jul 10, 2018

We still have to decide where the dependency logic should sit between flux-core and flux-sched, though.

@SteVwonder SteVwonder changed the title sched: job dependencies job dependencies Jul 10, 2018
@SteVwonder
Copy link
Member Author

Ah, good point. I just assumed it would go into sched, but you are right, that isn't necessarily the case.

@dongahn
Copy link
Member

dongahn commented Jul 28, 2018

As we discussed this with Montoya, Dahlgren and Laney the other day, it seems we do need to collect input from some of the workflow people on this.

@dongahn dongahn transferred this issue from flux-framework/flux-sched Dec 19, 2020
@grondo grondo changed the title job dependencies advanced job dependencies Jun 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

2 participants