Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fair share #21

Open
innovate-invent opened this issue Mar 10, 2022 · 0 comments
Open

Fair share #21

innovate-invent opened this issue Mar 10, 2022 · 0 comments

Comments

@innovate-invent
Copy link
Collaborator

Jobs can be scheduled with a criteria that makes them always unscheduable. A service that polls the docker swarm/k8s queue for new jobs can then take the scheduling user and other metadata from the job and remove the unscheduable criteria based on fair share.
Once the jobs are complete, Galaxy can be told not to delete the job. This service can then collect CPU times and any other metrics before cleaning up the job.

This is ideally separate from the Galaxy job-runner so that it can be re-used by other project potentially not using Galaxy, or across multiple Galaxy instances.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant