Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

questions about job level preemption #8

Open
kevyn-zhang opened this issue Sep 30, 2021 · 0 comments
Open

questions about job level preemption #8

kevyn-zhang opened this issue Sep 30, 2021 · 0 comments

Comments

@kevyn-zhang
Copy link

Hello, I'm sorry to bother you, but I'm reading your paper and I came across a question that I would like to ask you.

Regarding the big-c experiment part, set up two queues, one configured with 95% of cluster resources dedicated to run short jobs, and the other configured with 5% of cluster resources dedicated to run long jobs. When the short job is submitted while the long job is running continuously, the short job queue will seize the resources of the long job queue at that time, is that right?

If so, the job-level preemption policy does not work at all, because each queue of the capacity scheduler will only run one task at the same time, and the others are in the blocking state, and the submitted short job can only preempt the one running in the long job queue. In this case, what is the point of proposing a job-level preemption policy?

Sincere thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant