Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Scheduler] about priority scheduling #4938

Open
whitewindmills opened this issue May 14, 2024 · 3 comments · May be fixed by #4993
Open

[Scheduler] about priority scheduling #4938

whitewindmills opened this issue May 14, 2024 · 3 comments · May be fixed by #4993
Labels
kind/feature Categorizes issue or PR as related to a new feature.

Comments

@whitewindmills
Copy link
Member

What would you like to be added:
The current scheduler only schedules resources in order, that is, the resources triggered first can be scheduled first. They are stored in a first-in-first-out queue. This seems too simplistic at the moment, maybe it's time to introduce priority-based scheduling behavior.

Why is this needed:
In large-scale clusters, scheduling responses can become slow, An example use case is for data science workloads. A user may submit a job that they want to be prioritized above other workloads, but do not wish to affect existing work. The high priority resourceBinding will be scheduled ahead of other queued resourceBindings, as soon as sufficient cluster resources "naturally" become free.
priority-scheduling

@whitewindmills whitewindmills added the kind/feature Categorizes issue or PR as related to a new feature. label May 14, 2024
@RainbowMango
Copy link
Member

Hi @whitewindmills are you able to join this weeks's community meeting as @wengyao04 and her workmates going to share a proposal about priority and preemption scheduling?

@whitewindmills
Copy link
Member Author

@RainbowMango
I'm not sure if I can attend yet, but I'll try.

@RainbowMango RainbowMango linked a pull request Sep 6, 2024 that will close this issue
@RainbowMango
Copy link
Member

Now we have two proposals for this feature:

  1. First one at Propose binding priority and preemption #4993
  2. Second one at Google Doc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature Categorizes issue or PR as related to a new feature.
Projects
Status: Planning
Development

Successfully merging a pull request may close this issue.

2 participants