Repository navigation
Create Slurm runtime for model training using V2 APIs #2249
Description
What you would like to be added?
As we discussed during the last Training WG call, we want to design and implement Training Runtime for Slurm, so users can leverage Slurm workload manager for model training on Kubernetes.
Recordings: https://youtu.be/IBDyYUbB0UA
We can continue discussions once we implement the Training Operator V2 APIs.
cc @kubeflow/wg-training-leads @catblade
/area runtime
Love this feature?
Give it a 👍 We prioritize the features with most 👍
Metadata
Metadata
Assignees
Type
Projects
- Status
Activity
andreyvelich commentedon Sep 5, 2024
/remove-label lifecycle/needs-triage
github-actions commentedon Dec 4, 2024
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
andreyvelich commentedon Dec 4, 2024
/remove-lifecycle stale
github-actions commentedon Mar 4, 2025
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
tenzen-y commentedon Mar 4, 2025
/remove-lifecycle stale
github-actions commentedon Jun 3, 2025
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
24 remaining items
andreyvelich commentedon Jul 31, 2026
This is great to hear @killianmuldoon!
Would you be interested to contribute one of the Trainer user guides on how to run scheduled TrainJob pods with slurm-bridge?
https://trainer.kubeflow.org/en/latest/user-guides/index.html
modichika commentedon Aug 7, 2026
Hey @andreyvelich is anyone working on this one?
If not I would like to work one it.
killianmuldoon commentedon Aug 7, 2026
@modichika - if you don't mind I'd like to contribute this. I just need to think around the best way to present slurm bridge as a scheduler for TrainJobs
modichika commentedon Aug 7, 2026
If you don't mind let's work on it together? @killianmuldoon
andreyvelich commentedon Aug 7, 2026
Thank you for your interest @modichika, sure you can help us with the review and design implementation!
As we discussed before with @killianmuldoon during the Trainer call, let him work on initial proposal design how we want to expose
SlurmRuntimeto our users and how Slurm Bridge should be used./assign @killianmuldoon @modichika
modichika commentedon Aug 7, 2026
Cool thanks @andreyvelich and excited to work with @killianmuldoon