-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Apple silicon GPU(mps) support to ray #38464
base: master
Are you sure you want to change the base?
Conversation
Signed-off-by: NripeshN <nn2012@hw.ac.uk>
hi @krfricke, created a new PR because I messed up my old one. |
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 14 days if no further activity occurs. Thank you for your contributions.
|
hi @krfricke, please review this PR |
Signed-off-by: Nripesh Niketan <86844847+NripeshN@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you rebase with master
|
||
@staticmethod | ||
def get_current_node_num_accelerators() -> int: | ||
return 1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If the currently node doesn't have apple accelerators, we shouldn't return 1.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hey,
quick question. All Apple silicon laptops have mps accelerator support.
So shouldn't it always be 1?
Signed-off-by: Nripesh Niketan <86844847+NripeshN@users.noreply.github.com>
Signed-off-by: Nripesh Niketan <86844847+NripeshN@users.noreply.github.com>
@jjyao this feels like a good thing to push through to enable better support for local dev/test on apple silicon. reminder to take a look. im adding this to core-sprint so we don't forget. |
We really need Apple consult to help push this PR through as we're not familiar with MPS and other Apple Silicon GPU specific APIs. |
Why are these changes needed?
Related issue number
Checks
git commit -s
) in this PR.scripts/format.sh
to lint the changes in this PR.method in Tune, I've added it in
doc/source/tune/api/
under thecorresponding
.rst
file.