-
Notifications
You must be signed in to change notification settings - Fork 45
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support Mac installation #44
Comments
As far as I understand, that update should come from triton-inference-server, but since it's supposed to run on an NDVIDIA GPU I don't think it'll happen. What you can do is run on a docker emulated image running docker image with flag Hope that helps |
The limitation we have is installation on Linux machine as this is how the binary and libraries are prepared. As @sricke mentioned you may run Ubuntu:22.04 system using Docker and install recently published wheel with |
Thanks for the quick fix, that's what I'll start with. Is it possible to decouple pytriton from the cuda-python library? |
The |
Thanks all! |
@martin-liu you are correct. We are going to fix dependencies on our side to avoid cuda dependency at the moment. Thanks! |
@jkosek, fantastic! I'm truly appreciative of your efforts to resolve this issue. This adjustment will significantly enhance local development experience on Mac. Thank you! |
@martin-liu the change has been applied on the main branch and will be available with next wheel release. |
@jkosek Great! Thank you very much! |
@jkosek may I know what's the ETA for next release? |
@martin-liu the change has been just released. |
@jkosek Thank you for the update, I'll check out! |
@jkosek Seems there are no wheels available that support macOS. Are there any specific issues or blockers preventing the creation of macOS wheels? |
Hey @martin-liu . At the moment we are not able to provide a macOS wheel. The PyTriton contains a Triton binaries which are bounded to the Linux OS and specific version of GLibc. In such case the only option we can suggest is to use Docker image, ex. Ubuntu, on macOS. |
@jkosek got it, thanks |
It would be great to be able to install pytriton on Macs for ease-of-development. Even with the lack of CUDA support for Macs, being able to develop using only the CPU would be a real time saver.
As a far reaching stretch goal, being able to use
mps
on Macs would also be great.As of now
pip install nvidia-pytriton
throws an error being unable to installcuda-python
on my machine.My Machine:
The text was updated successfully, but these errors were encountered: