Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding ppc64le support for PyTorch engine #2989

Open
Sapana-Khemkar opened this issue Feb 12, 2024 · 4 comments
Open

Adding ppc64le support for PyTorch engine #2989

Sapana-Khemkar opened this issue Feb 12, 2024 · 4 comments
Labels
enhancement New feature or request

Comments

@Sapana-Khemkar
Copy link

Sapana-Khemkar commented Feb 12, 2024

Description

Adding support to ppc64le architecture to pytorch-engine.
By referring these instructions have built and test jni locally on my ppc64le VM with opence conda pytorch. Build and tests completed successfully.

@Sapana-Khemkar Sapana-Khemkar added the enhancement New feature or request label Feb 12, 2024
@frankfliu
Copy link
Contributor

We don't have plan to ship ppc64le native libraries for PyTorch engine.

Since you are able to build JNI, you can package your JNI and the .so files in a jar or save them in DJL cache folder. DJL should be able to pick it up.

@Sapana-Khemkar
Copy link
Author

@frankfliu
DJL is dependency for https://github.com/opensearch-project/ml-commons
We are working on enabling ppc64le support for opensearch. Here is issue opensearch-project/opensearch-build#3122.
If you can consider this request, we are happy to work with you.

@frankfliu
Copy link
Contributor

The challenge part is how to create a release pipeline for ppc. And how to maintain this pipeline for new version of PyTorch

@Sapana-Khemkar
Copy link
Author

The challenge part is how to create a release pipeline for ppc. And how to maintain this pipeline for new version of PyTorch

@frankfliu you can use multiarch/qemu-user-static container image for implementing workflow for ppc64le. We can support you to implement the same.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants