Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unable to run inference in linux environment #10921

Closed
K-Alex13 opened this issue Apr 30, 2024 · 9 comments
Closed

unable to run inference in linux environment #10921

K-Alex13 opened this issue Apr 30, 2024 · 9 comments

Comments

@K-Alex13
Copy link

do we have a correct version package with oneapi 2024.1 and new bigdl? May I find it in http://ec2-52-27-27-201.us-west-2.compute.amazonaws.com/ipex-release.php?device=xpu&repo=us&release=stable
I can not install a correct version to run this.
please help me

@K-Alex13
Copy link
Author

506b2a58-ccb6-4ce3-a566-acb86d3bab0d
the main issue is the error above

@Kpeacef
Copy link

Kpeacef commented Apr 30, 2024

Hi I have encountered this issue before, could you try to install oneapi 2024.0 and try again? Hope that it helps

@K-Alex13
Copy link
Author

thank you for your response, I already install 2024.0

@yangw1234
Copy link
Contributor

Hi @K-Alex13 , IPEX-LLM currently only supports oneapi 2024.0. You can activate oneapi 2024.0 and try again.

@K-Alex13
Copy link
Author

K-Alex13 commented May 1, 2024

the problem is still exist, if this is due to I forget to uninstall oneapi 2024.1 just continue install oneapi 2024.0?

@Kpeacef
Copy link

Kpeacef commented May 1, 2024

Hi I would suggest you to source 2024.0. try cd to /opt/intel and see the versions

@yangw1234
Copy link
Contributor

the problem is still exist, if this is due to I forget to uninstall oneapi 2024.1 just continue install oneapi 2024.0?

Hi K-Alex13, have you try source the 2024.0 version of oneapi?

If it does not work, would you mind sending the output of ldd /path/to/libtorch_cpu.so (copy the path form the last line of you the error message you paste.)?

@K-Alex13
Copy link
Author

K-Alex13 commented May 6, 2024

image I try to reinstall the oneapi 2024.0 and new error comes up

@K-Alex13
Copy link
Author

K-Alex13 commented May 6, 2024

image
This is the new error, not sure what happened.

I use oneapi 2024.0 with following package
713 pip install torch-2.1.0a0+cxx11.abi-cp39-cp39-linux_x86_64.whl
714 pip install torchvision-0.16.0a0+cxx11.abi-cp39-cp39-linux_x86_64.whl
715 pip install intel_extension_for_pytorch-2.1.10+xpu-cp39-cp39-linux_x86_64.whl
716 pip install --pre --upgrade bigdl-llm[xpu]

@K-Alex13 K-Alex13 closed this as completed May 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants