Failed to load PyTorch native library

[jsxzliyou]

When I run examples/ai.djl.examples.inference.face.RetinaFaceDetection

Exception in thread "main" ai.djl.engine.EngineException: Failed to load PyTorch native library
at ai.djl.pytorch.engine.PtEngine.newInstance(PtEngine.java:77)
at ai.djl.pytorch.engine.PtEngineProvider.getEngine(PtEngineProvider.java:40)
at ai.djl.engine.Engine.getEngine(Engine.java:168)
at ai.djl.engine.Engine.getInstance(Engine.java:133)
at ai.djl.examples.inference.face.RetinaFaceDetection.main(RetinaFaceDetection.java:53)
Caused by: java.lang.UnsatisfiedLinkError: C:\Users\youli.djl.ai\pytorch\1.7.0-cpu-win-x86_64\0.14.0-SNAPSHOT-cpu-djl_torch.dll: 找不到指定的程序。
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at ai.djl.pytorch.jni.LibUtils.loadNativeLibrary(LibUtils.java:384)
at ai.djl.pytorch.jni.LibUtils.loadLibrary(LibUtils.java:93)
at ai.djl.pytorch.engine.PtEngine.newInstance(PtEngine.java:50)
... 4 more

0.14.0-SNAPSHOT-cpu-djl_torch.dll: this file is existing , I'm sure.

======
delete pytorch folder,and run again

[INFO ] - Downloading https://publish.djl.ai/pytorch-1.7.0/cpu/win/native/lib/torch.dll.gz ...
[INFO ] - Downloading https://publish.djl.ai/pytorch-1.7.0/cpu/win/native/lib/asmjit.dll.gz ...
[INFO ] - Downloading https://publish.djl.ai/pytorch-1.7.0/cpu/win/native/lib/torch_cpu.dll.gz ...
[INFO ] - Downloading https://publish.djl.ai/pytorch-1.7.0/cpu/win/native/lib/c10.dll.gz ...
[INFO ] - Downloading https://publish.djl.ai/pytorch-1.7.0/cpu/win/native/lib/fbgemm.dll.gz ...
[INFO ] - Downloading https://publish.djl.ai/pytorch-1.7.0/cpu/win/native/lib/libiomp5md.dll.gz ...
[INFO ] - Downloading jni https://publish.djl.ai/pytorch-1.7.0/jnilib/0.14.0/win-x86_64/cpu/djl_torch.dll to cache ...
Exception in thread "main" ai.djl.engine.EngineException: Failed to load PyTorch native library
at ai.djl.pytorch.engine.PtEngine.newInstance(PtEngine.java:77)
at ai.djl.pytorch.engine.PtEngineProvider.getEngine(PtEngineProvider.java:40)
at ai.djl.engine.Engine.getEngine(Engine.java:168)
at ai.djl.engine.Engine.getInstance(Engine.java:133)
at ai.djl.examples.inference.face.RetinaFaceDetection.main(RetinaFaceDetection.java:53)
Caused by: java.lang.IllegalStateException: Cannot download jni files
at ai.djl.pytorch.jni.LibUtils.downloadJniLib(LibUtils.java:496)
at ai.djl.pytorch.jni.LibUtils.copyJniLibraryFromClasspath(LibUtils.java:247)
at ai.djl.pytorch.jni.LibUtils.getLibName(LibUtils.java:104)
at ai.djl.pytorch.jni.LibUtils.loadLibrary(LibUtils.java:88)
at ai.djl.pytorch.engine.PtEngine.newInstance(PtEngine.java:50)
... 4 more
Caused by: java.io.FileNotFoundException: https://publish.djl.ai/pytorch-1.7.0/jnilib/0.14.0/win-x86_64/cpu/djl_torch.dll
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1890)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:263)
at java.net.URL.openStream(URL.java:1045)
at ai.djl.pytorch.jni.LibUtils.downloadJniLib(LibUtils.java:491)
... 8 more

[zachgk]

Can you try using the latest PyTorch version 1.9.1? PyTorch 1.7.0 is somewhat old and we did not build the jni to support it with the current version of DJL.

[jsxzliyou]

@zachgk Thank you! I made a mistake.

[watler-peng]

very thanks

[frankfliu]

@jsxzliyou DJL 0.14.0 requires pytorch 1.9.1, see: https://docs.djl.ai/engines/pytorch/pytorch-engine/index.html#installation

I'm not sure how you get into this situation, looks like you using DJL 0.14.0-SNAPSHOT. Please try to run it with gradle command. If command line work, then most likely is your IDE problem.

[jsxzliyou]

@frankfliu Thank you! I made a mistake. I used wrong version about PyTorch native library

[NoClient]

Me too. I didn't pay attention to the version correspondence in the table. I copied it directly

[frankfliu]

There is some delay in updating the docs website. Now it's fixed.

[rr-y]

/Users/mmt9267/.djl.ai
Loading: 100% |████████████████████████████████████████|
Exception in thread "main" ai.djl.engine.EngineException: Failed to load PyTorch native library
at ai.djl.pytorch.engine.PtEngine.newInstance(PtEngine.java:90)
at ai.djl.pytorch.engine.PtEngineProvider.getEngine(PtEngineProvider.java:40)
at ai.djl.engine.Engine.getEngine(Engine.java:190)
at ai.djl.Model.newInstance(Model.java:99)
at ai.djl.repository.zoo.BaseModelLoader.createModel(BaseModelLoader.java:191)
at ai.djl.repository.zoo.BaseModelLoader.loadModel(BaseModelLoader.java:154)
at ai.djl.repository.zoo.Criteria.loadModel(Criteria.java:172)
at com.mmt.ugc.text.algorithms.qna.BertQuestionAnswer.predict(BertQuestionAnswer.java:80)
at com.mmt.ugc.text.algorithms.qna.BertQuestionAnswer.main(BertQuestionAnswer.java:56)
Caused by: java.lang.UnsatisfiedLinkError: Can't load library: /Users/mmt9267/.djl.ai/pytorch/2.0.1-20230709-cpu-osx-x86_64/0.23.0-libdjl_torch.dylib
at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2393)
at java.base/java.lang.Runtime.load0(Runtime.java:755)
at java.base/java.lang.System.load(System.java:1953)
at ai.djl.pytorch.jni.LibUtils.loadNativeLibrary(LibUtils.java:353)
at ai.djl.pytorch.jni.LibUtils.loadLibrary(LibUtils.java:84)
at ai.djl.pytorch.engine.PtEngine.newInstance(PtEngine.java:53)
... 8 more

[frankfliu]

Are you using macOS 11?

[rr-y]

yeah it's macOS 11

[frankfliu]

You have to use 1.12.1 for macOS 11: see: https://docs.djl.ai/engines/pytorch/pytorch-engine/index.html#macos