Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to enable mkldnn on paddle engine #6

Open
ruhengChen opened this issue May 28, 2022 · 1 comment
Open

how to enable mkldnn on paddle engine #6

ruhengChen opened this issue May 28, 2022 · 1 comment

Comments

@ruhengChen
Copy link

Description

I tried .optOptions(Collections.singletonMap("enableMKLDNN", "true")) to create Criteria and find the options of PpModel added indeead, but it did not work. how to fix this?

Expected Behavior

enable mkldnn on paddle engine

Environment Info

os.name: Windows 10 amd64

------------------ CUDA -----------------
[DEBUG] - No cudart library found in path.
GPU Count: 0

----------------- Engines ---------------
DJL version: 0.18.0
Default Engine: MXNet
[DEBUG] - Using cache dir: C:\Users\CRH\.djl.ai\mxnet\1.9.0-mkl-win-x86_64
[INFO ] - Downloading libgcc_s_seh-1.dll ...
[INFO ] - Downloading libgfortran-3.dll ...
[INFO ] - Downloading libopenblas.dll ...
[INFO ] - Downloading libquadmath-0.dll ...
[INFO ] - Downloading mxnet.dll ...
[DEBUG] - Loading mxnet library from: C:\Users\CRH\.djl.ai\mxnet\1.9.0-mkl-win-x86_64\mxnet.dll
Default Device: cpu()
PyTorch: 2
MXNet: 0
XGBoost: 10
TensorFlow: 3
@mymagicpower
Copy link
Owner

For paddlepaddle this feature is not enabled (i think). Contact DJL team to get further/deep engine support.
For other engines, refer to below link:
http://docs.djl.ai/docs/development/inference_performance_optimization.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants