Unable to detect GPU as inference device

[js333031]

OpenVINO Version

2024.1.0

Operating System

Other (Please specify in description)

Device used for inference

GPU

Framework

None

Model used

No response

Issue description

Hardware: NUC 12 with A770m discreet GPU
OS: Ubuntu 24.04 LTS
Kernel: 6.8.0-31-generic
User's group ownership: video, render

dmesg, output of hello_query_device, output of hello_query_device using strace, list of packages, output of clinfo and vainfo is in attached files.
clinfo.txt
vainfo.txt
hqd.txt
dpkg_list.txt
dmesg.txt
hqd_strace.txt

Step-by-step reproduction

Compute runtime installed after default Ubuntu 24.04 LTS did not work with clinfo using following steps:

mkdir neo
cd neo
wget https://github.com/intel/intel-graphics-compiler/releases/download/igc-1.0.16695.4/intel-igc-core_1.0.16695.4_amd64.deb
wget https://github.com/intel/intel-graphics-compiler/releases/download/igc-1.0.16695.4/intel-igc-opencl_1.0.16695.4_amd64.deb
wget https://github.com/intel/compute-runtime/releases/download/24.17.29377.6/intel-level-zero-gpu-dbgsym_1.3.29377.6_amd64.ddeb
wget https://github.com/intel/compute-runtime/releases/download/24.17.29377.6/intel-level-zero-gpu_1.3.29377.6_amd64.deb
wget https://github.com/intel/compute-runtime/releases/download/24.17.29377.6/intel-opencl-icd-dbgsym_24.17.29377.6_amd64.ddeb
wget https://github.com/intel/compute-runtime/releases/download/24.17.29377.6/intel-opencl-icd_24.17.29377.6_amd64.deb
wget https://github.com/intel/compute-runtime/releases/download/24.17.29377.6/libigdgmm12_22.3.19_amd64.deb
wget https://github.com/intel/compute-runtime/releases/download/24.17.29377.6/ww17.sum
sha256sum -c ww17.sum
sudo dpkg -i *.deb

Relevant log output

See attached

Issue submission checklist

• I'm reporting an issue. It's not a question.
• I checked the problem with the documentation, FAQ, open issues, Stack Overflow, etc., and have not found a solution.
• There is reproducer code and related data files such as images, videos, models, etc.

[p-durandin]

@js333031 clinfo looks OK but hello_query_device reports CPU only. Please check if user has appropriate rights:
User should be in video and render groups
Please check hqd under sudo

[isanghao]

Hi, thanks for reporting with a lot of details :)

Below is the usual log that we see.

# Result from my environment
[pid 351921] openat(AT_FDCWD, "/etc/OpenCL/vendors", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3
[pid 351921] openat(AT_FDCWD, "/etc/OpenCL/vendors/intel.icd", O_RDONLY) = 4

There should be intel.icd file from opencl vendors. From your strace, your vendors file is within conda. Maybe python-related OCL environment is not properly configured. This may be due to your /mnt/forlinux/conda/envs/py310/lib/openvino-2024.1.0/../libOpenCL.so.1 file installation path.

# Result from your environment
openat(AT_FDCWD, "/mnt/forlinux/conda/envs/py310/etc/OpenCL/vendors", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3

If you can check clinfo strace log, I think you can confirm that. clinfo seems to check other vendors file. I guess clinfo is referring other libOpenCL.so file, too.

[js333031]

hello_query_device is now able to see the GPU. Here's what I did:

1. Remove existing conda env: conda remove --name py310 --all
2. Outside of the base conda env: conda deactivate
3. Install media drivers again, similar to steps provided in initial issue submission above
4. Verify that /etc/OpenCL/vendors/intel.icd exists
5. Ran benchmark_app (outside conda env) but that failed. I think due to python 3.12 being the default version on 24.04 LTS
6. For Python 3.10, created new conda env (unfortunately I called it same as old name - py310): conda create --name py310 python=3.10
7. Activated new env: conda activate py310
8. Installed openvino 2024.1.0: conda install -c conda-forge openvino=2024.1.0
9. hello_query_device failed again. strace shows /mnt/forlinux/conda/envs/py310/etc/OpenCL/vendors used still
10. Create symbolic link in /mnt/forlinux/conda/envs/py310/etc/OpenCL/vendors to use system's: ln -s /etc/OpenCL/vendors/intel.icd .
11. Verified that hello_query_device and benchmark_app work with GPU.0 and GPU.1

I think only step 10 above was needed to fix the issue.

[ilya-lavrenov]

Create symbolic link in /mnt/forlinux/conda/envs/py310/etc/OpenCL/vendors to use system's: ln -s /etc/OpenCL/vendors/intel.icd

We have dedicated note about GPU https://docs.openvino.ai/2024/get-started/install-openvino/install-openvino-conda.html#enabling-gpu-device-for-inference

[isanghao]

Can we close this ticket then?

[js333031]

Yes thanks.

…

On Tue, Jun 4, 2024 at 9:52 PM Mingyu Kim ***@***.***> wrote: Can we close this ticket then? — Reply to this email directly, view it on GitHub <#24804 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABT2PN2GF5IEMFYSD2GWP4LZFZVNXAVCNFSM6AAAAABITPODX2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBYG4YTGNZUGU> . You are receiving this because you were mentioned.Message ID: ***@***.***>