ML not detecting ARC A380 Falling back to CPU warning?

[ptr727]

Hi, trying to get ML using hardware acceleration working with OpenVino and ARC A380, but I get WARNING No GPU device found in OpenVINO. Falling back to CPU.

I can get hardware transcoding working in Immich and intel_gpu_top shows card activity when transcoding is running.

Full compose file here.

  immich-machine-learning:
    container_name: immich_machine_learning
    image: ghcr.io/immich-app/immich-machine-learning:release-openvino
    restart: unless-stopped
    user: root
    # https://docs.immich.app/features/ml-hardware-acceleration
    # https://github.com/immich-app/immich/releases/latest/download/hwaccel.ml.yml
    device_cgroup_rules: # Why
      - "c 189:* rmw"
    # cat /etc/group | grep -e render -e video
    # stat -c \"%g\" /dev/dri/render*
    group_add: # Running as root, should not be needed, but saw this being added in troubleshooting steps
     - 44
     - 104
    devices:
      - /dev/dri:/dev/dri
    environment:
      - TZ=${TZ}
      - IMMICH_LOG_LEVEL=debug
    networks:
      stack_network:
    volumes:
      - model-cache:/cache
      - /dev/bus/usb:/dev/bus/usb # Why?
    healthcheck:
      disable: false

[11/29/25 15:16:18] INFO     Loading detection model 'buffalo_l' to memory      
[11/29/25 15:16:18] DEBUG    Available ORT providers:                           
                             {'OpenVINOExecutionProvider',                      
                             'CPUExecutionProvider'}                            
[11/29/25 15:16:18] DEBUG    Available OpenVINO devices: ['CPU']                
[11/29/25 15:16:18] WARNING  No GPU device found in OpenVINO. Falling back to   
                             CPU.                                               
[11/29/25 15:16:18] INFO     Setting execution providers to                     
                             ['CPUExecutionProvider'], in descending order of   
                             preference                                         
[11/29/25 15:16:18] DEBUG    Setting execution provider options to              
                             [{'arena_extend_strategy': 'kSameAsRequested'}]    
[11/29/25 15:16:18] DEBUG    Setting execution_mode to ORT_SEQUENTIAL           
[11/29/25 15:16:18] DEBUG    Setting inter_op_num_threads to 1                  
[11/29/25 15:16:18] DEBUG    Setting intra_op_num_threads to 2                  
[11/29/25 15:16:18] INFO     Loading visual model 'ViT-B-32__openai' to memory  
[11/29/25 15:16:18] DEBUG    Loading visual preprocessing config for CLIP model 
                             'ViT-B-32__openai'                                 
[11/29/25 15:16:18] DEBUG    Loaded visual preprocessing config for CLIP model  
                             'ViT-B-32__openai'                                 
[11/29/25 15:16:18] DEBUG    Available ORT providers:                           
                             {'OpenVINOExecutionProvider',                      
                             'CPUExecutionProvider'}                            
[11/29/25 15:16:18] DEBUG    Available OpenVINO devices: ['CPU']                
[11/29/25 15:16:18] WARNING  No GPU device found in OpenVINO. Falling back to   
                             CPU.                                               
[11/29/25 15:16:18] INFO     Setting execution providers to                     
                             ['CPUExecutionProvider'], in descending order of   
                             preference                                         
[11/29/25 15:16:18] DEBUG    Setting execution provider options to              
                             [{'arena_extend_strategy': 'kSameAsRequested'}]    
[11/29/25 15:16:18] DEBUG    Setting execution_mode to ORT_SEQUENTIAL           
[11/29/25 15:16:18] DEBUG    Setting inter_op_num_threads to 1                  
[11/29/25 15:16:18] DEBUG    Setting intra_op_num_threads to 2                  
[11/29/25 15:16:19] INFO     Loading detection model 'PP-OCRv5_mobile' to memory
[11/29/25 15:16:19] DEBUG    Available ORT providers:                           
                             {'OpenVINOExecutionProvider',                      
                             'CPUExecutionProvider'}                            
[11/29/25 15:16:19] DEBUG    Available OpenVINO devices: ['CPU']                
[11/29/25 15:16:19] WARNING  No GPU device found in OpenVINO. Falling back to   
                             CPU.                                               
[11/29/25 15:16:19] INFO     Setting execution providers to                     
                             ['CPUExecutionProvider'], in descending order of   
                             preference                                         
[11/29/25 15:16:19] DEBUG    Setting execution provider options to              
                             [{'arena_extend_strategy': 'kSameAsRequested'}]    
[11/29/25 15:16:19] DEBUG    Setting execution_mode to ORT_SEQUENTIAL           
[11/29/25 15:16:19] DEBUG    Setting inter_op_num_threads to 1                  
[11/29/25 15:16:19] DEBUG    Setting intra_op_num_threads to 2                  
[11/29/25 15:16:19] DEBUG    Setting model format to onnx                       
[11/29/25 15:16:19] INFO     Loading recognition model 'buffalo_l' to memory    
[11/29/25 15:16:19] DEBUG    Available ORT providers:                           
                             {'OpenVINOExecutionProvider',                      
                             'CPUExecutionProvider'}                            
[11/29/25 15:16:19] DEBUG    Available OpenVINO devices: ['CPU']                
[11/29/25 15:16:19] WARNING  No GPU device found in OpenVINO. Falling back to   
                             CPU.                                               
[11/29/25 15:16:19] INFO     Setting execution providers to                     
                             ['CPUExecutionProvider'], in descending order of   
                             preference                                         
[11/29/25 15:16:19] DEBUG    Setting execution provider options to              
                             [{'arena_extend_strategy': 'kSameAsRequested'}]    
[11/29/25 15:16:19] DEBUG    Setting execution_mode to ORT_SEQUENTIAL           
[11/29/25 15:16:19] DEBUG    Setting inter_op_num_threads to 1                  
[11/29/25 15:16:19] DEBUG    Setting intra_op_num_threads to 2                  
[11/29/25 15:16:19] DEBUG    Setting model format to onnx                       
[11/29/25 15:16:20] INFO     Loading recognition model 'PP-OCRv5_mobile' to     
                             memory                                             
[11/29/25 15:16:20] DEBUG    Available ORT providers:                           
                             {'OpenVINOExecutionProvider',                      
                             'CPUExecutionProvider'}                            
[11/29/25 15:16:20] DEBUG    Available OpenVINO devices: ['CPU']                
[11/29/25 15:16:20] WARNING  No GPU device found in OpenVINO. Falling back to   
                             CPU.                                               
[11/29/25 15:16:20] INFO     Setting execution providers to                     
                             ['CPUExecutionProvider'], in descending order of   
                             preference                                         
[11/29/25 15:16:20] DEBUG    Setting execution provider options to              
                             [{'arena_extend_strategy': 'kSameAsRequested'}]    
[11/29/25 15:16:20] DEBUG    Setting execution_mode to ORT_SEQUENTIAL           
[11/29/25 15:16:20] DEBUG    Setting inter_op_num_threads to 1                  
[11/29/25 15:16:20] DEBUG    Setting intra_op_num_threads to 2                  
[11/29/25 15:16:20] INFO     Using engine_name: onnxruntime                     
[11/29/25 15:21:24] INFO     Shutting down due to inactivity.                   
[11/29/25 15:21:24] INFO     Shutting down                                      
[11/29/25 15:21:24] INFO     Waiting for application shutdown.                  
[11/29/25 15:21:24] INFO     Application shutdown complete.                     
[11/29/25 15:21:24] INFO     Finished server process [135]                      
[11/29/25 15:21:24] ERROR    Worker (pid:135) was sent SIGINT!                  
[11/29/25 15:21:24] INFO     Booting worker with pid: 376                       
[11/29/25 15:21:25] DEBUG    Could not load ANN shared libraries, using ONNX:   
                             libmali.so: cannot open shared object file: No such
                             file or directory                                  
[11/29/25 15:21:25] DEBUG    RKNN is not available                              
[11/29/25 15:21:26] INFO     Started server process [376]                       
[11/29/25 15:21:26] INFO     Waiting for application startup.                   
[11/29/25 15:21:26] INFO     Created in-memory cache with unloading after 300s  
                             of inactivity.                                     
[11/29/25 15:21:26] INFO     Initialized request thread pool with 64 threads.   
[11/29/25 15:21:26] INFO     Application startup complete.                      

OS is Proxmox 8 running Docker 29 directly on host OS.

$ ls -l /dev/dri
total 0
drwxr-xr-x 2 root root        100 Nov  2 07:38 by-path
crw-rw---- 1 root video  226,   0 Nov  2 07:38 card0
crw-rw---- 1 root video  226,   1 Nov  2 07:38 card1
crw-rw---- 1 root render 226, 128 Nov  2 07:38 renderD128

$ uname -r
6.8.12-16-pve

$ docker --version
Docker version 29.0.3, build 511dad6

$ lspci -nn | grep -Ei "3d|display|vga"
43:00.0 VGA compatible controller [0300]: Intel Corporation DG2 [Arc A380] [8086:56a5] (rev 05)
c6:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 52)

Any help troubleshooting appreciated.

[ptr727]

I tried the latest OpenVINO docker toolkit directly and it also does not detect the GPU.
Posted in the OpenVINO forum for more help?

[ptr727]

I updated from kernel 6.8 to 6.17 and now it is working. Available OpenVINO devices: ['CPU', 'GPU']
There must be some minimum kernel version required for this to work?