[Detector Support]: OpenVINO with Intel J4105

[pietro1796]

Describe the problem you are having

I’m running Frigate inside an LXC container on Proxmox (Debian 12.7). I’m trying to use OpenVINO with the iGPU passed through to the container.

I have successfully passed the iGPU to the LXC, and it is correctly visible inside the container. I then pass the GPU to the Frigate container via Docker Compose, and it also appears to be correctly detected there.

However, when I configure OpenVINO to use the GPU as the device, the detector fails to start and crashes the system (the service does not come up). If I switch to using the CPU as the device, it works, but detection is very slow (around 120ms).

Any help getting the iGPU working properly with OpenVINO in this setup would be greatly appreciated.

Version

0.15.0-6cb5cfb

Frigate config file

############# CORE #############
mqtt:
  enabled: false

database:
  path: /db/frigate.db

ffmpeg:
  hwaccel_args: preset-vaapi

birdseye:
  enabled: false

detectors:
  openvino:
    type: openvino
    device: CPU
    model:
      path: /openvino-model/ssdlite_mobilenet_v2.xml

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  path: /openvino-model/ssdlite_mobilenet_v2.xml
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

snapshots:
  enabled: false

record:
  enabled: true
  retain:
    days: 15
    mode: motion

version: 0.15-1

############# DETECTIONS #############

objects:
  track:
    - person
    - door
    - car
    - truck
    - bicycle
    - motorcycle
    - bus
    - dog
    - cat

audio:
  enabled: false
  listen:
    - glass_break
    - gunshot
    - scream
    - door_bell
    - door_knock
    - alarm
    - siren
    - fire_alarm
    - smoke_alarm
    - carbon_monoxide_alarm
    - beep
    - baby_cry
    - dog_bark
    - cat_meow

############# CAMERE #############
cameras:

### STUDIO ###
  Studio:
    onvif:
      host: 192.168.100.84
      port: 2020
      user: <myuser>
      password: <mypassword>
    ffmpeg:
      inputs:
        - path: rtsp://<myuser>:p<mypassword>@192.168.100.84:554/stream1
          roles:
            - record
            - audio
        - path: rtsp://<myuser>:p<mypassword>@192.168.100.84:554/stream2
          roles:
            - detect
    detect:
      enabled: true
      width: 640
      height: 360
      fps: 5
    motion:
      mask: 0.357,0.055,0.357,0,0.001,0,0,0.054

docker-compose file or Docker CLI command

version: "3.9"

services:
  frigate:
    container_name: frigate
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    privileged: True
    shm_size: "256mb"
    devices:
      - /dev/dri/renderD128:/dev/dri/renderD128
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /home/frigate_data/config.yml:/config/config.yml
      - /home/frigate_data/media:/media/frigate
      - /home/frigate_data/db:/db
      - /home/frigate_data/tools:/tools
      - type: tmpfs
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    environment:
      - XDG_RUNTIME_DIR=/tmp/runtime-0
      - LIBVA_DRIVER_NAME=i965
    ports:
      - "8971:8971"
      - "5000:5000"
      - "1984:1984"
      - "8554:8554"
      - "8555:8555/tcp"
      - "8555:8555/udp"

Relevant Frigate log output

2025-05-08 20:48:29.424792360  Process detector:openvino:
2025-05-08 20:48:29.424798508  Traceback (most recent call last):
2025-05-08 20:48:29.424800702    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2025-05-08 20:48:29.424802177      self.run()
2025-05-08 20:48:29.424804054    File "/opt/frigate/frigate/util/process.py", line 41, in run_wrapper
2025-05-08 20:48:29.424810224      return run(*args, **kwargs)
2025-05-08 20:48:29.424855798    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2025-05-08 20:48:29.424858572      self._target(*self._args, **self._kwargs)
2025-05-08 20:48:29.424861316    File "/opt/frigate/frigate/object_detection.py", line 121, in run_detector
2025-05-08 20:48:29.424863305      object_detector = LocalObjectDetector(detector_config=detector_config)
2025-05-08 20:48:29.424865189    File "/opt/frigate/frigate/object_detection.py", line 68, in __init__
2025-05-08 20:48:29.424866851      self.detect_api = create_detector(detector_config)
2025-05-08 20:48:29.424916069    File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2025-05-08 20:48:29.424918469      return api(detector_config)
2025-05-08 20:48:29.424949952    File "/opt/frigate/frigate/detectors/plugins/openvino.py", line 40, in __init__
2025-05-08 20:48:29.424952506      self.interpreter = self.ov_core.compile_model(
2025-05-08 20:48:29.424954942    File "/usr/local/lib/python3.9/dist-packages/openvino/runtime/ie_api.py", line 543, in compile_model
2025-05-08 20:48:29.424956798      super().compile_model(model, device_name, {} if config is None else config),
2025-05-08 20:48:29.424958611  RuntimeError: Exception from src/inference/src/cpp/core.cpp:121:
2025-05-08 20:48:29.424960234  Exception from src/inference/src/dev/plugin.cpp:53:
2025-05-08 20:48:29.424962069  Check 'false' failed at src/plugins/intel_gpu/src/plugin/program_builder.cpp:185:
2025-05-08 20:48:29.424998291  [GPU] ProgramBuilder build failed!
2025-05-08 20:48:29.425001030  Exception from src/plugins/intel_gpu/src/runtime/ocl/ocl_stream.cpp:429:
2025-05-08 20:48:29.425002586  [GPU] clWaitForEvents, error code: -14
2025-05-08 20:48:29.425003775  
2025-05-08 20:48:29.425005248  
2025-05-08 20:48:29.425006333  
2025-05-08 20:48:29.425007369  
2025-05-08 20:48:29.855867902  [INFO] Starting go2rtc healthcheck service...
2025-05-08 20:48:46.648988210  [2025-05-08 20:48:46] frigate.watchdog               INFO    : Detection appears to have stopped. Exiting Frigate...

Install method

Proxmox via Docker

Object Detector

OpenVino

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Both on the LXC container (Debian) and inside the Frigate Docker container, the vainfo command and ls /dev/dri work correctly and show the GPU. Also, intel_gpu_top shows some activity, so it looks like something is using the GPU.

[NickM-27]

I don't believe this hardware is supported by OpenVINO

[pietro1796]

https://docs.frigate.video/frigate/hardware/

in the openvino paragraph, it seems to be used

[NickM-27]

it is not officially supported. It worked at one point but the updated deps stopped supporting it #13388

[hawkeye217]

See this post from Intel: https://community.intel.com/t5/Intel-Distribution-of-OpenVINO/OpenVINO-with-Intel-Celeron-J4125/m-p/1309143

And see this similar issue: #13388

[pietro1796]

Intel post is about 4125, it's the same things for 4105?

[hawkeye217]

Sorry, I misread the Intel post. Nonetheless, the Intel packages Frigate uses don't seem to currently support it.

[ruckerzerg]

@pietro1796 have you found a solution yet?

[pietro1796]

Yes, i've change my hardware :)