[Detector Support]: Frigate+ YOLOv9 2025.2 model not working with openvino detector

[aartrost]

Describe the problem you are having

I've been running yolonas openVino Frigate+ models on my 12th gen i3-12100 without issue for the last 6 months or so. I've generated the latest yolov9s but it seems to be unusable on my setup. All options are grayed out:

and manually setting the yolov9s model ID results in the detector crashing with a [GPU] Mismatch tensor and port type: f32 vs u8 error.

Is there anything wrong with this config on my end or is should this work out of the box? Thanks!

Version

0.16.1

Frigate config file

detectors:
  ov:
    type: openvino
    device: GPU

# works
model:
  path: plus://d34251945733ff27381c2c0b8dab02ec
  width: 320
  height: 320


# yolov9s does not work
# model:
#   path: plus://2dd496218ba3ffe168cce64f9600f279
#   width: 320
#   height: 320

docker-compose file or Docker CLI command

docker run
  -d
  --name='frigate'
  --net='bridge'
  --pids-limit 2048
  --privileged=true
  -e TZ="America/Los_Angeles"
  -e HOST_OS="Unraid"
  -e HOST_HOSTNAME="NAS"
  -e HOST_CONTAINERNAME="frigate"
  -e 'FRIGATE_RTSP_PASSWORD'='enterpassword'
  -e 'PLUS_API_KEY'=''
  -e 'LIBVA_DRIVER_NAME'='iHD'
  -l net.unraid.docker.managed=dockerman
  -l net.unraid.docker.webui='http://[IP]:[PORT:5000]'
  -l net.unraid.docker.icon='https://raw.githubusercontent.com/yayitazale/unraid-templates/main/frigate.png'
  -p '5000:5000/tcp'
  -p '8554:8554/tcp'
  -p '8555:8555/tcp'
  -p '8555:8555/udp'
  -p '1984:1984/tcp'
  -p '1935:1935/tcp'
  -p '8971:8971/tcp'
  -v '/mnt/user/appdata/frigate':'/config':'rw'
  -v '/mnt/user/surveillance/frigate/':'/media/frigate':'rw'
  -v '/etc/localtime':'/etc/localtime':'rw'
  --device='/dev/bus/usb'
  --device='/dev/dri/renderD128'
  --shm-size=768mb
  --mount type=tmpfs,target=/tmp/cache,tmpfs-size=1000000000
  --restart unless-stopped 'ghcr.io/blakeblackshear/frigate:0.16.1'

Relevant Frigate log output

2025-09-07 12:27:48.966251723  [INFO] Preparing Frigate...
2025-09-07 12:27:49.355824133  [INFO] Starting Frigate...
2025-09-07 12:27:52.628934893  [2025-09-07 12:27:52] frigate.util.config            INFO    : Checking if frigate config needs migration...
2025-09-07 12:27:52.653941586  [2025-09-07 12:27:52] frigate.util.config            INFO    : frigate config does not need migration...
2025-09-07 12:28:06.794225339  [2025-09-07 12:28:06] frigate.app                    INFO    : Starting Frigate (0.17.0-6505ae5)
2025-09-07 12:28:06.869870745  [2025-09-07 12:28:06] peewee_migrate.logs            INFO    : Starting migrations
2025-09-07 12:28:06.870625124  [2025-09-07 12:28:06] peewee_migrate.logs            INFO    : There is nothing to migrate
2025-09-07 12:28:06.907725536  [2025-09-07 12:28:06] frigate.app                    INFO    : Recording process started: 772
2025-09-07 12:28:06.929986609  [2025-09-07 12:28:06] frigate.app                    INFO    : Review process started: 785
2025-09-07 12:28:06.931756646  [2025-09-07 12:28:06] frigate.app                    INFO    : go2rtc process pid: 128
2025-09-07 12:28:07.229454793  [2025-09-07 12:28:07] frigate.app                    INFO    : Embedding process started: 795
2025-09-07 12:28:07.314778100  [2025-09-07 12:28:07] frigate.app                    INFO    : Output process started: 855
2025-09-07 12:28:07.530457495  INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
2025-09-07 12:28:07.634428630  [2025-09-07 12:28:07] frigate.audio_manager          INFO    : Audio processor started (pid: 880)
2025-09-07 12:28:08.190584859  [2025-09-07 12:28:08] frigate.api.fastapi_app        INFO    : Starting FastAPI app
2025-09-07 12:28:08.356962060  [2025-09-07 12:28:08] frigate.api.fastapi_app        INFO    : FastAPI started
2025-09-07 12:28:08.422125887  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Camera processor started for doorbell: 1019
2025-09-07 12:28:08.442721462  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Capture process started for doorbell: 1076
2025-09-07 12:28:08.513829563  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Camera processor started for driveway: 1141
2025-09-07 12:28:08.541168201  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Capture process started for driveway: 1191
2025-09-07 12:28:08.561188860  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Camera processor started for stairway: 1260
2025-09-07 12:28:08.581454162  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Capture process started for stairway: 1317
2025-09-07 12:28:08.602686935  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Camera processor started for rooftop: 1381
2025-09-07 12:28:08.621343918  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Capture process started for rooftop: 1438
2025-09-07 12:28:08.653543976  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Camera processor started for livingroom: 1502
2025-09-07 12:28:08.685064123  [2025-09-07 12:28:08] frigate.camera.maintainer      INFO    : Capture process started for livingroom: 1559
2025-09-07 12:28:10.160051920  Process frigate.detector:ov:
2025-09-07 12:28:10.160057781  Traceback (most recent call last):
2025-09-07 12:28:10.160059450    File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
2025-09-07 12:28:10.160065317      self.run()
2025-09-07 12:28:10.160068226    File "/opt/frigate/frigate/object_detection/base.py", line 164, in run
2025-09-07 12:28:10.160069612      detections = object_detector.detect_raw(input_frame)
2025-09-07 12:28:10.160088972                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-09-07 12:28:10.160090862    File "/opt/frigate/frigate/object_detection/base.py", line 95, in detect_raw
2025-09-07 12:28:10.160092584      return self.detect_api.detect_raw(tensor_input=tensor_input)
2025-09-07 12:28:10.160094170             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-09-07 12:28:10.160095803    File "/opt/frigate/frigate/detectors/plugins/openvino.py", line 150, in detect_raw
2025-09-07 12:28:10.160111839      infer_request.infer(input_tensor)
2025-09-07 12:28:10.160113640    File "/usr/local/lib/python3.11/dist-packages/openvino/_ov_api.py", line 197, in infer
2025-09-07 12:28:10.160115511      return OVDict(super().infer(_data_dispatch(
2025-09-07 12:28:10.160116597                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-09-07 12:28:10.160126750  RuntimeError: Exception from src/inference/src/cpp/infer_request.cpp:116:
2025-09-07 12:28:10.160128103  Exception from src/inference/src/cpp/infer_request.cpp:66:
2025-09-07 12:28:10.160175576  Check 'port.get_element_type() == tensor->get_element_type()' failed at src/plugins/intel_gpu/src/plugin/sync_infer_request.cpp:131:
2025-09-07 12:28:10.160177181  [GPU] Mismatch tensor and port type: f32 vs u8
2025-09-07 12:28:33.002294  2025-09-07 12:28:10.160178411
2025-09-07 12:28:33.002332  2025-09-07 12:28:10.160179457
2025-09-07 12:28:33.002341  2025-09-07 12:28:10.160180300
2025-09-07 12:28:28.170118387  [2025-09-07 12:28:28] frigate.watchdog               INFO    : Detection appears to be stuck. Restarting detection process...
2025-09-07 12:28:29.055319721  Process frigate.detector:ov:
2025-09-07 12:28:29.055322781  Traceback (most recent call last):
2025-09-07 12:28:29.055324039    File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
2025-09-07 12:28:29.055324823      self.run()
2025-09-07 12:28:29.055325656    File "/opt/frigate/frigate/object_detection/base.py", line 164, in run
2025-09-07 12:28:29.055326444      detections = object_detector.detect_raw(input_frame)
2025-09-07 12:28:29.055327367                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-09-07 12:28:29.055328268    File "/opt/frigate/frigate/object_detection/base.py", line 95, in detect_raw
2025-09-07 12:28:29.055329094      return self.detect_api.detect_raw(tensor_input=tensor_input)
2025-09-07 12:28:29.055329908             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-09-07 12:28:29.055330750    File "/opt/frigate/frigate/detectors/plugins/openvino.py", line 150, in detect_raw
2025-09-07 12:28:29.055331484      infer_request.infer(input_tensor)
2025-09-07 12:28:29.055332346    File "/usr/local/lib/python3.11/dist-packages/openvino/_ov_api.py", line 197, in infer
2025-09-07 12:28:29.055333282      return OVDict(super().infer(_data_dispatch(
2025-09-07 12:28:29.055334166                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-09-07 12:28:29.055335239  RuntimeError: Exception from src/inference/src/cpp/infer_request.cpp:116:
2025-09-07 12:28:29.055336148  Exception from src/inference/src/cpp/infer_request.cpp:66:
2025-09-07 12:28:29.055337298  Check 'port.get_element_type() == tensor->get_element_type()' failed at src/plugins/intel_gpu/src/plugin/sync_infer_request.cpp:131:
2025-09-07 12:28:29.055338264  [GPU] Mismatch tensor and port type: f32 vs u8

Install method

Docker CLI

Object Detector

OpenVino

Screenshots of the Frigate UI's System metrics pages

n/a

Any other information that may be helpful

No response

[NickM-27]

2025-09-07 12:28:06.794225339 [2025-09-07 12:28:06] frigate.app INFO : Starting Frigate (0.17.0-6505ae5)

looks like you are running a version of 0.17 from before the model config was updated to support this

[aartrost]

Ooof, my bad. I was running a nightly build and during the bug report info gathering I switched over to the official 0.16.1 build but neglected to re-test! It's working OK now

[jeeftor]

I think I'm seeing the same issue with 16.1.

[hawkeye217]

No, this is a different issue, and not being able to select the models there is only a frontend issue. You can pull the latest master build for the simple fix (ghcr.io/blakeblackshear/frigate:751de14), or you can just cut and paste the model ID into your config manually.

[jeeftor]

I had to manually set the model ID in the config - and it seems to have worked.