RPI5 with Hailo support

[DivineJimmi]

I am close to giving up. I tried everything and nothing seems to work.
I started with Docker swarm operating via portainer
then i switched to docker with portainer
then i switched to docker without any UI

No matter what i am doing, i am unable to get my Hailo working, and my frigate container is crashing every single time.

my hailo shows up when typing lspci, it also shows me a file under /dev called hailo0
So my Hailo is definitely connected and drivers are installed.

I am always getting some crazy errors in my logs. hailo_out_of_physical_devices, hailo_driver_failed, hailo_invalid_driver_version

After trying #16349 i get hailo_unsupported_fw_version
I did this: https://community.hailo.ai/t/hailo-invalid-driver-version-76/6078 and it did not work.

I changed the driver from 4.20 to 4.19 to 4.20.1 and back. Nothing seems to work. What am i doing wrong?
With the standard-configs from frigate install docs, i get hailo_invalid_driver_version

I am using docker version 28.0.1, build 068a01e on a raspberry pi 5
I am using this hailo: https://www.berrybase.de/raspberry-pi-ai-hat-13-tops-hailo-8l-accelerator

docker-compose.yml

version: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true
    restart: unless-stopped
    stop_grace_period: 30s
    image: ghcr.io/blakeblackshear/frigate:df840b7-h8l (i tried stable-h8l, 0.15.0-h8l, 0.15.0-beta7-h8l)
    shm_size: "512mb"
    devices:
      - /dev/hailo0
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /var/lib/docker/volumes/frigate/_data/config:/config
      - /var/lib/docker/volumes/frigate/_data/media/frigate:/media/frigate
    ports:
      -  "8971:8971"
      - "5000:5000" # Internal unauthenticated access. Expose carefully.
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
      - "1984:1984" #go2rtc
    environment:
      FRIGATE_RTSP_PASSWORD: "password"

This is a typical log output i am getting everytime.

2025-03-14 01:13:10.257782275  [2025-03-14 01:13:10] frigate.app                    INFO    : Capture process started for kamera_trockenfutterspender: 446
2025-03-14 01:13:10.329960978  [2025-03-14 01:13:10] frigate.api.fastapi_app        INFO    : Starting FastAPI app
2025-03-14 01:13:10.378320595  [2025-03-14 01:13:10] frigate.detectors.plugins.hailo8l INFO    : A model file already exists at /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef not downloading one.
2025-03-14 01:13:10.380580202  [HailoRT] [error] CHECK failed - Driver version (4.20.0) is different from library version (4.19.0)
2025-03-14 01:13:10.380664445  [HailoRT] [error] Driver version mismatch, status HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.380675260  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.413477369  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.413543278  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.413545519  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.413546760  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.413557723  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.413589187  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.413592261  [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INVALID_DRIVER_VERSION(76)
2025-03-14 01:13:10.416423789  Process detector:hailo8l:
2025-03-14 01:13:10.416430660  Traceback (most recent call last):
2025-03-14 01:13:10.416432049    File "/usr/local/lib/python3.9/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 3498, in _open_vdevice
2025-03-14 01:13:10.416433252      self._vdevice = _pyhailort.VDevice.create(self._params, device_ids)
2025-03-14 01:13:10.416434493  hailo_platform.pyhailort._pyhailort.HailoRTStatusException: 76
2025-03-14 01:13:10.416435141
2025-03-14 01:13:10.416436252  The above exception was the direct cause of the following exception:
2025-03-14 01:13:10.416436863
2025-03-14 01:13:10.416437715  Traceback (most recent call last):
2025-03-14 01:13:10.416438864    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2025-03-14 01:13:10.416441141      self.run()
2025-03-14 01:13:10.416442234    File "/opt/frigate/frigate/util/process.py", line 41, in run_wrapper
2025-03-14 01:13:10.416448271      return run(*args, **kwargs)
2025-03-14 01:13:10.416449382    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2025-03-14 01:13:10.416450364      self._target(*self._args, **self._kwargs)
2025-03-14 01:13:10.416451475    File "/opt/frigate/frigate/object_detection.py", line 121, in run_detector
2025-03-14 01:13:10.416453456      object_detector = LocalObjectDetector(detector_config=detector_config)
2025-03-14 01:13:10.416454531    File "/opt/frigate/frigate/object_detection.py", line 68, in __init__
2025-03-14 01:13:10.416455586      self.detect_api = create_detector(detector_config)
2025-03-14 01:13:10.416456697    File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2025-03-14 01:13:10.416457549      return api(detector_config)
2025-03-14 01:13:10.416458771    File "/opt/frigate/frigate/detectors/plugins/hailo8l.py", line 72, in __init__
2025-03-14 01:13:10.416459531      self.target = VDevice()
2025-03-14 01:13:10.416496106    File "/usr/local/lib/python3.9/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 3491, in __init__
2025-03-14 01:13:10.416497513      self._open_vdevice()
2025-03-14 01:13:10.416498846    File "/usr/local/lib/python3.9/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 3498, in _open_vdevice
2025-03-14 01:13:10.416500032      self._vdevice = _pyhailort.VDevice.create(self._params, device_ids)
2025-03-14 01:13:10.416501346    File "/usr/local/lib/python3.9/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 111, in __exit__
2025-03-14 01:13:10.416502272      self._raise_indicative_status_exception(value)
2025-03-14 01:13:10.416515254    File "/usr/local/lib/python3.9/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 156, in _raise_indicative_status_exception
2025-03-14 01:13:10.416516476      raise self.create_exception_from_status(error_code) from libhailort_exception
2025-03-14 01:13:10.416517865  hailo_platform.pyhailort.pyhailort.HailoRTException: libhailort failed with error: 76 (HAILO_INVALID_DRIVER_VERSION)
2025-03-14 01:13:10.424730462  [2025-03-14 01:13:10] frigate.detectors.plugins.hailo8l ERROR   : HailoRTException during initialization: libhailort failed with error: 76 (HAILO_INVALID_DRIVER_VERSION)
2025-03-14 01:13:10.465503163  [2025-03-14 01:13:10] frigate.api.fastapi_app        INFO    : FastAPI started

config

mqtt:
  enabled: false

detectors:
  hailo8l:
    type: hailo8l
    device: PCIe

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  model_type: ssd
  path: /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef

cameras:
  kamera_trockenfutterspender:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://192.168.20.75/ch0_1.h264
          roles:
            - detect
    detect:
      enabled: false
version: 0.15-1

As you can see, i tried to only get the bare-minimum in my config files, to get it easier to find errors.

[opentinker]

Moin!
I'm succesfully running Frigate on a Raspi 5 with a Hailo 8L (Pineboards AI bundle instead of the hat, but this should not matter) running on Portainer.

During installation, I stumbled over the same driver version mismatch issue.
The solution was to rebuild the driver via this script:
https://github.com/blakeblackshear/frigate/blob/dev/docker/hailo8l/user_installation.sh

So, no reason to give up!

[tomaae]

user_installation.sh script from dev will 4.20 which breaks frigate.
Fix for this is simple, You just need to install correct hailo version on host:
apt-get install hailo-dkms=4.19.0* hailort=4.19.0* hailort=4.19.0*
remember to reboot afterwards.

You can check version using: hailortcli fw-control identify

[nherbaut]

confirmed working, thanks