Raspi 5 + hailo performance?

[hohaha045]

Anyone using raspi5 w/ hailo 8 or 8L?
Would like to see the performance compared to my current setup minipc + coral TPU.
I am thinking about making the firgate standalone, separate from HA

[inkeep-ai-assistant[bot]]

Based on the available sources, both Hailo-8 and Hailo-8L are supported on Raspberry Pi 5(1)(2)(3). The Hailo-8 and Hailo-8L AI accelerators are available in M.2 and HAT form factors for the Raspberry Pi, with the HAT version mounting directly onto compatible Raspberry Pi models(1).

Performance Metrics

For Hailo inference times(2):

Hailo-8:

• SSD MobileNet v1: ~6 ms
• YOLOv6n: ~7 ms

Hailo-8L:

• SSD MobileNet v1: ~10 ms
• YOLOv6n: ~11 ms
• YOLOv9-tiny (320): 18 ms

For comparison, the Coral TPU shows(2):

• MobileNetV2: varies by model but typically in the 10-15 ms range

Community Experience

Community members have successfully deployed Frigate on Raspberry Pi 5 with Hailo(4)(5). One user reported running Frigate on a Raspberry Pi 5 with a Hailo 8L using Portainer(4).

Important Setup Notes

You must follow specific installation steps for Raspberry Pi(1):

1. Disable the built-in Hailo driver (Raspberry Pi only) by blacklisting it
2. Run the installation script to install the correct driver version
3. Reboot your system
4. Verify the installation

The Hailo detector automatically selects the default model based on your hardware - YOLOv6n for both Hailo-8 and Hailo-8L(3).

**

📚 Sources:

1. Installation
2. Recommended hardware
3. Supported Hardware
4. RPI5 with Hailo support
5. Performance compare between my setup and the rpi5 with AI hat

---

Have another question? Just tag @inkeep.

[hohaha045]

The Hailo team has not yet contributed code for the Hailo-10. You may be better off asking them on their support forums directly: https://community.hailo.ai/t/hailo-official-integration-with-frigate/13679

I know, I am using playing w/ the AI lol.
Any chance you know using hailo + respi5 would be better? or a mini-pc would be more suitable if I need some transcoding.

[hawkeye217]

A mini PC with an iGPU would definitely be an improvement. An iGPU is probably the most versatile piece of hardware right now available for Frigate as it can do object detection, accelerated video decoding, and accelerated Frigate enrichments (semantic search, face recognition, LPR).

[hohaha045]

A mini PC with an iGPU would definitely be an improvement. An iGPU is probably the most versatile piece of hardware right now available for Frigate as it can do object detection, accelerated video decoding, and accelerated Frigate enrichments (semantic search, face recognition, LPR).

Is the hailo8 could be use the same way as coral edge tpu? (i am pretty sure it can, it just whenever i search hailo8 the results come with raspi). I assume i only have to install some driver maybe?

[NickM-27]

Yes, it can be used in the same way, there are driver install instructions in the docs

[hawkeye217]

https://docs.frigate.video/frigate/installation#hailo-8