Skip to content

hailo-ai/hailo_model_zoo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

974 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Hailo Model Zoo

docs/images/logo.png

Python 3.12 Tensorflow Cuda Hailo Dataflow Compiler HailoRT License: MIT

The Hailo Model Zoo provides pre-trained models for high-performance deep learning applications. Using the Hailo Model Zoo, you can measure the full precision accuracy of each model, the quantized accuracy using the Hailo Emulator, and measure the accuracy on Hailo's device. Finally, you will be able to generate the Hailo Executable Format (HEF) binary file to speed up development and generate high-quality applications accelerated with Hailo's technology. The Hailo Model Zoo also provides re-training instructions to train the models on custom datasets and models that were trained for specific use cases on internal datasets.

Models Hailo provides different pre-trained models in ONNX / TF formats and pre-compiled HEF (Hailo Executable Format) binary file to execute on the Hailo devices.

The models are divided to:

What's new

Core stack updates This release aligns with the latest version of the Hailo software stack, ensuring compatibility and performance improvements.

  • Upgraded to Dataflow Compiler v5.4.0
  • Upgraded to HailoRT v5.4.0

Retraining

Hailo also provides RETRAINING INSTRUCTIONS to train a network from the Hailo Model Zoo with custom dataset.

Benchmarks

List of Hailo's benchmarks can be found in hailo.ai.
In order to reproduce the measurements please refer to the following page.

Quick Start Guide

  • Install Hailo Dataflow Compiler and enter the virtualenv. In case you are not Hailo customer please contact hailo.ai

  • Install HailoRT (optional). Required only if you want to run on Hailo's. In case you are not Hailo customer please contact hailo.ai

  • Clone the Hailo Model Zoo

    git clone https://github.com/hailo-ai/hailo_model_zoo.git
    
  • Run the setup script

    cd hailo_model_zoo; pip install -e .
    
  • Run the Hailo Model Zoo. For example, print the information of the MobileNet-v1 model:

    hailomz info mobilenet_v1
    

Getting Started

For full functionality please see the INSTALLATION GUIDE page (full install instructions and usage examples). The Hailo Model Zoo is using the Hailo Dataflow Compiler for parsing, model optimization, emulation and compilation of the deep learning models. Full functionality includes:

  • Parse: model translation of the input model into Hailo's internal representation.
  • Profiler: generate profiler report of the model. The report contains information about your model and expected performance on the Hailo hardware.
  • Optimize: optimize the deep learning model for inference and generate a numeric translation of the input model into a compressed integer representation.
    For further information please see our OPTIMIZATION page.
  • Compile: run the Hailo compiler to generate the Hailo Executable Format file (HEF) which can be executed on the Hailo hardware.
  • Evaluate: infer the model using the Hailo Emulator or the Hailo hardware and produce the model accuracy.

For further information about the Hailo Dataflow Compiler please contact hailo.ai.

Claude Code Skills

The Hailo Model Zoo ships three Claude Code skills that walk you through the full DFC flow on a fresh model — auto-matching the Model Zoo's parser configs and ALLS optimization scripts when the model name is known, and falling back to interactive guidance when it is not:

  • /hailo-parse <path-to-model> [hw_arch] — parses an ONNX or TensorFlow model into a Hailo HAR, looking up start/end nodes from cfg/networks/ when available.
  • /hailo-optimize <parsed.har> [hw_arch] — applies a model script and quantizes the network, auto-loading a matching ALLS from cfg/alls/, validating calibration-set normalization, using GPU when available, and gating on the post-optimize SNR.
  • /hailo-compile <optimized.har> [hw_arch] — compiles the optimized HAR into a deployable HEF and provides triage for common compilation failures.

The skills are auto-discovered when you launch Claude Code from inside the cloned Model Zoo (they live under .claude/skills/). They use only the public hailo_sdk_client API from the DFC wheel, so the DFC remains a black box. See the DFC User Guide on the developer-zone for the full DFC reference.

License

The Hailo Model Zoo is released under the MIT license. Please see the LICENSE file for more information.

Support & Issues

⚠️ Issue reporting is disabled in this repository.

For bug reports, feature requests, or discussions, please visit our Hailo Community Forum.

Changelog

For further information please see our CHANGELOG page.


About

The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment

Topics

Resources

License

Stars

680 stars

Watchers

28 watching

Forks

Packages

 
 
 

Contributors