Skip to content

v0.8.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 01 Apr 03:53
· 2311 commits to main since this release
v0.8.0
3036d8e

What's Changed

Features

  • High-performance LLM inference engine
  • Support for Qwen3 models (8B/4B variants)
  • Native embeddings and reranking
  • CUDA support for NVIDIA GPUs
  • Metal support for Apple Silicon
  • Flash Attention v3 support

Installation

# Download for your platform
curl -L https://github.com/hanzoai/engine/releases/latest/download/hanzoai-$(uname -s | tr "[:upper:]" "[:lower:]")-$(uname -m).tar.gz | tar -xz
sudo mv hanzo-engine /usr/local/bin/hanzoai
Assets 6
Loading