Skip to content

Releases: lithos-ai/lithos-metal

lithos-metal 0.1.2

Choose a tag to compare

@github-actions github-actions released this 05 Oct 15:25

lithos-metal now lives at https://github.com/lithos-ai/lithos-metal with a fresh, single-commit history. This release includes the latest compact prefill kernels, reusable prompt checkpoints, and incremental OpenCode tool-call streaming.

Install or upgrade:

brew install lithos-ai/tap/lithos-metal
# Existing installations:
brew update
brew upgrade lithos-ai/tap/lithos-metal

Serve a supported target with its automatically selected NVFP4 DSpark head:

lithos-metal serve --model nvidia/Qwen3.8-27B-NVFP4
lithos-metal opencode

The ARM64 archive contains the compiled runtime, kernels, chip recipes, and serving dependency wheels. Requires Apple silicon and macOS 26 or later; Homebrew supplies Python 3.12. Models download separately.

Validation: 991 local contract checks passed; the offline bundle installs and loads its native runtime outside the source checkout. See the serving guide for supported models and current limitations.