Repository navigation
Tempo9 v1.1.2
Engine 3.0.0-rc3 (C ABI 3.0).
- Metal tensor units are back on. They had been off in every build since 2026-09-23, including 1.1.1. Prefill is faster on M5-class GPUs. q8_0 and RMSNorm prefill staging is cheaper, and q8_0 decode at batch 9–16 uses a small-M tensor tile.
- Gemma 4 E-series: prefill computes the 18 KV-shared layers on the last token only, and Gemma 4 now gets the prefix cache.
- Tool calls: a past tool call's arguments string is decoded before the chat template renders it. Gemma 4 tool calls no longer leak into the message content, and generation stops at
<eos>. - Tokenizer: special tokens are split in one byte-level pass, about 15× faster on agent prompts.
Install: brew install thinkspread/tap/tempo9, curl -fsSL https://raw.githubusercontent.com/thinkspread/tempo9/main/install.sh | bash, or SwiftPM .package(url: "https://github.com/thinkspread/tempo9", from: "1.1.2").
The CLI is signed and notarized (Developer ID).