Tempo9 v1.1.1

Tempo9 1.1.1 is a bug-fix release. It ships a new engine with two correctness fixes; if you use 1.0.0 or 1.1.0, upgrade.

Requirements: unchanged. You need a Mac with Apple Silicon and macOS 26 or later. GPU (Metal) acceleration currently needs an M5 or later; earlier chips run on the CPU.

Fixes

• BF16 / F16 models produced garbage. Loading a model whose weights are all BF16 or F16 (for example Qwen3-0.6B-BF16.gguf) assembled every fused QKV weight wrong: 2-byte elements were copied into a buffer laid out for 4-byte ones. Output was unreadable for full-attention models and never stopped for hybrid ones. Quantized models (Q4_K, Q8_0, …) were not affected.
• About 3–4% of responses were garbled under concurrent load on Metal. When several requests shared a long prompt prefix and decoded together, a one-step-lag decode pipeline let a host/GPU race corrupt some outputs. The pipeline is now off by default: 0 bad answers in 400 shared-prefix requests at 8 in flight, against 14–15 with it on. Single-stream decode is 1.3–2.1% slower; concurrent decode is not slower.
• The server no longer turns text into tool calls when the request declared no tools. A model writing <tool_call> in a plain chat request used to get an empty reply with finish_reason: "tool_calls". Now the text is returned as text; requests that do declare tools behave as before.

The engine's C header gains te9_gemm_backend_reason() (engine API 1.5), which says why the engine fell back to the CPU. It is additive; nothing in the Swift API changed.

Install or upgrade the tempo9 server

brew upgrade tempo9        # or: brew install thinkspread/tap/tempo9

or

curl -fsSL https://raw.githubusercontent.com/thinkspread/tempo9/main/install.sh | bash

Use the engine in-process (Swift)

.package(url: "https://github.com/thinkspread/tempo9", from: "1.1.1")

A package already on from: "1.1.0" picks up 1.1.1 with swift package update. Package.swift now points at this release's Tempo9Engine.xcframework.zip.

Licence

The licences have not changed. The engine is under the Tempo9 Engine License 0.1 (ENGINE-LICENSE), and the source in this repository is under Apache-2.0.

Assets

File	SHA-256 / SwiftPM checksum
tempo9-1.1.1-macos-arm64.tar.gz	35def0f05f7ea4c9710857aa81b888bfd1b767d63f782200dafdfcd2ef855cca
Tempo9Engine.xcframework.zip	c7a654c031b91792009eea4ecdda6ce078fd2a5f6c7a3fc1eaf66b7760d2a407