Skip to content

Tempo9 v1.1.3

Choose a tag to compare

View all tags
@kzjeef kzjeef released this 04 Oct 05:05
v1.1.3
23a8894

One command from an empty Mac to a running server:

brew install thinkspread/tap/tempo9
tempo9 --hf unsloth/Qwen3.5-9B-GGUF:Q4_K_S

--hf owner/repo[:quant] downloads a GGUF into the standard Hugging Face cache, so a copy that huggingface_hub or llama.cpp already pulled is reused. Downloads resume after an interruption and are checked against their sha256. With no quant given, it picks Q4_K_S.

Claude Code reuses its prompt cache.

  • The server forwards Anthropic cache_control breakpoints to the engine, and pins the points in the tool list where Claude Code's prompt changes between turns.
  • The new engine keeps recurrent-state snapshots for hybrid models such as Qwen3.5, so a request whose tool list changed can resume from cache instead of starting over.
  • On Qwen3.5-9B (M5 Pro), a one-question Claude Code session goes from about 98 s to about 63 s, and a later session on the same server takes 10–23 s.
  • manual/claude-code.md breaks down what a session costs and compares Qwen3.5-9B with Gemma-4-E4B.

Docs. The README now carries the 2026-10 benchmark against vllm-metal, omlx and llama.cpp; the full write-up is docs/benchmark-2026-10-m5pro.md.

The CLI is signed and notarized (Developer ID).

Assets 4
Loading