Skip to content

v1.28.0 - hybrid linear-attention priced correctly, Qwen3.8 in the atlas, Linux CI

Choose a tag to compare

@FedericoTs FedericoTs released this 16 Aug 10:44
· 81 commits to master since this release

The planner now prices hybrid linear-attention models correctly - two days after the class shipped.

Qwen3.8-27B landed 2026-08-14 with 48 of its 64 layers as linear attention; every prior model this tool had met was full-attention throughout.

  • KV priced on full-attention layers only (U-51, staked as prereg #101 P-5 before measuring). The old formula assumed every layer caches K+V with position - a measured 4x over-estimate on the hybrid (260 KB/pos read, ~64 real). The count now comes from the file: a block carrying an attn_k projection caches K+V. Full-attention models byte-identical (regression-pinned); hybrids print KV 68 KB/pos (hybrid: 17 of 65 layers cache KV).
  • Recipes atlas: Qwen3.8-27B added - the first measured depth-aware band published for it, probed launch-day+1 (fragile band 51-64, back-fragile).
  • Linux end-to-end CI - a GPU-less ubuntu runner asserts calibrate exits cleanly with no GPU (the exact issue #2 failure class), then runs a real llama-bench and plan --gguf. Green on first run. AMD/Vulkan detection lands as v1.28.1 with the contributed patch.
  • The receipt: predicted 1.80 tok/s for Qwen3.8-27B on a 2016 GTX 1060 before the model generated a token; measured 2.04 +/- 0.02. Both logs committed.
  • Also since 1.27: the quant-quality campaign page (docs/QUANT_QUALITY.md) and prereg #102's honest negative (effective rank does NOT predict the fragile band - the probe stays).

pip install -U quantprobe

🤖 Generated with Claude Code