v0.16.3 — gemma-4-e2b crash fix + tool names constrained at sampling time
v0.16.3 — 2026-07-26
A correctness release, found by installing Krill from scratch and following our
own instructions. gemma-4-e2b — the model the install caveats tell you to
pull first — crashed on its first generation. 4-bit checkpoints ship the
per-layer projection already quantized; the loader was skipping it, so a dense
layer held a packed tensor and the first matmul trapped. Fixed, and the golden
path (brew install → krill pull gemma-4-e2b → krill run gemma-4-e2b) works
end to end again.
Also: tool names are now constrained while the model samples them. A model
trained on another harness's vocabulary used to ask for Read where Krill
offers read_file and die on its first tool call. A trigger-activated grammar
now makes an unknown tool name unrepresentable rather than something to detect
and repair — at no measurable decode cost. See
docs/TOOL_NAME_RESOLUTION.md.
Plus a quieter CLI: diagnostics go to stderr instead of corrupting krill list | …, the one-line installer no longer asks for a password it does not need, and
the pull progress bar reaches 100%.
Install
brew tap srvsngh99/krill && brew install krill # or: brew upgrade krill
curl -fsSL https://raw.githubusercontent.com/srvsngh99/Krill/main/install.sh | shApple Silicon, macOS 14+. Full detail in CHANGELOG.md.