Repository navigation
ishizuki v0.1.7
Native macOS inference engine for Ternary Bonsai 2 27B on MLX Swift.
Install
Installer — ishizuki-v0.1.7.pkg, signed and notarized, installs to ~/.local, no admin
password.
Loose binary — ishizuki-v0.1.7-macos-arm64.tar.gz: the executable and the metallib it
loads, together.
Since v0.1.6
MLX failures no longer take the server down. array::shape(int) is bounds-checked through
std::vector::at, so an out-of-range dimension anywhere inside MLX surfaces as
out_of_range("vector") during eval — which MLX Swift turns into fatalError, killing the
process for one request. Generation now runs inside withError, so that becomes a Swift throw;
the error box is composed into the existing cancellation hook, so the loop stops at the next
step instead of running on over a poisoned graph. A failure after the response is committed
closes the stream rather than writing a second status line, and an MLX fault reports 500 instead
of blaming the caller with a 400.
This contains the reported Fatal error: vector crash — a run that hits it now fails that
one request and keeps serving. It does not identify the out-of-range access itself, which
remains unreproduced: a 64871-token thinking request with the reporting flags, a quantized-KV
stress at 4096 context, and unit tests asserting the quantized cache's window/store invariants
across reallocations all completed clean.