Repository navigation
ishizuki v0.2.0
Native macOS inference engine for Ternary Bonsai 2 27B on MLX Swift.
Install
Installer — ishizuki-v0.2.0.pkg, signed and notarized, installs to ~/.local, no admin
password.
Loose binary — ishizuki-v0.2.0-macos-arm64.tar.gz: the executable and the metallib it
loads, together.
Already on v0.1.7? ishizuki update takes it from here.
Since v0.1.7
-
ishizuki chat— the engine in one verb. Loads a pack and talks, with the thinking block
in a muted inset box, prefill and decode rates under every reply, and the session cache kept
warm so each turn only prefills what changed./thinkchanges reasoning effort mid-thread;
/new,/systemand/statsdo what they say. The header grows a procedural bonsai over its
stone, sized to the terminal. -
ishizuki update— self-update in place. Fetches the release tarball for this machine's
architecture and swaps the running executable and the metallib beside it, wherever ishizuki was
installed from. Nothing is written until the download's sha256 matches the digest GitHub
publishes and the new executable satisfies a Developer ID requirement naming the team that
signed the binary it replaces. Each file is renamed aside and the new one renamed in, so a
running server keeps the inode it already opened and a half-finished swap rolls back. -
Memory is planned from demand, not from the machine. A cold server used to claim a pool of
up to 8 GB and six prefix caches sized for full 262K context — about 41 GB on a 64 GB Mac,
before a single request arrived. It now starts at one 8K slot and a 0.5 GB pool and doubles a
tier whenever the work runs into it, stopping at what the wired ceiling holds. Weights are
measured from the pack instead of guessed at 9 GB, and the dashboard carries the live tier,
the peak, and bars for memory and GPU utilization. The tradeoff is a slower warm-up. -
The older ternary packs load and run. Ternary-Bonsai 8B, 4B and 1.7B ship as plain Qwen3
MLX packs — standard config, scale-only 2-bit affine weights, no Hadamard rotation. Point
--repoat one and it runs, honouring the pack's own YaRN. A real Hadamard pack missing a
module record still fails loud. -
Agents launched from
ishizuki launchcan paint. Foundation spawns children into their own
process group, so pi, claude and hermes each stopped on SIGTTIN/SIGTTOU at the first raw-mode
tty access and never drew. The foreground process group is handed over for the life of the
tool and taken back afterwards.