Skip to content

ishizuki v0.2.0

Choose a tag to compare

@struffl struffl released this 18 Sep 15:27
· 210 commits to main since this release

Native macOS inference engine for Ternary Bonsai 2 27B on MLX Swift.

Install

Installer — ishizuki-v0.2.0.pkg, signed and notarized, installs to ~/.local, no admin
password.

Loose binary — ishizuki-v0.2.0-macos-arm64.tar.gz: the executable and the metallib it
loads, together.

Already on v0.1.7? ishizuki update takes it from here.

Since v0.1.7

  • ishizuki chat — the engine in one verb. Loads a pack and talks, with the thinking block
    in a muted inset box, prefill and decode rates under every reply, and the session cache kept
    warm so each turn only prefills what changed. /think changes reasoning effort mid-thread;
    /new, /system and /stats do what they say. The header grows a procedural bonsai over its
    stone, sized to the terminal.

  • ishizuki update — self-update in place. Fetches the release tarball for this machine's
    architecture and swaps the running executable and the metallib beside it, wherever ishizuki was
    installed from. Nothing is written until the download's sha256 matches the digest GitHub
    publishes and the new executable satisfies a Developer ID requirement naming the team that
    signed the binary it replaces. Each file is renamed aside and the new one renamed in, so a
    running server keeps the inode it already opened and a half-finished swap rolls back.

  • Memory is planned from demand, not from the machine. A cold server used to claim a pool of
    up to 8 GB and six prefix caches sized for full 262K context — about 41 GB on a 64 GB Mac,
    before a single request arrived. It now starts at one 8K slot and a 0.5 GB pool and doubles a
    tier whenever the work runs into it, stopping at what the wired ceiling holds. Weights are
    measured from the pack instead of guessed at 9 GB, and the dashboard carries the live tier,
    the peak, and bars for memory and GPU utilization. The tradeoff is a slower warm-up.

  • The older ternary packs load and run. Ternary-Bonsai 8B, 4B and 1.7B ship as plain Qwen3
    MLX packs — standard config, scale-only 2-bit affine weights, no Hadamard rotation. Point
    --repo at one and it runs, honouring the pack's own YaRN. A real Hadamard pack missing a
    module record still fails loud.

  • Agents launched from ishizuki launch can paint. Foundation spawns children into their own
    process group, so pi, claude and hermes each stopped on SIGTTIN/SIGTTOU at the first raw-mode
    tty access and never drew. The foreground process group is handed over for the life of the
    tool and taken back afterwards.