Skip to content

Ishizuki v0.3.0 — Major speedups

Choose a tag to compare

@struffl struffl released this 23 Sep 11:05
· 54 commits to main since this release

Speedups over Llama.cpp

Currently, we're seeing speedups on the same models, tested with
ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF

Objectively faster by ~2x

Llama.cpp:

pp512 |        131.36 ± 0.18
tg128 |         11.65 ± 2.73

Ishizuki:

pp512 | 272 T/s
tg128 | 28 T/s

Try it with Qwen Whittle and Qwen3.8-Next!

Includes support for next-gen Qwen architectures including engrams on disk and MoE expert streaming

Full Changelog: v0.2.1...v0.3.0