Repository navigation
Ishizuki v0.3.0 — Major speedups
Speedups over Llama.cpp
Currently, we're seeing speedups on the same models, tested with
ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF
Objectively faster by ~2x
Llama.cpp:
pp512 | 131.36 ± 0.18
tg128 | 11.65 ± 2.73
Ishizuki:
pp512 | 272 T/s
tg128 | 28 T/s
Try it with Qwen Whittle and Qwen3.8-Next!
Includes support for next-gen Qwen architectures including engrams on disk and MoE expert streaming
Full Changelog: v0.2.1...v0.3.0