Skip to content

BaseRT engine 0.2.6

Choose a tag to compare

@prabod prabod released this 18 Sep 01:51
· 7 commits to main since this release
3b31090

BaseRT 0.2.6

Fixes garbage output from Qwen3.x 27B and 35B-A3B models on M1-family
Macs.
These models answered their first token correctly and then produced
repeated nonsense on M1, M1 Pro, M1 Max and M1 Ultra, in 0.2.4 and 0.2.5.
Other chips and models were not affected.

Changed

  • A GPU dispatch that the hardware would silently skip now stops with an
    error naming the kernel, instead of producing wrong output.