Repository navigation
BaseRT engine 0.2.6
BaseRT 0.2.6
Fixes garbage output from Qwen3.x 27B and 35B-A3B models on M1-family
Macs. These models answered their first token correctly and then produced
repeated nonsense on M1, M1 Pro, M1 Max and M1 Ultra, in 0.2.4 and 0.2.5.
Other chips and models were not affected.
Changed
- A GPU dispatch that the hardware would silently skip now stops with an
error naming the kernel, instead of producing wrong output.