Skip to content

v0.81.61

Choose a tag to compare

View all tags
@github-actions github-actions released this 11 Jul 14:42
v0.81.61
ddcfea1

Improved

  • Qwen3.5/3.6 generation speed on AMD GCN/Vega cards (continued)... the short convolution that runs in front of every Gated Delta Net layer was still executing on the CPU on wave64 cards, so each generated token crossed to the CPU and back for every one of those layers. That kernel needs no cross-thread reduction, so it now runs on the GPU with the rest of the layer. This is the piece 0.81.60 missed... the fused delta-net kernel moved to the GPU there, but the convolution beside it did not, which is why generation had not sped up on those cards. Verified numerically against the CPU reference; speed reports from GCN/Vega owners are welcome.

Full Changelog: v0.81.60...v0.81.61

Assets 5
Loading