Repository navigation

1.6.2

github-actions released this 14 Oct 19:54

· 24 commits to master since this release

4c84273

Faster CPU offloading
Support TP models with DFlash2 drafters
Less VRAM overhead for GDN/KDA/MLA layers
ROCm fixes and faster attention on gfx11*
Other bugfixes

Full Changelog: v1.6.1...v1.6.2

Assets 67