Skip to content

1.6.0

Latest

Choose a tag to compare

@github-actions github-actions released this 07 Oct 17:08
151539c
  • Preliminary ROCm support (ROCm 10 only, gfx1100+)
  • Faster offloading for AVX2 CPUs
  • Smarter CPU core allocation/pinning by default
  • Reduced system memory overhead
  • Fix vision towers for GLM4, Qwen3-VL
  • Other bugfixes and optimizations

Full Changelog: v1.5.4...v1.6.0