Skip to content

1.5.4

Choose a tag to compare

@github-actions github-actions released this 03 Oct 15:05
· 45 commits to master since this release
  • Options for token-embedding quantization and disk streaming
  • Improved quantization accuracy
  • Update HF Transformers integration module to Transformers 5, add backprop for wrapped EXL3 layers
  • Faster model loading
  • Performance improvements
  • Reduced system memory and VRAM overhead
  • Fixes for MiMo-V2.6
  • Lots and lots of (latent) bugfixes

Full Changelog: v1.5.3...v1.5.4