Skip to content

1.6.7

Latest

Choose a tag to compare

@github-actions github-actions released this 13 Nov 22:35
  • Fix split-device quantization issues
  • Improved checkpointing
  • Pipelined prefill
  • Fix issues with disk tier shared across multiple instances
  • More precise expert routing and sparse attn indexing
  • Other optimizations & bugfixes

Full Changelog: v1.6.6...v1.6.7