Skip to content

1.6.6

Latest

Choose a tag to compare

@github-actions github-actions released this 31 Oct 13:06
  • Support DeepseekV41ForCausalLM
  • Support Lfm3ForCausalLM and Lfm3VlForConditionalGeneration
  • Improved loop detection
  • Greatly reduced VRAM usage during quantization
  • Faster quantization capture pass
  • Fixed disk cache eviction policy (prevent possible churn when switching between many models)
  • More optimizations, bugfixes and QoL improments

Full Changelog: v1.6.5...v1.6.6