Skip to content

1.4.3

Choose a tag to compare

View all tags
@github-actions github-actions released this 23 Aug 23:18
· 11 commits to master since this release
v1.4.3
2398c05
  • Support GlmMoeDsaForCauslLM (GLM 5.2, still probably somewhat WIP)
  • Partial CPU layer expert offloading option with dynamic placement (supersedes expert cache)
  • Improved dynamic draft sizing with auto-calibrated confidence thresholds
  • New (experimental) quant-optimizer pipeline
  • Support for mid-stream text injection in generator (enables reasoning token budget)
  • More precise autosplit allocation
  • Reduced (and now stable) VRAM footprint for DSA prefill
  • CPU cache offloading supported in TP mode
  • Bugfixes and QoL improvements
  • Remove incomplete Nanochat implementation

Full Changelog: v1.4.2...v1.4.3

Assets 52
Loading