Skip to content

1.4.4

Latest

Choose a tag to compare

@github-actions github-actions released this 26 Aug 13:58
· 1 commit to master since this release
  • Fix correctness bug in split MoE CPU-offload mode
  • Better MTP support in expert-parallel mode
  • Validate and default to vision tower quantization
  • Support vision model offloading (streams from system memory, performance penalty is small)

Full Changelog: v1.4.3...v1.4.4