1.4.0

github-actions released this 06 Aug 20:51

· 17 commits to master since this release

791c830

Support DeepseekV4ForCausalLM
Improved AVX512 CPU offload performance
Faster prefill (all models)
Bugfixes
QoL features

Full Changelog: v1.3.0...v1.4.0

Assets 52