lvllm-v2.3.6

guqiong96 released this 17 Jul 11:30

· 2231 commits to main since this release

0ae80a2

feat: lk_moe==2.3.0 add FP16 activation support for MOE V2
SM75 can now use GPU prefill with: --dtype="float16"

Assets 3