Skip to content

b10988

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 15 Sep 18:50
9f31776

opencl: choose the MoE expert matmul by batch size for speculative decoding/MTP (#27637)

  • opencl: gate the prebuilt q4_0 MoE GEMM on routing count

  • opencl: stop writing zeros into the padded MoE activation slots

  • opencl: rephrase claude's comments


Co-authored-by: Li He lih@qti.qualcomm.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: