Skip to content

b9664

Choose a tag to compare

@github-actions github-actions released this 16 Jun 08:09
ac79caa

sycl: support reordered Q4_K/Q5_K/Q6_K MoE MUL_MAT_ID (#24452)

  • sycl: support reordered Q4_K and Q5_K MoE MUL_MAT_ID

Extend reordered-weight handling to fused MoE MUL_MAT_ID for Q4_K and Q5_K expert tensors and add Q5_K reordered DMMV coverage. Unsupported 3D reorder cases now fall back instead of aborting.

  • sycl: extend MoE reorder to Q6_K mul_mat_id

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: