Skip to content

b9767

Choose a tag to compare

@github-actions github-actions released this 23 Jun 08:58
7c90850

ggml-webgpu: improve MTP inference by using mat-vec path for small batches (#24811)

  • ggml-webgpu: improve small batches decoding

  • Add barrier to the NUM_COLS loop in mul-mat-vec

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: