Skip to content

b10194

Choose a tag to compare

@github-actions github-actions released this 30 Jul 15:00
e1a1abb

ggml-cuda: Allow transpose-free gemmv computation (#26171)

When matrix's weights are shaped 1xK is leverage a transpose-free
computation to use mat_mul_vec_f.

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: