Skip to content

b10244

Choose a tag to compare

@github-actions github-actions released this 03 Aug 22:13
67d5978

model: M3: Move MSA into a new memory implementation (#26338)

  • Move MSA logic from llama-kv-cache into llama-kv-cache-msa

  • cont : minor

  • cont : ws fix


Co-authored-by: Georgi Gerganov ggerganov@gmail.com

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: