Skip to content

b12576

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 20 Nov 14:24
4783b11

llama : move the indexer key rotation choice into the model classes (#32653)

  • llama : move the indexer key rotation choice into the model classes

The KV cache forced a Hadamard rotation for the lightning indexer keys
based on a list of architectures. The virtual llama_model::indexer_k_rot()
now returns true for the same models. DeepSeek4.1 inherits from DeepSeek4
but was not in the list, so it overrides it back to false.

  • llama : rename indexer_k_rot() to lid_k_hdmd()

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: