Skip to content

b11870

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 25 Oct 02:15
74bca39

model: DSV4.1 flash (#31086)

  • model : add DeepSeek-V4.1-Flash (deepseek41)

  • deepseek41 : remove MXFP8, convert the Engram table to BF16

  • deepseek41 : compute the compressed-KV read layers once in the cache

  • deepseek41 : use get_cells() for the shared-history check, drop llama_kv_cache::seq_pos_tok_le

  • deepseek41 : gather the Engram rows in-graph like qwen4exp, drop the host gather

  • deepseek41 : keep the Engram hash constants in hparams.ple_*, one module per Engram layer

  • deepseek41 : drop the LLAMA_DSV41_KV_MIRROR toggle

  • deepseek41 : keep il last in build_hc_mixes

  • deepseek41 : sort the top-k rows before the sparse gather

  • tests : add deepseek41 to the Metal fusion baseline


Co-authored-by: Daniel Han danielhanchen@gmail.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: