Skip to content

1.6.4

Latest

Choose a tag to compare

@guitaripod guitaripod released this 24 Sep 15:02
· 1 commit to master since this release

Answers that outgrow a shared cache together go again one at a time.

  • llama.cpp with --kv-unified fails every request in flight with "Context size has been exceeded"
    when their answers fill the pool together, although each fits alone; those questions now get
    their retry one at a time, and only one that overflows alone scores zero as out of context
  • that failure no longer counts toward a server that went away; MiMo-V2.6-Distill's run stopped on
    four Graphwalks prompts that failed together three sessions running