Repository navigation
Answers that outgrow a shared cache together go again one at a time.
- llama.cpp with --kv-unified fails every request in flight with "Context size has been exceeded"
when their answers fill the pool together, although each fits alone; those questions now get
their retry one at a time, and only one that overflows alone scores zero as out of context - that failure no longer counts toward a server that went away; MiMo-V2.6-Distill's run stopped on
four Graphwalks prompts that failed together three sessions running