Skip to content

v0.8.12 — a chat that outgrew the context is caught, and the cut is named

Latest

Choose a tag to compare

@LogneBudo LogneBudo released this 23 Oct 23:50

Fixed

  • A chat that outgrew the context is caught. Measured on Ollama 0.40.6 and 0.40.10: a conversation longer than the context loses its oldest messages, and the system prompt and the new message are kept. The model answers without the dropped messages and can invent what they held. Only a system prompt too long on its own loses its start, cut to about half the context. LLMxRay only knew the second case, and only at the context ceiling, so it missed both. The Live finding, Prompt X-ray and the MCP turn list now catch both and say which one happened.
  • The README and the docs no longer say the system prompt is always among what is cut.
  • A lost-cache finding keeps the space between its two sentences.

Changed

  • Verified on Ollama 0.40.10. It still under-reports memory on its llama.cpp runner, so the GPU map keeps drawing from the model file.

Update

npx llmxray@latest
docker pull djovaneli/llmxray:0.8.12