v0.7.2 — Live: see what your other tools send to Ollama
Live
LLMxRay now opens a second port, 11435, that behaves exactly like Ollama and forwards everything to it. Point any other tool at http://localhost:11435 and every turn it sends appears on the new Live page.
- Works with what you already run: VS Code Copilot (through the Ollama extension's
ollama.endpoint), Open WebUI, Continue, n8n, the Ollama CLI and SDKs, any script. The page's empty state is the setup: one address to copy and the steps for each tool. - Turn by turn: client, model, prompt tokens, how many came from the cache, prefill and generation speed, tool calls.
- Inside a turn: what the prompt is made of (system, tool schemas, history, your message) and the exact point where it stopped matching the previous turn, which is where the cache broke.
- Findings in plain sentences, each linked to the turn that proves it: a prompt larger than the context the model was loaded with, a model running partly on CPU, a client re-reading most of its prompt every turn, tool schemas that dominate the prompt.
- Per client: turns, tokens, tool calls, prefill time, and an estimate of what a cache fix would save.
Only counts and timings are kept, in memory. Prompt text is an opt-in that writes to a file under your home directory. Nothing leaves your machine.
Verified on a real Copilot agent session: 108 tool schemas, 46K-token prompts, 99% served from cache once the context was raised to 64K.
CLI: --observe-port <n>, --no-observe. Docker: -p 11435:11435, OBSERVE_PORT, OBSERVE=0.
npx llmxray@0.7.2
docker pull djovaneli/llmxray:0.7.2Guide: https://lognebudo.github.io/llmxray/docs/en/guide/live