Skip to content

v0.12.4 – errors in the middle of a stream count as errors (router 0.6.4)

Choose a tag to compare

@psewar psewar released this 02 Oct 06:03
· 6 commits to main since this release

Router 0.6.4, agent unchanged (0.16.0). Errors in the middle of a stream now count as errors.

  • What went wrong: when a model writes a tool call with broken XML, Ollama ends the streamed answer with an error line (seen: {"error":"XML syntax error on line 3: unexpected EOF"}) and drops the whole answer. The router passed that line on and counted the request as ok, so these failures were invisible in metrics and logs.
  • Now: the request counts as outcome error, the router logs Ollama's message and adds a stream_error entry to the decision log. Ollama clients still get Ollama's line verbatim; Anthropic clients get an error event, OpenAI clients an error object followed by [DONE].
  • The node's circuit breaker does not count it: the node works, the model's output was broken.
Deutsch

Router 0.6.4. Bricht Ollama eine Antwort mitten im Stream mit einer Fehlerzeile ab (z. B. kaputtes Werkzeug-XML), zählt die Anfrage jetzt als Fehler, steht im Log und im Entscheidungsprotokoll (stream_error), und Anthropic- bzw. OpenAI-Clients bekommen ein Fehlerereignis in ihrer Form. Der Breaker des Knotens zählt es nicht.