Skip to content

v0.6.4

Choose a tag to compare

@imsid imsid released this 17 Jun 07:07
b36c3f9

OSS provider hardening for parser-less and reasoning backends.

Fixes

  • Leaked / dropped tool calls: OSSCompatibleProvider now detects when a backend lacks a tool-call parser and emits the model's native tool-call syntax as plain text (no structured tool_calls) — previously a silent end_turn that dropped the call. Sets provider_metadata["tool_call_leak"] and applies on_tool_call_leak (warn default / raise / ignore). (#24)
  • Persistent provider options: new default_provider_options constructor param, shallow-merged into every request with request-level values winning — pin gateway settings (e.g. OpenRouter extra_body.provider.require_parameters) without subclassing. (#24)
  • OpenRouter reasoning field: _split_reasoning now recognizes OpenRouter's reasoning field in addition to reasoning_content, so reasoning isn't silently dropped on those routes. (#23)

Both changes keep the base provider gateway-agnostic. See the updated LLM-providers README and the oss-models docs post.