Skip to content

0.0.85

Choose a tag to compare

@github-actions github-actions released this 17 Jul 16:07
· 230 commits to main since this release

Otoroshi LLM Extension — v0.0.85

Added

  • OpenAI-compatible tool / function calling for Anthropic providers — the
    /v1/chat/completions endpoint now fully bridges OpenAI-style tool calling to the Anthropic
    Messages API, in both non-streaming and streaming modes:
    • Request translation — tool_choice is converted from the OpenAI shape ("auto",
      "required", "none", or {"type":"function","function":{"name"}}) to the Anthropic object
      shape ({"type":"auto"|"any"|"none"|"tool"}), and tools are converted from
      {"type":"function","function":{"name","parameters"}} to Anthropic's {"name","input_schema"}.
      Payloads already in the Anthropic format are passed through untouched.
    • Response translation — Anthropic tool_use content blocks are returned as OpenAI
      tool_calls, with a finish_reason of tool_calls.
    • Multi-turn history — assistant messages carrying tool_calls and tool-role result
      messages are translated to Anthropic tool_use / tool_result content blocks, with
      consecutive tool results grouped into a single user message as Anthropic requires.
    • Streaming — tool calls are now emitted as incremental OpenAI tool_calls deltas
      (content_block_start carries the tool id/name, input_json_delta carries the argument
      fragments), and the terminal chunk reports finish_reason: "tool_calls" instead of "stop".

Fixed

  • Anthropic streaming chunk metadata — streamed chunks reported "id": "--" and
    "model": "--" (both were read from the top level of the message_start event instead of its
    nested message object) and a created timestamp of 0; all three now carry their real values.

Release Infos

  • the documentation is available here
  • release is available here

Contributors