v0.8.0 - Tool Choice Support

What's New

Tool Choice Support

Control how models use tools with the new tool_choice parameter:

• "auto" - Model decides whether to use tools (default)
• "required" - Force the model to use a tool
• "none" - Disable tool calling

Configuration

New FIRST_ITERATION_TOOL_CHOICE config option controls the first iteration behavior:

# Default: "auto" - model decides
FIRST_ITERATION_TOOL_CHOICE=auto

# Force tool use on first call
FIRST_ITERATION_TOOL_CHOICE=required

Ollama Backend Change

Switched from native /api/chat to OpenAI-compatible /v1/chat/completions endpoint:

• Enables full tool_choice support (native API didn't support this)
• Response format now matches LM Studio (standard OpenAI format)
• Both backends now use nearly identical code paths

Full Changelog

See CHANGELOG.md for details.