Skip to content

v0.1.7

Choose a tag to compare

@provos provos released this 06 Feb 18:46
· 41 commits to main since this release

Release Notes for LLM Interface v0.1.7

Overview

This minor release improves the resilience of the LLM interface and adds better model detection mechanisms.

Features

  • Structured Output Capability: Improved the matching of structured output capabilities of models based on their names and versions.
  • Thinking Process Integration: Introduced a requires_thinking attribute to the LLMInterface class, allowing models like Deepseek-R1 to document their 'thinking' process which is required when using Ollama with structured outputs.

Improvements

  • Error Handling: Error handling in the LLMInterface class when response caching fails.
  • Test Suite Reliability: Regression tests for structured output generation forces llm_client to use structured outputs.