Skip to content

v0.1.13-update.3

Choose a tag to compare

View all tags
@asdek asdek released this 13 May 18:42
v0.1.13-update.3
ae63c5a
This commit was signed with the committer’s verified signature.
asdek Dmitry Ng
GPG key ID: 955A172DFDB77CC3
Verified
Learn about vigilant mode.

Highlights

  • Better Reasoning: Improved step-by-step thinking support in AI models, including models through OpenRouter
  • Stream Done Signal: Streaming API now clearly tells you when a response is finished

Major Improvements

Reasoning Capabilities

  • Access to AI Thinking Process: Access the reasoning content (step-by-step thinking) from models that support this feature
  • Cross-Provider Support: Works with multiple AI providers including OpenAI, Anthropic, and models available through OpenRouter
  • Flexible Configuration: Use either a simple effort level or specific token budget to control reasoning behavior
  • Multiple Format Support: Compatible with both modern and legacy reasoning formats across different providers

Streaming Enhancements

  • Reliable Resource Management: New ChunkTypeDone notification ensures your application knows exactly when a stream is complete, allowing for predictable resource release
  • Simplified Error Handling: No more need for timeout workarounds or complex stream completion detection logic

Technical Details

  • Added ReasoningOptions type with Effort and MaxTokens parameters
  • Extended necessary structures to support reasoning fields reasoning_content and reasoning
  • Implemented ChunkTypeDone for reliable stream completion notification in all LLM implementations

Contributors

Full Changelog: v0.1.13-update.2...v0.1.13-update.3

Contributors

asdek
Assets 2
Loading