Skip to content

v0.1.1-pre

Pre-release
Pre-release

Choose a tag to compare

@rifkybujana rifkybujana released this 13 Oct 22:35
· 56 commits to main since this release
25fd531

Release Notes

Version 0.1.1 - Enhanced Tool Call Support & Stability Improvements

Major New Features

XML-Style Tool Call Parser

A groundbreaking addition that enables seamless tool call support across a wide range of AI models and inference engines, including those that don't natively support structured tool calling.

Key Benefits:

  • Universal Compatibility: Works with local AI models and inference engines that lack native tool call support
  • Seamless Integration: Automatically detects and parses XML-style tool call markers in model responses
  • Future-Proof Architecture: Enables support for emerging models and custom inference implementations
  • Zero Configuration: Works out of the box with OpenAI-compatible APIs

Technical Details:

  • Supports both standard OpenAI JSON-style tool calls and XML-style tool call markers
  • Intelligent streaming parser handles cross-chunk tool call boundaries
  • Robust error handling with graceful fallback to text-only responses
  • Prevents tool call marker leakage in text output

Impact:
This feature dramatically expands the ecosystem of AI models compatible with Kolosal CLI, making it possible to use local models, custom inference engines, and emerging AI providers that previously couldn't support tool calling capabilities. This is a major step toward true vendor independence and flexibility in AI model selection.

Technical Improvements

Enhanced Tool Call ID Management

  • Implemented deterministic tool call ID remapping system
  • Prevents ID collisions when converting from Gemini format to OpenAI format
  • Proper ID pairing between tool calls and their responses
  • Sequential ID generation with suffix counters (0, 0__1, 0__2, etc.)

Improved Streaming Robustness

  • Better handling of cross-chunk tool call boundaries
  • Intelligent buffering prevents premature text emission
  • XML tool call detection and parsing during streaming
  • Graceful error handling for malformed tool calls

Code Quality Enhancements

  • Added extensive debug logging for troubleshooting
  • Improved error messages with context
  • Better separation of concerns in converter architecture
  • Enhanced test coverage for edge cases

Use Cases Enabled

With the new XML parser, you can now:

  1. Use Local AI Models: Run models locally with inference engines that don't have native tool calling support
  2. Custom Inference Engines: Integrate custom AI inference implementations using XML-style tool markers
  3. Legacy Model Support: Enable tool calling on older models that predate structured function calling
  4. Vendor Independence: Easily switch between different AI providers without compatibility concerns
  5. Emerging Models: Support new models and providers as they come online, even before they implement structured tool calling

Support

If you encounter any issues with this release:

  1. Check the Troubleshooting Guide
  2. Review the API Documentation
  3. Open an issue on GitHub

Full Changelog: See CHANGELOG.md for detailed commit history.

Release Date: October 14, 2025
Version: 0.1.1-pre
Branch: agent → main