Skip to content

v1.31.7

Choose a tag to compare

@ardan-bkennedy ardan-bkennedy released this 19 Aug 22:06
· 19 commits to main since this release
742f521

Release Notes - v1.31.7

Release Date: August 19, 2026

Overview

Version 1.31.7 brings model configuration updates, improvements to media message normalization that preserves message fields, and removes the enum restriction on reasoning_effort to support newer templates.

Detailed Changes

Improvements

Improvement Media Message Field Preservation

  • Author: William Kennedy
  • toMediaMessage now preserves reasoning_content, tool_calls, and tool_call_id fields instead of dropping them during media normalization
  • Messages are cloned before normalization so only content fields are rewritten
  • A length mismatch check between source and normalized messages prevents silent data loss
  • Non-user roles (system, assistant, tool) are now correctly preserved through the full message lifecycle

Improvement Removed reasoning_effort Enum Restriction

  • Author: William Kennedy
  • Removed the hardcoded enum validation for reasoning_effort in parseReasoningString
  • The SDK now accepts any string value so newer chat templates can add reasoning levels without requiring a server change
  • Invalid values are passed through to the template which may reject them

Improvement Model Configuration Updates

  • Author: William Kennedy
  • Added unsloth/Ornith-1.0-35B-UD-Q8_K_XL/AGENT model config with nseq-max: 2, context-window: 131072, and preserve_thinking: true
  • Removed hardcoded temperature, top_k, and top_p overrides for all AGENT models to use their GGUF sampling defaults
  • Added chat-template-kwargs: preserve_thinking: true to all AGENT models

Bug Fixes

Bug Fix Removed Invalid reasoning_effort Test Case

  • Author: William Kennedy
  • Removed test case that expected "invalid" to fail validation on reasoning_effort
  • The new behavior allows any string so templates can validate their own values

Documentation

Documentation Updated Request Parameters Manual

  • Author: William Kennedy
  • Updated Chapter 10 to document the flexible reasoning_effort behavior
  • Updated API Endpoints manual with catalog and operations endpoint details

Statistics

Category Count
Total Commits 1
New Features 0
Improvements 3
Bug Fixes 1
Documentation 1

Contributors:

  • William Kennedy

Upgrade Notes

Breaking Changes

None

Migration

No migration required

Recommended Actions

  • Review model configuration files if custom sampling overrides were set — defaults now come from the model's GGUF metadata
  • Verify that any custom reasoning_effort values are compatible with your chat templates