Skip to content

v1.31.1

Choose a tag to compare

View all tags
@ardan-bkennedy ardan-bkennedy released this 15 Aug 19:28
· 40 commits to main since this release
v1.31.1
66754cb
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Release Notes - v1.31.1

Release Date: August 15, 2026

Overview

Version 1.31.1 brings MTP performance improvements, new support for the Qwen3.8-27B model, and documentation updates for Homebrew installation.

Detailed Changes

New Features

Qwen3.8-27B Model Support

  • Author: William Kennedy
  • Added catalog entry for unsloth/Qwen3.8-27B-UD-Q4_K_XL (Hybrid model with vision, reasoning, and tooling capabilities)
  • Added model configuration for unsloth/Qwen3.8-27B-UD-Q4_K_XL/AGENT with reasoning_effort: "low" and 16384 max tokens
  • Updated libs.go for compatibility

Improvements

MTP Performance Enhancements

  • Author: William Kennedy
  • Removed adaptive chooseNDraft throttling for MTP — now uses the configured draft count to match llama.cpp behavior
  • Added detailed timing observability for MTP decode operations: target decode elapsed, MTP sync elapsed, decode wait elapsed, and chunk counts
  • Updated defMTPNDraft from 2 to 3 to match llama.cpp's MTP default
  • Clarified comments distinguishing MTP drafting from separate-GGUF speculative decoding

Reasoning Effort Handling

  • Author: William Kennedy
  • Removed the global default DefReasoningEffort constant so the chat template determines the default reasoning level
  • Updated Mistral parser to only coerce explicit reasoning_effort values — an empty value remains unset, allowing the template's native default to apply
  • Added test coverage for Mistral parser reasoning effort handling

Model Config Updates

  • Author: William Kennedy
  • Increased max_tokens from 8192 to 16384 for AGENT models: gemma-4-26B-A4B, mtp-Qwen3.6-27B, mtp-Qwen3.6-35B-A3B, gemma-4-E4B, and Qwopus3.5-4B-Coder

Documentation

Homebrew Installation Fix

  • Author: William Kennedy
  • Updated Homebrew installation instructions in .manual/chapter-02-installation.md and README.md

Statistics

Category Count
Total Commits 3
New Features 1
Improvements 3
Bug Fixes 0
Documentation 1

Contributors:

  • William Kennedy

Upgrade Notes

Breaking Changes

None

Migration

No migration required

Recommended Actions

  • Review the updated MTP behavior: draft token count no longer adapts based on acceptance rate for auto-detected MTP heads — it uses the configured value (default 3) to match llama.cpp
  • If you relied on the previous DefReasoningEffort default of "medium", verify your templates handle the reasoning effort default appropriately
Assets 15
Loading