Skip to content

v1.31.8

Choose a tag to compare

View all tags
@ardan-bkennedy ardan-bkennedy released this 21 Aug 18:04
· 14 commits to main since this release
v1.31.8
c23d571
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Release Notes - v1.31.8

Release Date: August 21, 2026

Overview

Version 1.31.8 brings explicit control over where a multimodal model's media projector (mmproj) runs, support for the new Ornith 1.5 model line, and a faster, lighter test suite. The highlight is a new proj-device option that lets you pin the projector to a specific accelerator (for example, CUDA1 or MTL0), a general upgrade to Yzma v1.24.0, and a large reduction in the test-model download footprint from about 98 GiB to about 52 GiB.

Detailed Changes

New Features

Feature Projector Device Control

  • Author: William Kennedy
  • New WithProjDevice SDK option and proj-device model-config setting that pins the multimodal projector to a specific backend device (for example, CUDA1 or MTL0); omit for automatic placement.
  • proj-device conflicts with proj-on-cpu: true; the language model's device selection via ngpu-layers/main-gpu is unaffected.
  • DeviceInfo now reports description, hardware_type, and backend, so kronk devices exposes richer detail and the projector can target the reported name.

Feature Code-Generation Benchmark Harness

  • Author: William Kennedy
  • New structured code-generation benchmark (sdk/kronk/tests/benchmarks) that runs a two-turn tic-tac-toe coding task and produces token/throughout/TTFT/through speculative-decoding metrics and model-memory estimates.
  • Integrated automated grader (grader_test.go) that builds, vets, checks Go structure, and runs win/draw/undo scenarios against each response.
  • New make targets (benchmark-codegen-*) with BENCH_CODEGEN_TIME and BENCH_CODEGEN_TIMEOUT knobs, replacing the previous bench suite.

Improvements

Improvement Ornith 1.5 Model Support

  • Author: William Kennedy
  • Agent model config now uses kronk/ornith-ai/Ornith-1.5-35B-Q8_0/AGENT as the main model, retiring the Ornith 1.0 35B entry.
  • Updated model capabilities, context/output limits, and catalog/model-config entries to match the Ornith 1.5 line.
  • Adjusted small-model and additional-model entries and their limits in .agents.

Improvement Smaller Test-Model Footprint

  • Author: William Kennedy
  • Test-model set reduced from about 98 GiB to about 52 GiB, using smaller quantizations that still exercise each runtime path.
  • Cleaned the default catalog (sdk/tools/defaults/yaml/catalog.yaml) by removing stale/unused model entries.
  • Added MODEL_USAGE.md to record the intent behind each model-backed test, benchmark, and example selection.

Improvement CI Model-Backed Coverage

  • Author: William Kennedy
  • GitHub Actions now run focused, model-backed tests per capability in linux.yml (ThinkChat, tool-call content, draft/speculative, vision, rerank) instead of relying solely on local runs.
  • Added small test models (Qwen3-0.6B-Q8_0, Qwopus3.5-4B-Coder.Q4_K_M) and trimmed models to fit the GitHub Actions 10 GiB cache quota.
  • Refined kronk launch model filtering for cleaner regeneration of the OpenCode config.

Improvement GPU Device Classification

  • Author: William Kennedy
  • ClassifyDeviceType now classifies by backend device metadata (hardware type + registration name), giving more accurate gpu_rocm/gpu_cuda/gpu_metal/gpu_vulkan mapping.
  • Refactored ROCm/HIP alias handling so it no longer depends solely on by-name prefixes.

Library Updates

  • Author: William Kennedy
  • Upgraded Yzma v1.23.0 → v1.24.0, bringing the underlying llama.cpp default library from b10520 → b10549.
  • Refreshed transitive dependencies (grpc, aws-sdk-go-v2, cloud.google.com/storage, genproto, testify, logrus, mewkiz/flac, lestrrat-go/dsig).

Bug Fixes

None.

Documentation

Documentation Projector + Benchmark Docs

  • Author: William Kennedy
  • Chapter 03 documents the new proj-device setting, its conflict with proj-on-cpu, and the updated config-reference table.
  • New code-generation benchmark README documents the protocol, metrics, make targets, and artifacts.
  • Updated several manual chapters and BUI docs (DocsManual, DocsSDKModel) to reflect the cleaned model list and projector options.

Dependencies

Dependency Yzma and Transitive Dependencies

  • Author: William Kennedy
  • github.com/hybridgroup/yzma v1.23.0 → v1.24.0 (primary library upgrade).
  • kronk libs default llama.cpp build bumped b10520 → b10549.
  • Bumped grpc, aws-sdk-go-v2 suite, cloud.google.com/auth and storage, genproto packages, testify, sirupsen/logrus, mewkiz/flac, and lestrrat-go/dsig.

Statistics

Category Count
Total Commits 4
New Features 2
Improvements 4
Bug Fixes 0
Documentation 1

Contributors:

  • William Kennedy

Upgrade Notes

Breaking Changes

None.

Migration

No migration required. The new proj-device setting is optional; omit it to keep the previous automatic projector behavior.

Recommended Actions

  • Review the cleaned default catalog and test-model list if any of those entries were relied upon.
  • Optionally add proj-device to pin the multimodal projector on multi-GPU systems.
  • Re-run any custom benchmark scripts against the new benchmark-codegen-* make targets.
Assets 15
Loading