Skip to content

mlx-agent v0.12.0

Choose a tag to compare

@github-actions github-actions released this 07 Nov 23:00
· 206 commits to main since this release
v0.12.0
fc585f3
  • Add Strata total-memory budgets, live budget changes and saved usage profiles. Choose plain, verified prompt-lookup or MTP decoding; unused draft heads stay unloaded.
  • Add image inputs to the Messages and Responses APIs and opt-in image-feature reuse for Qwen2.5-VL and Qwen3-VL dense/MoE models.
  • Improve M5 code-edit decoding and prompt processing, reduce idle worker CPU use, and protect active requests during memory-pressure handling and worker reloads.
  • Add a coding-edit benchmark and loopback endpoint measurements for repeated prefixes, prefill, concurrency and cold loads. Benchmark exports distinguish end-to-end throughput from native stage rates.
  • Add native MLX TripoSG, TRELLIS.2 and Pixal3D mesh generation, including octree surface extraction and camera-aligned glTF output.
  • Accept 5-bit and 6-bit conversion where supported, and report converter-specific bit widths and model sizes.
  • Rank discovery by downloads, trending, likes or recency, and search repository names.
  • Discover MLX Agent services across receipt locations and scope doctor, watch and stop commands to a selected service.
  • Fix JIT tool-call identifiers, stream keepalives, end-token trimming, KV-cache admission and readiness deadlines.
  • Add mlx-agent --version and refresh installation, serving and compatibility documentation.

mlx-agent-docs-v0.12.0.tar.gz

sha256 f764773cac549eb05e3ca0138cf6d833c2e2f5458820fd6cd69bcdb2c661a624