Skip to content

mlx-agent v0.13.0

Choose a tag to compare

@github-actions github-actions released this 16 Nov 17:17
· 66 commits to main since this release
v0.13.0
96995d8
  • Add serve front-door: one authenticated loopback port that lists discovered routes sharing its API key by path-free model name and routes chat, Messages, Responses and embeddings to them. The mlx-agent OpenClaw provider plugin discovers its chat models with the gateway key.
  • Add Splash as a serving runtime for local GGUF, MLX and Strata profile weights and cached repositories, with authenticated --jit serving behind the front door, strata and splash bench labels and the Splash family of each quantized MLX output in convert scan.
  • Serve classifiers, text embeddings, speech, music, image, video and 3D models through typed local endpoints that keep weights loaded between jobs or release them after each request, including OpenAI POST /v1/embeddings with float or base64 output. convert speak, music, generate, video and describe run on a live endpoint that already serves the same model, and task capabilities --model-path reports model-bound media settings.
  • Add the Kev classification port (jaredpalmer/kev-4b over Qwen3-4B-Base, 8-bit or unquantized), and serve TypeSafe System One decisions at POST /v1/systemone on classification task routes and the front door.
  • Protect MLX-LM, vision, Strata, accelerated chat and typed endpoints with API keys, separate control credentials and private Unix or HTTP workers. Add serve private-worker and a foreground authenticated MLX service for existing service managers. A live model load refuses when its files or settings no longer match the reviewed serving plan.
  • Share memory admission across resident endpoints and tracked agent processes under one budget that includes Metal physical memory; --memory-budget-gb caps task jobs. A guard stop releases only the model worker and the endpoint keeps admitting requests, exited owners are not charged, idle task allocator cache is reclaimed before a refused admission is retried, and serving status keeps numeric reasons for memory refusals.
  • Add named serving workflows with per-role models and resource profiles, read-only previews, owned activation and memory forecasts that include resident models and pending allocations.
  • Managed chat gateways apply serving defaults without overriding explicit client settings and report token usage and response throughput through protected status.
  • Convert to FP16 or FP32 and 2, 3, 4, 5, 6 or 8-bit where the converter supports them. Model update preparation fetches pinned sources with companion and support files, requires observed completion and fresh output evidence, and reuses completed downloads instead of starting overlapping ones.
  • convert scan reports the disk each model occupies with every file counted once, bytes under each root that belong to no model, families of copies of one model across MLX, GGUF and Ollama, vision projector GGUFs with their declared base model, and standalone .safetensors and .ckpt files; --compare-assets compares same-size files by full SHA-256.
  • Add the mlx-task command and skill to every provider for durable local inference tasks, widen mlx-advisor to the whole model lifecycle, and document agent integration and the MCP server.
  • TRELLIS.2 convert mesh includes the texture stage and writes a closed, outward-facing solid with base color as COLOR_0 and occlusion, roughness and metallic as COLOR_1, takes repeatable --view images and a --guide GLB, and loads only the components each resolution needs.
  • Add the optional ace-step backend: convert music runs ACE-Step 1.5 checkpoints with their planner, and takes --bpm, --time-signature and --reference for them.
  • Add opt-in adaptive denoiser caching for Wan2.1 T2V and TripoSG with feature-memory budgets, refresh limits and reuse statistics, and speed up TripoSG and MiniMax Music3 by reusing conditioning projections, depth prefixes and prompt encodings.
  • Fix MLX-VLM tool calls from templates that write <tool_call><function= without a newline, such as MiMo-V2.6 and Qwen3.5, size paged Strata MTP expert caches from packed draft-head storage, reap exited serving and worker processes, and update opentelemetry-api to 1.45.2 and the ACE-Step runtime locks.

mlx-agent-docs-v0.13.0.tar.gz

sha256 bebf498dac02b1033ccf12d397076f1e66fbd63dbfa3cc43394d4d92e6ebf683