Repository navigation
mlx-agent v0.13.0
- Add
serve front-door: one authenticated loopback port that lists discovered routes sharing its API key by path-free model name and routes chat, Messages, Responses and embeddings to them. Themlx-agentOpenClaw provider plugin discovers its chat models with the gateway key. - Add Splash as a serving runtime for local GGUF, MLX and Strata profile weights and cached repositories, with authenticated
--jitserving behind the front door,strataandsplashbench labels and the Splash family of each quantized MLX output inconvert scan. - Serve classifiers, text embeddings, speech, music, image, video and 3D models through typed local endpoints that keep weights loaded between jobs or release them after each request, including OpenAI
POST /v1/embeddingswith float or base64 output.convert speak,music,generate,videoanddescriberun on a live endpoint that already serves the same model, andtask capabilities --model-pathreports model-bound media settings. - Add the Kev classification port (
jaredpalmer/kev-4bover Qwen3-4B-Base, 8-bit or unquantized), and serve TypeSafe System One decisions atPOST /v1/systemoneon classification task routes and the front door. - Protect MLX-LM, vision, Strata, accelerated chat and typed endpoints with API keys, separate control credentials and private Unix or HTTP workers. Add
serve private-workerand a foreground authenticated MLX service for existing service managers. A live model load refuses when its files or settings no longer match the reviewed serving plan. - Share memory admission across resident endpoints and tracked agent processes under one budget that includes Metal physical memory;
--memory-budget-gbcaps task jobs. A guard stop releases only the model worker and the endpoint keeps admitting requests, exited owners are not charged, idle task allocator cache is reclaimed before a refused admission is retried, and serving status keeps numeric reasons for memory refusals. - Add named serving workflows with per-role models and resource profiles, read-only previews, owned activation and memory forecasts that include resident models and pending allocations.
- Managed chat gateways apply serving defaults without overriding explicit client settings and report token usage and response throughput through protected status.
- Convert to FP16 or FP32 and 2, 3, 4, 5, 6 or 8-bit where the converter supports them. Model update preparation fetches pinned sources with companion and support files, requires observed completion and fresh output evidence, and reuses completed downloads instead of starting overlapping ones.
convert scanreports the disk each model occupies with every file counted once, bytes under each root that belong to no model, families of copies of one model across MLX, GGUF and Ollama, vision projector GGUFs with their declared base model, and standalone.safetensorsand.ckptfiles;--compare-assetscompares same-size files by full SHA-256.- Add the
mlx-taskcommand and skill to every provider for durable local inference tasks, widenmlx-advisorto the whole model lifecycle, and document agent integration and the MCP server. - TRELLIS.2
convert meshincludes the texture stage and writes a closed, outward-facing solid with base color asCOLOR_0and occlusion, roughness and metallic asCOLOR_1, takes repeatable--viewimages and a--guideGLB, and loads only the components each resolution needs. - Add the optional
ace-stepbackend:convert musicruns ACE-Step 1.5 checkpoints with their planner, and takes--bpm,--time-signatureand--referencefor them. - Add opt-in adaptive denoiser caching for Wan2.1 T2V and TripoSG with feature-memory budgets, refresh limits and reuse statistics, and speed up TripoSG and MiniMax Music3 by reusing conditioning projections, depth prefixes and prompt encodings.
- Fix MLX-VLM tool calls from templates that write
<tool_call><function=without a newline, such as MiMo-V2.6 and Qwen3.5, size paged Strata MTP expert caches from packed draft-head storage, reap exited serving and worker processes, and update opentelemetry-api to 1.45.2 and the ACE-Step runtime locks.
mlx-agent-docs-v0.13.0.tar.gz
sha256 bebf498dac02b1033ccf12d397076f1e66fbd63dbfa3cc43394d4d92e6ebf683