Repository navigation
mlx-agent v0.11.0
- Add
serve start --m5-prefill: an opt-in MLX-LM prompt kernel for affine 4-bit Qwen2 MLP projections on M5 GPUs with macOS 26; other hardware, dependencies, models and inputs keep native MLX, and the plan and receipt recordprefill_kernel. - Add
serve start --prompt-lookup: opt-in MLX-LM decoding for code edits that drafts up to eight tokens from repeated prompt text and verifies them with the model; plain greedy requests run one at a time, other requests keep native generation, and the plan and receipt recorddecode_profile. - JIT serve gateways answer the Anthropic Messages API (
POST /v1/messages) and the OpenAI Responses API (POST /v1/responses), streamed and unstreamed, with text, system prompts and tool calls translated to the model worker's chat completions; unsupported content and parameters return aninvalid_request_error. - The core requires Python 3.11 or later; the
mlx-agentandmlx-agent-mcplaunchers exit with a message on older interpreters, including thepython3bundled with macOS. - Releases also notify
cavi-ai/plugins, which points every host in the plugin catalog at the release. convert start --ggufconverts Qwen3.5-family GGUFs (qwen35) through a bundled port to MLX-VLM'sqwen3_5_text, orqwen3_5with the matchingmmprojprojector from the same folder; GGUFs holding only a multi-token-prediction block are classified as speculative drafters and refused.- Update filelock to 4.2.4 and setuptools to 84.2.1 in backend locks.
mlx-agent-docs-v0.11.0.tar.gz
sha256 56bc78c3191ec71f68a90bddcf4a6330abed9852105c55c9b7b43916dbfdd943