Repository navigation
v0.5.8 — oMLX provider support
Cleetus 0.5.8 adds first-class support for oMLX, an inference server for Apple Silicon.
- Configure
type: omlxwith the server root URL, without/v1. Optional API keys use Bearer authentication. - Supports model discovery, streamed text and reasoning, native tool calls, structured output, and embeddings across CLI, TUI, and ACP sessions.
- Reads effective model context windows from
max_model_lenwhen available, and detects local oMLX servers on port 8000 during first-run setup. - Updates the README and provider guide with local and remote setup, authentication, context limits, and embedding configuration.
- Updates the MCP TypeScript SDK from 1.29.0 to 1.31.0, addressing GHSA-6qxp-vccf-f47h, and refreshes the dependency lockfile and license notices.
providers:
mac:
type: omlx
base_url: http://localhost:8000
# api_key: ${OMLX_API_KEY}
default_provider: mac
# default_model: your-model-idValidated with 4,347 passing tests (6 skipped), lint, typecheck, dependency audit, license checks, a compiled CLI smoke test, and a live oMLX streaming tool-call round trip.