Skip to content

v0.5.8 — oMLX provider support

Choose a tag to compare

@github-actions github-actions released this 08 Oct 00:15
· 4 commits to main since this release
3a3e7c7

Cleetus 0.5.8 adds first-class support for oMLX, an inference server for Apple Silicon.

  • Configure type: omlx with the server root URL, without /v1. Optional API keys use Bearer authentication.
  • Supports model discovery, streamed text and reasoning, native tool calls, structured output, and embeddings across CLI, TUI, and ACP sessions.
  • Reads effective model context windows from max_model_len when available, and detects local oMLX servers on port 8000 during first-run setup.
  • Updates the README and provider guide with local and remote setup, authentication, context limits, and embedding configuration.
  • Updates the MCP TypeScript SDK from 1.29.0 to 1.31.0, addressing GHSA-6qxp-vccf-f47h, and refreshes the dependency lockfile and license notices.
providers:
  mac:
    type: omlx
    base_url: http://localhost:8000
    # api_key: ${OMLX_API_KEY}
default_provider: mac
# default_model: your-model-id

Validated with 4,347 passing tests (6 skipped), lint, typecheck, dependency audit, license checks, a compiled CLI smoke test, and a live oMLX streaming tool-call round trip.