Skip to content

Repository navigation

v0.6.0 — LM Studio out, oMLX in

Choose a tag to compare

View all tags
@dea6cat dea6cat released this 22 Oct 15:10
· 213 commits to main since this release
v0.6.0
8bf8cb1

LM Studio is out. oMLX is in.

What changed

  • MLX models now run in oMLX (Apache-2.0) instead of LM Studio, which is closed source. The first time you pick an MLX model, Clyde asks, then installs oMLX's pinned v0.7.2 from source into ~/.clyde/omlx. No Homebrew, and no change outside that folder.
  • Clyde holds the key. The oMLX server always starts with a key only Clyde has (~/.clyde/omlx/api_key, readable only by you). Without one, oMLX opens its admin API to anything that can reach the port, a web page in your browser included.
  • /models local downloads MLX models through oMLX's own downloader and Hugging Face GGUF through Ollama only.
  • /settings → oMLX memory guard: balanced (the default), aggressive, a fixed ceiling, or off.
  • clyde -p --time-limit SECONDS and --max-tokens N stop a headless run on time or on tokens. Both ideas come from Mistral Vibe.

Why

oMLX keeps a prompt's work on disk. On an 18 GB M3 Pro, a 3,555-token prompt took 7.56 s cold, 1.01 s warm, and 0.96 s after a server restart: the cache restored it instead of recomputing it. That is the case that matters here, since Clyde starts and stops the server and an 18 GB Mac evicts models often. It is one run, and it is not a comparison with LM Studio; the method and limits are in docs/research/omlx.md.

Coming from LM Studio

  • Nothing to re-download. oMLX serves ~/.lmstudio/models where it is.
  • A saved lmstudio: default model and your /eval results move to their omlx: names at start, when exactly one folder matches. Two quantizations of the same model are left alone rather than guessed.
  • clyde -p, Bonnie and editors never install oMLX: run one MLX model in the terminal first.

Also in this release

  • Memory: limits on what the model saves on its own, and your own notes keep at most 1,000 of the prompt's 2,000 characters.
  • /doctor lists skill problems the loader used to pass over in silence.
  • clyde -p --output-format stream-json, and SIGTERM now stops the running command too.
  • SkillSpector scans symlinked skills, and a first launch with 95 skills went from about 5 minutes to 38 s.

Full history: CHANGELOG.md · What leaves your machine: EGRESS.md · Found something: SECURITY.md

Assets 2
Loading