Skip to content

v0.5.4 — the picker stops selling slow models

Choose a tag to compare

@dea6cat dea6cat released this 18 Oct 03:59
· 388 commits to main since this release
  • /models local lists models that run slower than about 15 tokens per second last and marks them (slow); CLYDE_MIN_TOKS changes the floor.
  • Models whose chat template can't call tools are no longer offered, and a model that failed /eval is hidden whichever app runs it (Ollama, Hugging Face GGUF or LM Studio).
  • Downloads through LM Studio warn first that tool use isn't confirmed for that model.
  • Clyde asks for GPU offload when a GPU (Apple Silicon or NVIDIA) can hold all or part of the model: Ollama gets num_gpu, lms load gets --gpu.