Skip to content

v0.5.7 — /models local grows model pages

Choose a tag to compare

@dea6cat dea6cat released this 16 Nov 13:00
· 424 commits to main since this release
  • Choosing a model opens its page: downloads, likes, last update and license, parameters, architecture, context length, and what it can do — then every download of that model as a table: each GGUF quantization and MLX build with its size, fit, estimated speed and quality, the recommended one marked, and options too large for your machine shown but not selectable.
  • Results are tables with titled columns (model, fit, format, size, tokens per second, pulls, quantization, publisher); a narrow terminal drops the right-hand columns instead of wrapping.
  • Search results are named after the model they were made from when the repo's card says so reliably.
  • Ollama replies now record prefill_ms, decode_ms and load_ms in the trace, and tools/analyze_traces.py reads them.
  • A model whose best download is 2-bit or lower is listed after the usable ones, and IQ quantizations get a quality note like the others.
  • Pylint now runs on Python 3.14 with the project installed and fails below a score of 9 — it used to run on 3.8 to 3.10 and fail every time.