Skip to content

v0.9.4

Choose a tag to compare

@github-actions github-actions released this 24 Oct 03:24
· 14 commits to main since this release

Models from Hugging Face in the window, the newest llama.cpp, math in replies, and the system's font.

  • The Models tab searches Hugging Face for GGUF and MLX models, says whether each quantization fits on this machine's cards, runs partly on the CPU or is too large, and downloads into the models folder with a progress bar. A download carries on after a restart and is checked against Hugging Face's SHA-256.
  • llama.cpp b11846, which runs flint and the other newest models. A model llama.cpp cannot run now says so, instead of "Too large for the cards?".
  • A model that fits on the cards loads. flint (33 GB) was refused on three cards with 36 GB free; before refusing, Crucible now asks llama.cpp what the load would really take.
  • Math is typeset in replies, from LaTeX, and code blocks show the language and a Copy button, without line numbers.
  • The system's font, or any installed font from Settings, General.
  • Picking an expert in the box loads it at once, and keeps it loaded while it is picked.
  • The chat box holds still while typing.
  • Fixes from a review of everything since 0.8.6: a fence like ```c++ froze the window, a page in the preview could run script in Crucible, runtimes never downloaded on a Mac, RTX 20 and GTX 16 cards failed with the CUDA runtime, closing the window could leave a download running, and more.

Everything else is in the CHANGELOG.