Skip to content

v0.4.3

Choose a tag to compare

@Abdullahbinaqeel Abdullahbinaqeel released this 05 Aug 22:00

Changed

ragmill chat now fails cleanly when the local model is not installed.

Since llama-cpp-python left [all] in 0.4.1, this is the first thing a new user meets — and it was handled badly in two ways.

It raised from inside the REPL loop, so the failure only surfaced after you had typed a question. The question was discarded, and an ordinary "optional package not installed yet" state was reported as a Python traceback. The backend is now checked before the prompt opens, and the command exits with status 1 and a message.

The message also pointed elsewhere. It offered the Gemini and OpenAI backends — but someone running the local backend asked for local chat, and a hosted service that needs an API key answers a different question. It also suggested pip install "ragmill[chat]", which is a source build and precisely what fails on Windows. Both are gone. What you get now:

The local chat model is not installed yet.

Install it with this command:

  pip install llama-cpp-python --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cpu

Then run `ragmill chat` again. The first question downloads the model
(about 1.1GB); after that it runs fully offline.

The check is skipped for the hosted backends, so a Gemini or OpenAI user is never told to install a local model.

Upgrading

pip install --upgrade "ragmill[all]"

No API changes. This affects the guidance you get when the local model is missing — the install command itself is unchanged and works on 0.4.2 too.