v0.4.3
Changed
ragmill chat now fails cleanly when the local model is not installed.
Since llama-cpp-python left [all] in 0.4.1, this is the first thing a new user meets — and it was handled badly in two ways.
It raised from inside the REPL loop, so the failure only surfaced after you had typed a question. The question was discarded, and an ordinary "optional package not installed yet" state was reported as a Python traceback. The backend is now checked before the prompt opens, and the command exits with status 1 and a message.
The message also pointed elsewhere. It offered the Gemini and OpenAI backends — but someone running the local backend asked for local chat, and a hosted service that needs an API key answers a different question. It also suggested pip install "ragmill[chat]", which is a source build and precisely what fails on Windows. Both are gone. What you get now:
The local chat model is not installed yet.
Install it with this command:
pip install llama-cpp-python --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cpu
Then run `ragmill chat` again. The first question downloads the model
(about 1.1GB); after that it runs fully offline.
The check is skipped for the hosted backends, so a Gemini or OpenAI user is never told to install a local model.
Upgrading
pip install --upgrade "ragmill[all]"No API changes. This affects the guidance you get when the local model is missing — the install command itself is unchanged and works on 0.4.2 too.