Skip to content

v0.5.0

Choose a tag to compare

View all tags
@Abdullahbinaqeel Abdullahbinaqeel released this 05 Aug 22:40
v0.5.0
8d6b1e0

Added

ragmill setup-chat installs the local chat model runtime for you:

$ ragmill setup-chat
This will install the local chat model runtime:

  package:  llama-cpp-python (prebuilt wheel, no compiler needed)
  from:     https://abetlen.github.io/llama-cpp-python/whl/cpu
  command:  pip install llama-cpp-python --extra-index-url … --only-binary llama-cpp-python

That index is maintained by the llama-cpp-python author and is not PyPI.
It is needed because the package publishes no wheels to PyPI itself.

Continue? [y/N]

--yes skips the prompt, and is required when stdin is not a terminal, so it cannot install unattended by accident. It installs into the interpreter running RAGMill rather than whichever pip is first on PATH, and confirms the module imports afterwards instead of trusting pip's exit code. If it fails, it names the likely cause — a Python version with no wheel on that index, which covers 3.8 to 3.13 — and points at the hosted backends.

This deliberately is not a post-install hook. A wheel is unpacked, never executed, so Python packaging has no such hook — by design, after npm's postinstall became a supply-chain attack vector. Making it an explicit command also keeps the non-PyPI index visible and consented to, the way playwright install and python -m spacy download do.

Fixed

The documented command for installing the local model did not work.

pip install llama-cpp-python --extra-index-url https://abetlen.github.io/…
  → Downloading llama_cpp_python-0.3.34.tar.gz (71.6 MB)

--extra-index-url merges both indexes and pip picks the highest version across them — and PyPI carries a newer sdist-only release than the wheel index carries wheels. So pip chose the source archive, and the documented workaround for the Windows build failure triggered that very failure.

Adding --only-binary llama-cpp-python makes pip skip versions that have no wheel: it now fetches a 3.4 MB wheel with no compilation. Corrected everywhere the command appears — the CLI error, README, installation guide and chat guide.

If you were given the old command, use ragmill setup-chat or add --only-binary llama-cpp-python.

Upgrading

pip install --upgrade "ragmill[all]"

No breaking changes. Minor version bump because this adds a CLI command.

Assets 2
Loading