Mini-RAG Runner

Container wrapper for https://github.com/bdargan/mini-rag.git (fork florianbuetow/mini-rag)

Subtrees

• vendor/mini-rag: https://github.com/bdargan/mini-rag.git (main) # upstream florianbuetow/mini-rag git subtree add --prefix=vendor/mini-rag https://github.com/bdargan/mini-rag.git

Getting started

Build a local container - podman / docker

./build.sh

First time run and check

./run.sh
# setup venv FIRST time only
uv venv /container_venv --clear --force
just init
just test

Add your own corpus

See https://github.com/bdargan/mini-rag.git for adding corpus.

vendor/mini-rag/data/<corpus>

Check Cross-Encoder Efficiency

Test to see re-ranking efficiency gains

# in container
uv run pytest tests/test_rag_tokens.py -v -s

[TOKEN BENCHMARK REPORT]
  • Baseline Prompt Tokens (K=10): 308
  • Reranked Prompt Tokens (K=3):  112
  • Absolute Token Savings:         196
  • Efficiency Gains:               63.64%
PASSED