Skip to content

proofrag v0.4.0

Choose a tag to compare

View all tags
@unshDee unshDee released this 01 Jun 06:55
· 16 commits to main since this release
v0.4.0
b768e65
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

proofrag v0.4.0

Blind A/B comparison of two RAG variants.

  • proofrag compare — run two variants (vector vs GraphRAG, two prompts, two models) over the same golden set; the same pinned judge picks the better answer per question blind (answers shown in randomized order, position bias shuffled out).
  • Reports win counts + per-variant retrieval metrics, plus a self-contained HTML comparison report. proofrag report auto-detects the format; proofrag demo --compare renders a sample with no API key.

Install: pipx install "proofrag[anthropic]" · uvx "proofrag[anthropic]" demo

Assets 2
Loading