Skip to content

proofrag v0.5.0

Choose a tag to compare

View all tags
@unshDee unshDee released this 01 Jun 08:50
· 14 commits to main since this release
v0.5.0
9cb9cf0
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

proofrag v0.5.0

Pluggable scoring backends.

  • evaluate --backend deepeval (pip install "proofrag[deepeval]", verified against deepeval 4.0.5) — scores generation with FaithfulnessMetric / AnswerRelevancyMetric / GEval correctness, using proofrag's own model config (Anthropic → AnthropicModel, OpenAI → GPTModel).
  • Retrieval metrics, the HTML scorecard, diff, and compare are unchanged across backends; the scorecard renders each backend's metric set dynamically.
  • Ragas backend planned next.

Install: pipx install "proofrag[anthropic]" · uvx "proofrag[anthropic]" demo

Assets 2
Loading