Skip to content

v0.6.0

Choose a tag to compare

View all tags
@unshDee unshDee released this 13 Jun 21:50
· 3 commits to main since this release
v0.6.0
9066f22
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Summary

Backend expansion release.

Added

  • Added Ragas scoring backend through evaluate --backend ragas and the proofrag[ragas] extra.
  • Added Ragas faithfulness and factual correctness scoring using the configured LLM provider.
  • Added Ragas answer relevancy when OpenAI-compatible embeddings are configured.
  • Updated DeepEval support to deepeval 4.0.6.
  • Preserved DeepEval metric reasons in record rationales for scorecard notes.
  • Added golden set validation with schema checks, duplicate detection, source coverage, strict mode, JSON reports, and stable fingerprints.
  • Added proofrag run prediction adapters for HTTP endpoints and Python callables.
  • Added CI markdown summaries and automatic scorecard/results artifacts.

Changed

  • Updated plugin metadata to 0.6.0.
  • Updated changelog comparison links for recent releases.

Verification

  • PR checks passed on Python 3.11, 3.12, and 3.13.
Assets 2
Loading