Skip to content

v0.5.0

Choose a tag to compare

@github-actions github-actions released this 25 Apr 15:04
30508c8

0.5.0 (2026-04-25)

Features

  • cli: add evaluate-retrieval and evaluate-rag subcommands (f6133ba)
  • config: extend ThresholdConfig with retrieval and RAG thresholds (725c56e)
  • engine: add run_rag_evaluation orchestrator and retrieval drift check (202a741)
  • judge: add context_relevance and citation_faithfulness judges (8b5074b)
  • metrics: add retrieval_metrics module with recall, precision, MRR, nDCG (91ac8d0)
  • retrieval: add RetrievalAdapter protocol and BM25 in-memory adapter (7109118)
  • server: add evaluate_retrieval, evaluate_rag, drift, and poisoned-corpus MCP tools (c8a1ab1)
  • types: add retrieval and RAG result types, extend EvalEntry (650fbc0)

Documentation

  • design: add v0.5.0 retrieval eval design spec (5bf7e04)