Skip to content

ContextTrace v0.4.0

Choose a tag to compare

View all tags
@samarth1412 samarth1412 released this 04 Jun 16:28
v0.4.0
06b2bb1

ContextTrace v0.4.0 - Regression Diffing for RAG Grounding

ContextTrace v0.4.0 adds local regression diffing for claim-level evidence verification.

You can now compare a baseline RAG trace against a current trace and detect whether a prompt, retriever, chunking, or model change made grounding worse.

What’s New

  • Added contexttrace compare baseline.json current.json
  • Supports raw portable trace JSON and saved contexttrace verify --json outputs
  • Added local HTML regression reports
  • Added CI-friendly --fail-on gates
  • Detects:
    • new unsupported claims
    • support-rate drops
    • citation mismatch regressions
    • should-abstain flips
    • new root causes
    • added, removed, changed, and resolved claims

Example

contexttrace compare baseline.json current.json
contexttrace compare baseline.json current.json --json
contexttrace compare baseline.json current.json --report
contexttrace compare baseline.json current.json --fail-on new_failure
Assets 2
Loading