ContextTrace v0.3.0

ContextTrace v0.3.0

ContextTrace v0.3.0 adds local claim-level evidence verification with root-cause diagnosis for RAG and AI agent outputs.

Instead of only saying whether an answer passed or failed, ContextTrace now shows where the evidence chain broke: unsupported claim, wrong citation, answer overreach, conflicting context, retrieval miss, or should-have-abstained.

What’s New

• Claim-level evidence verification with contexttrace verify
• Local HTML verification reports
• Typed required, matched, and missing fact diagnostics
• Evidence spans with character offsets and stable span hashes
• Multi-span evidence support across retrieved contexts
• Citation mismatch detection:
  • citation_ok
  • cited_source_missing
  • cited_source_does_not_support_claim
  • claim_supported_by_different_source
  • claim_has_no_citation
• Claim-level root-cause diagnosis:
  • retrieval_miss
  • answer_overreach
  • partial_context_support
  • wrong_source_cited
  • missing_cited_source
  • conflicting_contexts
  • stale_context
  • insufficient_context
  • should_have_abstained
• Real verification benchmark:
  • 32 ContextTrace repo-doc cases
  • 13 external OSS docs/GitHub issue cases
  • 45 total real cases with --case-set all
• Local benchmark HTML reports with misses to inspect

Example Commands

contexttrace verify trace.json
contexttrace verify trace.json --json
contexttrace verify trace.json --report
contexttrace verify-demo citation_mismatch --report