Skip to content

ContextTrace v0.6.0

Choose a tag to compare

@samarth1412 samarth1412 released this 04 Jun 23:28

ContextTrace v0.6.0

ContextTrace v0.6.0 adds a complete local evidence QA workflow for RAG outputs.

This release moves ContextTrace beyond separate debugging commands. Developers can now capture a RAG response, inspect trace quality, verify claim-level evidence, audit retrieval and corpus failures, and produce one local QA report with risk level and recommended next actions.

Highlights

  • Evidence QA workflow with contexttrace qa trace.json --corpus docs/ --report.
  • Trace inspection with contexttrace inspect trace.json.
  • Endpoint capture with contexttrace capture endpoint.
  • Saved response capture with contexttrace capture response response.json.
  • Risk scoring in QA output, including risk level, primary issue, risk signals, and CI gates.
  • Stronger retrieval audit diagnostics with failure stages, evidence status, diagnostic signals, failure paths, developer summaries, and recommended actions.
  • Local QA HTML report covering inspection warnings, claim verification, optional corpus audit, risk signals, and next actions.
  • Validation docs and harnesses for public-source RAG app runs and saved-response debugging workflows.

Core Commands

contexttrace capture endpoint --endpoint http://localhost:8000/query --query "What is the refund policy?" --out traces/refund_trace.json --verify --report

contexttrace capture response response.json --query "What is the refund policy?" --out traces/refund_trace.json --verify --report

contexttrace inspect traces/refund_trace.json

contexttrace qa traces/refund_trace.json --corpus docs/ --report