ContextTrace v0.6.0
ContextTrace v0.6.0
ContextTrace v0.6.0 adds a complete local evidence QA workflow for RAG outputs.
This release moves ContextTrace beyond separate debugging commands. Developers can now capture a RAG response, inspect trace quality, verify claim-level evidence, audit retrieval and corpus failures, and produce one local QA report with risk level and recommended next actions.
Highlights
- Evidence QA workflow with
contexttrace qa trace.json --corpus docs/ --report. - Trace inspection with
contexttrace inspect trace.json. - Endpoint capture with
contexttrace capture endpoint. - Saved response capture with
contexttrace capture response response.json. - Risk scoring in QA output, including risk level, primary issue, risk signals, and CI gates.
- Stronger retrieval audit diagnostics with failure stages, evidence status, diagnostic signals, failure paths, developer summaries, and recommended actions.
- Local QA HTML report covering inspection warnings, claim verification, optional corpus audit, risk signals, and next actions.
- Validation docs and harnesses for public-source RAG app runs and saved-response debugging workflows.
Core Commands
contexttrace capture endpoint --endpoint http://localhost:8000/query --query "What is the refund policy?" --out traces/refund_trace.json --verify --report
contexttrace capture response response.json --query "What is the refund policy?" --out traces/refund_trace.json --verify --report
contexttrace inspect traces/refund_trace.json
contexttrace qa traces/refund_trace.json --corpus docs/ --report