rca-evidence-packet 0.2.0
This release is the result of authoring and validating a complete evidence packet for a public ORCA-bench Medium task.
Added
- Schema version 2 with required claim-level
source_evidencelocations. - A public ORCA-bench product-catalog failure packet with replayed Prometheus responses, explicitly labeled curated rubric evidence, source locations, and byte digests.
- Draft-2020-12 schema conformance tests across supported packet versions.
- Python/ECMAScript path-regex parity checks, including Unicode whitespace and U+FEFF handling.
Schema version 1 remains accepted for compatibility. Optional source evidence on v1 packets is still validated fail closed.
Verification
- 71 tests pass on Python 3.9 and 3.11.
- Clean wheel installs validate both bundled examples and reject tampered evidence.
- Final exact-HEAD Claude Code review found zero issues for
a2c2b4caf8e4c5fb2ee27dbafb26fcbdc6bd1b9d.
The validator still does not claim that evidence semantically proves a diagnosis or that a query was actually run.