v0.1.0
jevassert v0.1.0
Record/replay regression tests for Jev question packs — assert accuracy, calibration and cost in CI.
Commands
record— concurrent calls with retries,--resume,--rpm,--dry-runcost estimate,--shuffle-options,--repeat N(stability)check— accuracy with bootstrap CIs, ECE/Brier, coverage + author thresholds, threshold suggestion,--failures,--partition dev|test, JUnit + markdown evidencecompare— paired accuracy deltas + exact McNemar
Pack spec v0 loader (jevassert.packs), implemented from the canonical jev-packs SPEC.md.
Reference evidence: jev-packs registry — 9 packs, 2,990 cases / 6,430 items, verified against jev-1.13.0.
63 tests, offline CI, Apache-2.0.