Releases: kalibraring/conditional-instruction-benchmark
Releases · kalibraring/conditional-instruction-benchmark
Release list
CIB v0.5.3
Adds the explicit private cloud-config seed and minimum-validity controls to cib check, matching cib study and enabling frozen configured studies without internal API workarounds.
Verification: 118 tests, all hosted checks, publication scan, package build, and a real 6/6 configured Codex check with zero harness failures.
CIB v0.5.2
CIB v0.5.2 hardens the scientific evidence boundary exposed by the invalid confirmatory-v2 run.
Highlights:
- frozen, hash-sealed Promptfoo test-ledger recovery for redacted per-trial timeouts
- exact full-manifest consistency between results, protected archives, and frozen assignments
- correct separation of pre-session transport failures, evaluation timeouts, and behavioral grading failures
- strict session uniqueness and completed-session requirements
- explicit privacy-safe signed-format cloud-config seeding with freshness and post-run integrity evidence
- publication scanning now includes untracked non-ignored files
Verification:
- 117 local tests and all hosted checks pass
- final real Codex smoke: 6/6 with zero harness or integrity failures
- offline invalid-v2 parity: 1,152 rows, 680 behavioral successes, 35 harness failures, 9 ledger recoveries, 8/8 audits, zero scorer/index disagreements
- publication scan: 85 files, zero findings
- wheel and sdist build and clean install pass
Scientific boundary: v2 remains invalid as confirmatory evidence. Its offline normalization is regression evidence only.
v0.5.1
What's Changed
- fix: isolate Promptfoo process state by @Mohamad-Kamar in #6
Full Changelog: v0.5.0...v0.5.1
Contributors
Mohamad-Kamar
Assets 5
v0.5.0
What's Changed
- Separate per-trial and whole-study timeouts by @Mohamad-Kamar in #5
New Contributors
- @Mohamad-Kamar made their first contribution in #5
Full Changelog: v0.4.0...v0.5.0
Contributors
Mohamad-Kamar
Assets 5
v0.4.0
v0.3.0
v0.2.1
What's Changed
- Bump actions/setup-node from 6.1.0 to 7.0.0 by @dependabot[bot] in #1
- Bump @openai/codex-sdk from 0.144.1 to 0.144.5 by @dependabot[bot] in #2
New Contributors
- @dependabot[bot] made their first contribution in #1
Full Changelog: v0.2.0...v0.2.1
Contributors
dependabot