Skip to content

agentest v3.3.1 (review fixes)

Choose a tag to compare

@srpadmanabhuni srpadmanabhuni released this 02 Nov 06:31
· 149 commits to main since this release
d3819d1

Review-fix release after an external correctness review of v3.3.0 and dataset v1.3.1. Rules and verdicts are unchanged from v3.3.0.

  • Fix: catalog/checklist-110.jsonl regenerated from dataset v1.3.1 (byte-identical to the Hub file). It had carried the pre-v1.2.1 control_refs the dataset retracted on all 110 rows. catalog_revision is now v1.3.1.
  • CI: the catalogue pin check now covers the jsonl (sha256), cross-checks control_refs against every pack CSV, and rejects retracted tokens.
  • CI: new RELEASE file is the single source of truth for version strings; scripts/check_versions.py fails CI on drift (pyproject, __version__, install pins in README/docs, README coverage rows vs docs/COVERAGE.md, catalog/VERSION, citation DOI) and --bump rewrites them.
  • Docs: stale install pins fixed; README coverage table current; legacy catalog/t1_001.yaml archived to docs/history/.
  • Citation: README and CITATION.cff cite the checklist's Zenodo all-versions concept DOI 10.5281/zenodo.23597877.

Install: pip install "agentest @ git+https://github.com/srpadmanabhuni/agentest.git@v3.3.1"

PRs: #12, #13, #14.