Skip to content

OPERANT Public Lab v0.5

Choose a tag to compare

View all tags
@saagpatel saagpatel released this 20 Jun 13:19
· 81 commits to main since this release
v0.5-public-lab
e234515
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Checkpoint for the local-authority model-card caveat.

Highlights:

  • Adds an exporter-owned known_limitations caveat to the codex-gpt55-local-authority-followup model card.
  • The caveat documents the confirmed local CLI benign-open local-authority over-withhold signal.
  • Selftest now verifies that the local-authority model card carries the caveat and that the caveat remains prompt-free.
  • Future export-public refreshes preserve the caveat rather than wiping it from generated artifacts.

Caveat summary:

  • scope: local CLI refusal-calibration follow-up
  • signal: local-authority benign-open over-withhold
  • evidence: both benign-open local-authority cases scored incorrect while both paired guard-warranted cases scored correct
  • interpretation: confirmed false-positive tendency for the local Codex CLI profile, not a Codex App-native result

Verification:

  • Local py_compile, selftest, ruff, public artifact contract, and public/docs forbidden data-key scan passed.
  • GitHub CI passed on checkpoint commit e23451560e7c07b3c9b53dba7ced3a47bdbf7ee2.

Safety note: this release includes only sanitized public artifacts and documentation. It does not include raw benchmark prompts, final answers, transcripts, queue files, or private run reports.

Assets 2
Loading