Skip to content

v5.0.2 — 3 More Codex Adversarial Findings

Choose a tag to compare

View all tags
@raphaelchristi raphaelchristi released this 03 Apr 03:52
· 101 commits to main since this release
v5.0.2
056a7dd

What's Fixed

3 new findings from second Codex adversarial review (GPT-5.4) — different issues from the first run.

  • Canary accepts answer key — Agents returning {"answer": ...} instead of {"output": ...} now pass the canary. Same contract as has_output and token_efficiency evaluators.
  • Constraint gate resolves project_dir — Both worktree and baseline paths are now scoped to the project subdirectory. Previously inspected repo root for subdirectory projects.
  • Removed --passWithNoTests from npm test — Jest-specific flag that broke vitest, mocha, tap, and custom test scripts. Now runs npm test as-is.

Codex Review Score

Two adversarial reviews found 9 total issues (6 in v1, 3 in v2). All fixed. The non-determinism of LLM reviews means multiple passes catch more — worth doing.

🤖 Claude (author) + Codex/GPT-5.4 (reviewer)

Assets 2
Loading