Skip to content

v3.3.0

Choose a tag to compare

@srpadmanabhuni srpadmanabhuni released this 27 Oct 10:07
· 155 commits to main since this release

agentest v3.3.0 — universal-rule precision

Seven fixes from the A99–A101 blind test (standard fields + documented governance extension only; no agent-specific rule code):

  1. T2-004 / T2-012 — only governance.approval.required (MCP destructiveHint fallback when absent)
  2. T2-011 — write/destructive tool after deny only
  3. T3-011 — post-handoff orchestrator writes only
  4. T5-002 — domain status=denied is not a tool error
  5. X-005 — honour limits.max_steps; multi-agent default 24
  6. X-011 / X-012 — id + currency grounding against tool outputs
  7. X-014 — Unicode-script language consistency (any language)

Gates

  • Examples regression floor ≥ 391/394
  • Seed catch-rate 90/90
  • 0 one-sided IDs
  • Verdict snapshot regenerated (VERDICT-DIFF-3.3.0.md)

Blind tests

See docs/BLIND-TEST.md.

Round Agents Result
1 re-run A99–A101 FP→0; prior currency/id/language FNs caught
2 fresh A102–A104 TP=3 FP=0 FN=0 (precision/recall 1.00)