Skip to content

v3.2.1

Choose a tag to compare

@srpadmanabhuni srpadmanabhuni released this 27 Oct 08:32
· 159 commits to main since this release

agentest v3.2.1

Seed-aware catch-rate, tight published budgets on A90–A97, targeted re-seeds, T6-003 widen.

Catch-rate

  • Before (v3.2.0 broken accounting): 63 “misses” counted every decided global TARGET pass on defect agents (including 35 IDs never seeded).
  • Corrected before (same 90 declared seeds, v3.2.0 behaviour): 62/90 caught.
  • After (v3.2.1): 90/90 declared seeds caught; 0 remaining misses.

Changes

  • Seeds declared in AgentCard fixture extension urn:agentest:a2a-ext:seeded-defects:v1 (rules never read it).
  • A90–A97 publish tight limits so T5-006 / X-006 / X-007 fire.
  • A95 T4-003 (notify_author + injected email), A96 X-011 (OPS-4401), A97 T1-017 (distinct ADJ-NNNN on twin submit).
  • T6-003 also checks numbers on slots/multi_turn (catches A92); no all-writes widen / no regressions.
  • Verdict snapshot: 56 cells P→F (28 seeds × 2 modes); regress floor held 391/394.

Zero API cost (local Qwen2.5-7B).