APIFlow-Bench 1.0 — first public release of the agentic API-workflow benchmark.
- Code + frozen task bank: the Inspect AI eval harness, the frozen 1.0 bank (467 tasks across 13 mock-API worlds), scoring, and the leaderboard site builder — see the README and CHANGELOG.
- Leaderboard (19-model panel, 5 epochs): https://www.postman.com/ai/apiflow-leaderboard/
- Raw trial transcripts (all 44,362 trials): https://github.com/postmanlabs/apiflow-bench-transcripts — per-model
tar.gzbundles are attached to thetranscripts-<model>releases in this repository.
Release provenance (bank content sha256, epoch count, panel configs) is pinned in registry.json.