First release of AgentBench OS — property-based CI gates and zero-config watching for AI coding agents.
Highlights
agentbench watch— auto-detects Claude Code sessions on your machine and raises plain-English alerts when an agent deletes test assertions, disables tests, writes outside the project, runs destructive commands, or reaches out to the network. Zero configuration.- Live watch dashboard —
agentbench ui/agentbench appopen on a live feed of agent activity and alerts. - Eval engine — JSON task DSL, four property oracles (
test_must_pass,file_not_modified,no_network,assertion_exists), trajectory replay,agentbench run/gateCLI. - CI gate — composite GitHub Action to block PRs on agent regressions.
- Desktop apps — standalone builds for Windows, macOS, and Linux attached below.
Everything runs locally; nothing leaves your machine.