Skip to content

Releases: casualstack/agentbench-os

AgentBench OS v0.1.0

Choose a tag to compare

@sudocjdev sudocjdev released this 09 Jul 06:22

First release of AgentBench OS — property-based CI gates and zero-config watching for AI coding agents.

Highlights

  • agentbench watch — auto-detects Claude Code sessions on your machine and raises plain-English alerts when an agent deletes test assertions, disables tests, writes outside the project, runs destructive commands, or reaches out to the network. Zero configuration.
  • Live watch dashboardagentbench ui / agentbench app open on a live feed of agent activity and alerts.
  • Eval engine — JSON task DSL, four property oracles (test_must_pass, file_not_modified, no_network, assertion_exists), trajectory replay, agentbench run / gate CLI.
  • CI gate — composite GitHub Action to block PRs on agent regressions.
  • Desktop apps — standalone builds for Windows, macOS, and Linux attached below.

Everything runs locally; nothing leaves your machine.