Skip to content

v2.3.0 — run --json failure contract (ears for coding agents)

Choose a tag to compare

@darrenapfel darrenapfel released this 01 Jun 20:26
· 31 commits to main since this release
1c897e3

soundcheck-cli 2.3.0

npm install -g soundcheck-cli     # the command is `soundcheck`

The agent-first release. A coding agent can't hear — so it converges on green text tests while the spoken agent is still wrong. run --json gives it the failure as machine-readable evidence it can patch from.

Added

  • run --json — a machine-readable failure contract for coding agents and CI. soundcheck run … --json emits a stable, schema-versioned JSON document instead of making an agent scrape the HTML report or stdout. Per scenario: the gate results, the trace-driven diagnosis (the same evidence + remediation hint the tune fixer reads — patch from evidence, not gate names), oracleHeard (what the STT oracle heard), the optional judge verdict, and a reproduce command to re-run just that scenario; the run summary adds a deduped failingGates taxonomy. Bare --json writes JSON to stdout and routes all human output to stderr (stdout stays parseable); --json <file> writes a file and keeps the human output. Exit code unchanged (0 iff every gate passed).

    soundcheck run scenarios --aut ./agent.ts --replay --json | jq .summary

Changed

  • Docs lead with the published install. The guide, command reference, tutorial, and coding-agent skill present npm install -g soundcheck-cli (the command stays soundcheck) as the primary install, with the source checkout kept for the bundled examples and contributing.

Full notes: CHANGELOG.

🤖 Generated with Claude Code