Skip to content

v0.3.0

Choose a tag to compare

View all tags
@263311487-ux 263311487-ux released this 16 Aug 11:24
· 24 commits to main since this release
v0.3.0
6ecec12

dsh-verify — independent browser acceptance testing for agent deliverables. Agents self-test and pass; real browsers tell the truth.

What's in v0.3.0

  • Multi-spec glob: dsh-verify --spec 'specs/*.json' runs many specs, per-spec HTML reports, aggregated verdict, exit 0 only if all pass
  • expect_navigation: wait for a URL change after a click (multi-page flows)
  • Docker image: pinned to mcr.microsoft.com/playwright:v1.62.1-jammy (Chromium matches Playwright version; ⚠️ built locally, runtime verification pending on a Docker host)
  • Console & network assertions (v0.2): expect_console_errors, expect_network_errors (4xx / failed requests)
  • CI-friendly output (v0.2): --json machine-readable verdict; failed steps printed to stdout
  • Engine self-tests: 7 cases (node:test), including the .dark bug reproduction

The story

A 4-agent web team self-reviewed "no issues found" — but in a real browser the dark-mode toggle did nothing (.dark was toggled in JS, never styled in CSS). Same page, one missing CSS rule: buggy build FAILS 10/11, fixed build PASSES 11/11. Receipts in evidence/.

Install

git clone https://github.com/263311487-ux/dsh-verify
cd dsh-verify && npm install && npx playwright install chromium
npm run demo:buggy   # FAIL — the exact bug
npm run demo:fixed   # PASS

CI self-verifies on every push: engine tests + fixed must PASS + buggy must FAIL.

Assets 2
Loading