dsh-doublecheck: delivery quality gate (/gate) for DeepSeek Harness #2481
Replies: 4 comments
|
Nice — this is the evidence-gate layer. Complementary angle if useful: we built dsh-verify (browser acceptance testing for agent deliverables) after our 4-agent web team self-reviewed a demo as "no issues found" while the dark-mode toggle literally did nothing in a real browser — the .dark CSS rule was missing. Checklist gates and agent self-tests share the agent blind spot; an independent real-browser pass does not. dsh-verify takes a JSON spec (goto/click/expect_text/capture_style), drives headless Chromium, and returns an HTML report plus an exit code for CI. Buggy and fixed builds sit side by side in the repo as proof. It is now installable as a DSH plugin (dsh plugin add dsh-verify). Different layer from /gate: /gate decides, dsh-verify measures what the user actually experiences. |
|
Thanks for the pointer — dsh-verify's browser-acceptance angle is exactly the complementary layer to /gate's evidence discipline (self-asserted evidence vs. a real browser telling the truth). Bookmarked for the doublecheck roadmap; happy to cross-link if you have a demo session where both run together. |
|
@PerryLink thanks for the kind words — cross-link sounds great. Concretely from our side:
|
|
@PerryLink the joint guide is up — dsh-doublecheck × dsh-verify: the honest-delivery pipeline: https://github.com/263311487-ux/dsh-verify/blob/main/docs/doublecheck-gate.md It covers: the division of labor (your /gate keeps the evidence honest, dsh-verify keeps the browser honest), install + one-pipeline usage, a joint report template for PRs, and live proof from this repo: the 4-agent team said "no issues found", the gate was green, and the real browser still caught the missing .dark CSS rule (FAIL 10/11, computed style never changed). Open to your review — happy to fold in corrections, and to cross-link it from your README if useful. |
Uh oh!
There was an error while loading. Please reload this page.
dsh-doublecheck — the engineering-discipline bundle for DeepSeek Harness: v0.7.0 ships the delivery quality gate that folds a session's durable evidence into one deliverable / rework required decision.
What it solves / 解决什么问题
/gate status|run|config: a four-phase checklist — requirements interrogation (key questions against the committed spec), test evidence (latest run color + optional coverage threshold), implementation consistency (local forked reviewer maps diffs to spec dimensions), and the review conclusion.gate-report.md; durabledoublecheck/gatesession event, audit-safe (counts/ids/verdicts only, secrets redacted).Install / 安装
Links / 链接
Apache-2.0 · issues and PRs welcome (中英文都欢迎).
All reactions