e2e-skills 2.0.0

e2e-skills 2.0.0

Four Agent Skills for Playwright and Cypress E2E work: e2e-reviewer, playwright-test-generator, playwright-debugger, cypress-debugger.

Installs, catalog severities, and scanner flags are unchanged. No existing pattern ID changed, and no user action is required to upgrade.

What changed

• Evidence system rebuilt. Preregistered reviewer holdouts v8-v21, schema-enforced output, usage capture, the real-code fixpair-v1 corpus, and a developer-side Lean model of the severity contract. See benchmarks/STATUS.md.
• Reviewer. Findings now carry the pattern ID in every heading and instance severities for #1 and #23. New #8c (under #8): a Playwright matcher that is read but never called, or a bare expect(x);, runs no assertion. The scanner reports both shapes as confirmed [P0].
• Scanner. No longer exits incomplete when the optional #13 lookup fails.
• Security. Tier 2 now runs ast-grep with a skill-owned, rule-free sgconfig.yml (--config) from a private temporary directory, so a reviewed repository can no longer supply an sgconfig.yml that the host binary would load. Findings, flags, and exit codes are unchanged.

What the evidence does and does not show

• Reviewer holdout v19 passed its frozen full-versus-no-skill gate (stable F1 difference +0.571, 95% CI +0.411 to +0.738). It measured the pre-release 2.0.0 candidate, not the shipped reviewer, which later received small changes that no holdout has measured. It reruns v18's corpus, so it is confirmation, not fresh independent evidence. The corpus is single-host and model-authored.
• Generator v8 passed on its public pool (markup-refactor survival 0.954 versus 0.435, 6.74x generation time). Fault-detection improvement was not shown. The shipped generator text adds changes v8 did not measure.
• Debugger skills: no measured lift over a taxonomy-free prompt on real failures. The debugger text is unchanged in this release.
• The measurements are public development evidence, not sealed release results.

Tag note

An earlier v2.0.0 tag pointed at 8ec2cb8, a 2026-09-30 scanner snapshot that no release or GitHub Release ever referenced. On 2026-10-10 the tag was re-pointed to 6ded5e9, the actual 2.0.0 release commit.

If you fetched the old tag, delete it locally and fetch again:

git tag -d v2.0.0
git fetch origin tag v2.0.0

Repository size

The repository is about 34 MB to clone and about 180 MB checked out; most of it is benchmarks/ run records. The four skills themselves are the skills/ directories (about 2 MB). Use git clone --depth 1 if you only need the current tree.

Full details: CHANGELOG.