e2e-skills 2.0.1

e2e-skills 2.0.1

Four Agent Skills for Playwright and Cypress E2E work: e2e-reviewer, playwright-test-generator, playwright-debugger, cypress-debugger.

A debugger-only patch. Apart from the version field, the reviewer, generator, Cypress debugger, scanner, installs, pattern IDs, F-codes, and every existing safety rule are unchanged, and no rule is weakened. No user action is required to upgrade.

What changed

• playwright-debugger states a root cause only as far as the artifact evidences it. Anything beyond that is marked as a hypothesis with the missing evidence named. Without the spec source it describes the fix in prose instead of inventing selectors, endpoints, or line numbers.
• The report-reader command is one line with a literal absolute --project-root. The previous PROJECT_ROOT=$(...) form could not be matched by Claude Code's command check, so a non-interactive run spent one or two turns on rejected attempts. The spec source is read only from a user-supplied path or a relative, non-traversing regular file named like a test file, so a report cannot point it at .env or other config files.
• Docs and repository. Per-skill evidence paragraphs now describe the 2.0.1 evidence. Raw benchmark run artifacts (23 folders, 2,152 files, about 51 MB) moved to the voidmatcha/e2e-skills-benchmarks Hugging Face dataset, pinned to one revision in benchmarks/external-evidence.json and restorable byte-identically with scripts/dev/fetch-benchmark-evidence.sh (--dry-run shows the plan). Protocols, results, and runners stay in the repository. Ten reviewed scanner false positives are suppressed by exact path.

Evidence, with its limits

On four real OpenMetadata CI reports (12 runs per arm), unsupported claims per answer fell from 5.4 to 2.9 and answers that said the cause is not in the report rose from 58% to 100%. Strict cause agreement did not change (3 of 12 in every round), so this does not show better diagnosis accuracy. The candidate was tuned on those same four reports, so this is a development signal, not a held-out result. Details: debugger-dev-comparison-v1.

Full details are in the CHANGELOG.