Skip to content

v0.2.0 — diagnose and fix failing tests with verified locators

Choose a tag to compare

@trajectiq-ai trajectiq-ai released this 09 Oct 15:53
· 16 commits to main since this release

What's in it

0.2.0 turns this server from run and diagnose into diagnose and fix: a failing locator now
comes back with a replacement that was proven unique on the page, and the fix is applied and
re-verified before it is reported.

Added

  • suggest-fix — matches a broken locator against the DOM at failure, swaps in a Playwright
    locator proven unique on the page, and with apply: true writes it, re-runs the test and reverts
    the edit if it is still red. When nothing on the page plausibly matches it refuses and reports the
    element as missing, instead of patching a test to hide a real bug.
  • probe-script — run a small script against a live page and get structured results back.
  • get-run-status — background runs report progress and the final result, and can be cancelled.
  • analyze-history — ranks flaky, regressed and broken tests from the local run history, groups
    failures that share one cause, and shows a single test's timeline.
  • Two prompts — fix-failing-test and triage-flaky-tests, for clients that surface prompts.
  • Verified locators — inspect-page and validate-selector only report locators that were
    checked on the page to resolve to exactly that element.
  • Agent Skill — the server also ships as a skill under skill/playwright-e2e-mcp.
  • Benchmarks — bench/ measures the token cost of the diagnose-and-fix loop against
    Playwright MCP plus a shell.

Changed

  • The version moves to 0.2.0 in package.json, package-lock.json and server.json; the tag,
    package and server versions are cross-checked before anything is published.
  • README pins and the documented download URL move to v0.2.0.
  • One bug CI caught before this shipped: table cells escaped | without escaping backslashes
    first, so text holding a \ before a pipe could split a Markdown row (CodeQL
    js/incomplete-sanitization, high severity). Backslashes are now escaped first, in both
    analyze-history and diagnose-flaky.

Verified

  • CI green on the release PR and on main: test matrix (3 OS × Node 20/24), e2e on Ubuntu and
    Windows, the .mcpb build + launch simulation, npm pack dry run and npm audit.
  • npm: playwright-e2e-mcp@0.2.0 published with provenance.
  • MCP Registry: io.github.trajectiq-ai/E2E@0.2.0 — active, isLatest.
  • Vercel production deployment of the merge commit succeeded.

Assets

  • playwright-e2e-mcp-0.2.0.mcpb — one-click desktop extension: double-click to install.
  • playwright-e2e-mcp-0.2.0.tgz — the exact tarball npm published (byte-identical).
  • SHA256SUMS.txt — checksums for both.