Skip to content

Conversation

@kyle-ssg
Copy link
Member

@kyle-ssg kyle-ssg commented Jan 20, 2026

  • I have read the Contributing Guide.
  • I have added information to docs/ if required so people know about the feature.
  • I have filled in the "Changes" section below.
  • I have filled in the "How did you test this code" section below.

Changes

Playwright Test Improvements

Faster Tests

  • Inputs are really fast compared to TestCafe
  • Tests are passing in CI around 2m30s vs ~4m

Better Local Development

  • Tests are re-runable via ui (you'll have to run npm run test:teardown before clicking play again)
  • Tests come with videos and clickable traces (these get uploaded from GitHub on failures too)
  • Tests can be ran very quickly and can be repeated (E2E_REPEAT=x) and exit on first failed test (E2E_RETRIES=0)
image

main_large

Added Claude Commands

  • /e2e - Run all tests (OSS + Enterprise)
  • /e2e-oss - Run OSS tests, auto-fix failures, re-run until passing
  • /e2e-ee - Run Enterprise tests, auto-fix failures, re-run until passing
  • /e2e-create - Create a new test following existing patterns

Note: You can have the tests repeat to guarantee no flakiness

  • /e2e 5 → Runs all tests with E2E_REPEAT=5 (runs once, then 5 more times if passing)
  • /e2e-oss 5 → Same for OSS tests only
  • /e2e-ee 5 → Same for enterprise tests only
image

HTML Reports

  • Interactive dashboard with search/filter
  • Test timeline and duration metrics
  • Detailed error messages with stack traces

e.g. this is a downloaded report, we can access reports of failures as well as videos / interactive traces.

image image image image

CI/CD Features

GitHub Integration

  • Sticky PR comments with failure summaries
  • Direct links to ZIP artifacts containing:
  • HTML report
  • Videos of failures
  • Interactive traces
  • Screenshots
  • Automatic artifact cleanup
image image

How did you test this code?

  • No code changes, all e2e refactoring
  • Run local image and keep track of any failures
image

kyle-ssg and others added 30 commits August 5, 2025 16:27
Co-authored-by: Zaimwa9 <wadii.zaim@flagsmith.com>
# Conflicts:
#	frontend/web/components/pages/UserPage.tsx
Fix "Only HTTP(S) protocols are supported" error in teardown by adding
http:// prefix to FLAGSMITH_API_URL in docker-compose.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
kyle-ssg and others added 3 commits February 3, 2026 11:56
The file upload was showing "Playwright HTML Report {URL}" which
duplicates the "View artifacts" link in the notification message.
Remove the upload comment to avoid duplication.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
Remove the temporary environment: staging setting that was used for
testing Slack notifications. The Slack integration is now working.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
kyle-ssg and others added 2 commits February 3, 2026 12:15
Remove the old E2E debugging markup that showed Last Request and Last
Error in error-context.md. Playwright's built-in reporting (traces,
screenshots, network logs) provides better debugging information.

Removed:
- E2E debug divs from web/index.html
- Code writing to e2e-request/e2e-error in _data.js and TryIt.js

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@github-actions github-actions bot added chore and removed chore labels Feb 3, 2026
@kyle-ssg kyle-ssg requested a review from Zaimwa9 February 3, 2026 13:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chore front-end Issue related to the React Front End Dashboard

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants