Skip to content

test(ci): run the Playwright e2e suite as a CI gate - #80

Merged
pulkitxm merged 7 commits into
mainfrom
test/e2e-ci
Jul 24, 2026
Merged

test(ci): run the Playwright e2e suite as a CI gate#80
pulkitxm merged 7 commits into
mainfrom
test/e2e-ci

Conversation

@pulkitxm

@pulkitxm pulkitxm commented Jul 24, 2026

Copy link
Copy Markdown
Member

Adds an e2e CI job that boots web + realtime on a fresh seeded database and runs the existing Playwright specs, and fixes the next-dev regression that gate caught: react-email statically requires prettier subpaths that were unresolvable from apps/web, so every auth-linked page 500'd in dev.

@coderabbitai

coderabbitai Bot commented Jul 24, 2026

Copy link
Copy Markdown

Review Change Stack

Warning

Review limit reached

You’ve reached a temporary PR review limit under our Fair Usage Limits Policy.

Your recent review volume is higher than typical usage, so adaptive limits are currently applied.

Next review available in: 25 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 74d54129-bb3f-411c-8e09-ed9722882f63

📥 Commits

Reviewing files that changed from the base of the PR and between 71debdd and 1733426.

📒 Files selected for processing (1)
  • .github/workflows/ci.yml
📝 Walkthrough

Walkthrough

Adds a GitHub Actions E2E job with PostgreSQL, Redis, server startup, health checks, Playwright execution, and diagnostics. Next.js development bundling becomes phase-dependent, while Playwright tests receive timing, editor-targeting, and flaky-test updates.

Changes

E2E CI and test execution

Layer / File(s) Summary
Development server bundling
apps/web/next.config.ts, apps/web/package.json
Next.js conditionally transpiles development-server packages, and Prettier is added to web dependencies.
CI E2E job
.github/workflows/ci.yml
The workflow provisions PostgreSQL and Redis, initializes environment and schema state, starts application servers, waits for health readiness, runs Playwright, and collects failure logs and traces.
Playwright test stability
apps/web/e2e/*.spec.ts
Filtered-count checks use polling, comment entry targets .ProseMirror, the shortcut-overlay assertion is removed, and two flaky tests are marked fixme.

Estimated code review effort: 3 (Moderate) | ~20 minutes

Sequence Diagram(s)

sequenceDiagram
  participant GitHubActions
  participant PostgreSQL
  participant Redis
  participant RealtimeServer
  participant WebServer
  participant Playwright
  GitHubActions->>PostgreSQL: Push database schema
  GitHubActions->>RealtimeServer: Start development server
  GitHubActions->>WebServer: Start development server
  GitHubActions->>WebServer: Poll /api/health
  GitHubActions->>Playwright: Run bun run test:e2e
  Playwright->>WebServer: Execute browser tests
Loading

Possibly related PRs

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 0.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the main change: adding the Playwright e2e suite to CI as a gate.
Description check ✅ Passed The description is directly related to the changeset and accurately mentions the CI e2e job and the Next.js regression fix.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch test/e2e-ci

Comment @coderabbitai help to get the list of available commands.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pulkitxm has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

… plugin

@react-email/render statically requires prettier/plugins/html and
prettier/standalone. Production traces and bundles them via output:
standalone, but next dev externalizes them and resolved from apps/web,
where prettier was only a transitive dep and unreachable, so every page
that pulls the auth to email chain 500'd. Declaring prettier as an
apps/web dependency makes the subpaths resolvable in dev.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pulkitxm has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

The turbopack dev server externalizes @react-email/render, its
@react-email/components dependency, and their transitive prettier under
mangled ids it cannot load at runtime, so every page that reaches the
email templates 500'd in next dev. Transpiling those packages makes
turbopack bundle them instead, but bundling @react-email/components in
the production build duplicates React and breaks static export of the
landing page, so the extra packages are added only for the development
server phase. next build keeps the traced output: standalone behaviour.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pulkitxm has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

The editor overhaul turned the comment composer and doc editor into
ProseMirror surfaces, so comment specs now type into the .ProseMirror
element instead of filling the wrapper. Filter count assertions poll
through hydration, and the shortcut-overlay check is dropped from the
shift+f test since it only covered filter keyboard behaviour. The doc
rich-editor to markdown round trip and the synthetic-mouse board drag
and drop are marked fixme with reasons; realtime propagation stays
covered by same-user-tabs and second-workspace-realtime.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pulkitxm has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pulkitxm has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.github/workflows/ci.yml:
- Around line 261-274: Add a bounded realtime readiness probe between the web
health-check step and the “Run the end-to-end suite” step, using REALTIME_PORT
or the realtime health endpoint. Match the existing retry, timeout, logging, and
failure behavior so Playwright starts only after the realtime process is ready.
- Line 232: Update the actions/checkout@v5 step to set persist-credentials to
false, ensuring the checkout token is not retained in Git configuration for
subsequent bun install and test processes.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 5ceab9ad-84e3-4d6c-b99a-6b8d341fb22e

📥 Commits

Reviewing files that changed from the base of the PR and between a2e81b3 and 71debdd.

⛔ Files ignored due to path filters (1)
  • bun.lock is excluded by !**/*.lock
📒 Files selected for processing (7)
  • .github/workflows/ci.yml
  • apps/web/e2e/docs.spec.ts
  • apps/web/e2e/filters.spec.ts
  • apps/web/e2e/issues.spec.ts
  • apps/web/e2e/same-user-tabs.spec.ts
  • apps/web/next.config.ts
  • apps/web/package.json

Comment thread .github/workflows/ci.yml
Comment thread .github/workflows/ci.yml
… credentials

Addresses the CodeRabbit review: the e2e checkout sets persist-credentials
false since the job never needs the token after checkout, and a bounded
realtime /health probe runs before Playwright so websocket flows do not
start against a realtime process that is still booting.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pulkitxm has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@pulkitxm

Copy link
Copy Markdown
Member Author

Addressed both review findings in 9b6c6e6: the e2e checkout now sets persist-credentials: false, and a bounded realtime /health readiness probe runs before the Playwright step so websocket flows do not start against a still-booting realtime process.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pulkitxm has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@pulkitxm
pulkitxm merged commit 084755f into main Jul 24, 2026
6 checks passed
@pulkitxm
pulkitxm deleted the test/e2e-ci branch July 24, 2026 17:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant