Skip to content

perf(ci): move webkit VR shards to Depot runners to fix timeout flakiness#60235

Merged
gantoine merged 1 commit into
masterfrom
mendral/webkit-vr-depot-runners
May 27, 2026
Merged

perf(ci): move webkit VR shards to Depot runners to fix timeout flakiness#60235
gantoine merged 1 commit into
masterfrom
mendral/webkit-vr-depot-runners

Conversation

@mendral-app
Copy link
Copy Markdown
Contributor

@mendral-app mendral-app Bot commented May 27, 2026

Summary

  • Moves only webkit VR shards (4 shards) to depot-ubuntu-latest runners, keeping all 16 chromium shards on ubuntu-latest
  • Addresses the cost concern from perf(ci): move visual regression tests to depot-ubuntu-latest runners #56327 by limiting Depot usage to ~75 vCPU-hours/day (vs 380 for full migration)
  • Eliminates webkit page.goto 30s timeout flakiness (5-9% daily failure rate, 56+ consecutive days, 312+ occurrences)

Context

Webkit page.goto timeouts have been failing at 5-9% daily on GitHub Actions shared runners since April 2. Yesterday spiked to 9.13%. PR #56327 (full Depot migration) has been blocked 23 days by unresolved cost review.

This PR is a scoped-down alternative that targets only the browser with the actual flakiness problem (webkit), minimizing cost while eliminating the reliability issue.

Related: #56327, Insight

Change

# Before
runs-on: ubuntu-latest

# After (conditional on browser matrix)
runs-on: ${{ matrix.browser == 'webkit' && 'depot-ubuntu-latest' || 'ubuntu-latest' }}

Webkit shards only run on master pushes (not PRs), so this change has zero cost impact on PR CI runs.


Note

Created by Mendral. Tag @mendral-app with feedback or questions.

Webkit page.goto timeouts persist at 5-9% on shared GitHub Actions
runners due to CPU/memory contention (56+ consecutive days, 312+
occurrences). This scoped change moves only the 4 webkit shards to
Depot dedicated runners (~75 vCPU-hours/day) while keeping the 16
chromium shards on ubuntu-latest to minimize cost impact.

Addresses cost concerns raised in #56327 by limiting Depot usage to
the browser with the actual flakiness problem.
@mendral-app mendral-app Bot changed the title Unblock PR #56327 immediately — 14 days stale, spike worsening perf(ci): move webkit VR shards to Depot runners to fix timeout flakiness May 27, 2026
@mendral-app mendral-app Bot marked this pull request as ready for review May 27, 2026 12:28
@assign-reviewers-posthog assign-reviewers-posthog Bot requested a review from a team May 27, 2026 12:29
@greptile-apps
Copy link
Copy Markdown
Contributor

greptile-apps Bot commented May 27, 2026

Reviews (1): Last reviewed commit: "perf(ci): move webkit VR shards to depot..." | Re-trigger Greptile

@gantoine gantoine merged commit 100065a into master May 27, 2026
168 of 169 checks passed
@gantoine gantoine deleted the mendral/webkit-vr-depot-runners branch May 27, 2026 14:06
@deployment-status-posthog
Copy link
Copy Markdown

deployment-status-posthog Bot commented May 27, 2026

Deploy status

Environment Status Deployed At Workflow
dev ✅ Deployed 2026-05-27 14:33 UTC Run
prod-us ✅ Deployed 2026-05-27 15:01 UTC Run
prod-eu ✅ Deployed 2026-05-27 15:07 UTC Run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants