Skip to content

[ci] Skip community world E2E tests on main#1783

Merged
VaguelySerious merged 1 commit intomainfrom
peter/skip-community-worlds-ci
Apr 17, 2026
Merged

[ci] Skip community world E2E tests on main#1783
VaguelySerious merged 1 commit intomainfrom
peter/skip-community-worlds-ci

Conversation

@VaguelySerious
Copy link
Copy Markdown
Member

@VaguelySerious VaguelySerious commented Apr 16, 2026

Until community worlds support the new stream interface, AND we have a way of detecting that support somehow, community worlds won't run on v5, so we shouldn't require the checks to pass (or run them)

The world-vercel queue transport was moved to CBOR (#1627) and the
community worlds (turso, mongodb, redis) in mizzle-dev/workflow-worlds
still target the older spec version and JSON queue transport. Disable
the e2e-community jobs on main and drop them from e2e-required-check
until the community worlds ship CBOR-compatible releases. Community
worlds continue to run in CI on the stable branch.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@changeset-bot
Copy link
Copy Markdown

changeset-bot bot commented Apr 16, 2026

🦋 Changeset detected

Latest commit: 474d66c

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Apr 16, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 16, 2026 10:09pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 16, 2026 10:09pm
example-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-express-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 16, 2026 10:09pm
workflow-swc-playground Ready Ready Preview, Comment Apr 16, 2026 10:09pm
workflow-web Ready Ready Preview, Comment Apr 16, 2026 10:09pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

🧪 E2E Test Results

All tests passed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 923 0 67 990
✅ 💻 Local Development 994 0 86 1080
✅ 📦 Local Production 994 0 86 1080
✅ 🐘 Local Postgres 994 0 86 1080
✅ 🪟 Windows 90 0 0 90
✅ 📋 Other 252 0 18 270
Total 4247 0 343 4590

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 83 0 7
✅ example 83 0 7
✅ express 83 0 7
✅ fastify 83 0 7
✅ hono 83 0 7
✅ nextjs-turbopack 88 0 2
✅ nextjs-webpack 88 0 2
✅ nitro 83 0 7
✅ nuxt 83 0 7
✅ sveltekit 83 0 7
✅ vite 83 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 84 0 6
✅ express-stable 84 0 6
✅ fastify-stable 84 0 6
✅ hono-stable 84 0 6
✅ nextjs-turbopack-canary 71 0 19
✅ nextjs-turbopack-stable 90 0 0
✅ nextjs-webpack-canary 71 0 19
✅ nextjs-webpack-stable 90 0 0
✅ nitro-stable 84 0 6
✅ nuxt-stable 84 0 6
✅ sveltekit-stable 84 0 6
✅ vite-stable 84 0 6
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 84 0 6
✅ express-stable 84 0 6
✅ fastify-stable 84 0 6
✅ hono-stable 84 0 6
✅ nextjs-turbopack-canary 71 0 19
✅ nextjs-turbopack-stable 90 0 0
✅ nextjs-webpack-canary 71 0 19
✅ nextjs-webpack-stable 90 0 0
✅ nitro-stable 84 0 6
✅ nuxt-stable 84 0 6
✅ sveltekit-stable 84 0 6
✅ vite-stable 84 0 6
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 84 0 6
✅ express-stable 84 0 6
✅ fastify-stable 84 0 6
✅ hono-stable 84 0 6
✅ nextjs-turbopack-canary 71 0 19
✅ nextjs-turbopack-stable 90 0 0
✅ nextjs-webpack-canary 71 0 19
✅ nextjs-webpack-stable 90 0 0
✅ nitro-stable 84 0 6
✅ nuxt-stable 84 0 6
✅ sveltekit-stable 84 0 6
✅ vite-stable 84 0 6
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 90 0 0
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 84 0 6
✅ e2e-local-postgres-nest-stable 84 0 6
✅ e2e-local-prod-nest-stable 84 0 6

📋 View full workflow run

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.037s (-16.5% 🟢) 1.005s (~) 0.968s 10 1.00x
💻 Local Nitro 0.042s (-2.1%) 1.005s (~) 0.963s 10 1.14x
💻 Local Next.js (Turbopack) 0.046s 1.006s 0.960s 10 1.24x
🐘 Postgres Express 0.059s (+1.9%) 1.010s (~) 0.951s 10 1.60x
🐘 Postgres Next.js (Turbopack) 0.060s 1.010s 0.950s 10 1.63x
🐘 Postgres Nitro 0.061s (-36.2% 🟢) 1.011s (-3.0%) 0.951s 10 1.64x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 0.266s (+5.8% 🔺) 2.291s (-1.8%) 2.025s 10 1.00x
▲ Vercel Nitro 0.308s (-24.9% 🟢) 2.131s (-15.1% 🟢) 1.823s 10 1.16x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 1.088s (-3.3%) 2.005s (~) 0.917s 10 1.00x
💻 Local Next.js (Turbopack) 1.112s 2.006s 0.894s 10 1.02x
💻 Local Nitro 1.127s (~) 2.005s (~) 0.878s 10 1.04x
🐘 Postgres Express 1.145s (~) 2.010s (~) 0.865s 10 1.05x
🐘 Postgres Nitro 1.147s (+0.6%) 2.010s (~) 0.864s 10 1.05x
🐘 Postgres Next.js (Turbopack) 1.151s 2.010s 0.859s 10 1.06x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.939s (-4.7%) 3.686s (-3.8%) 1.747s 10 1.00x
▲ Vercel Nitro 2.030s (-47.8% 🟢) 4.337s (-26.6% 🟢) 2.307s 10 1.05x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 10.622s (-2.7%) 11.022s (~) 0.400s 3 1.00x
💻 Local Next.js (Turbopack) 10.777s 11.022s 0.244s 3 1.01x
🐘 Postgres Express 10.885s (-0.7%) 11.024s (~) 0.139s 3 1.02x
🐘 Postgres Next.js (Turbopack) 10.904s 11.018s 0.114s 3 1.03x
🐘 Postgres Nitro 10.922s (~) 11.022s (~) 0.099s 3 1.03x
💻 Local Nitro 10.936s (~) 11.025s (~) 0.089s 3 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 17.334s (-27.0% 🟢) 19.034s (-24.2% 🟢) 1.700s 2 1.00x
▲ Vercel Next.js (Turbopack) 17.873s (+3.2%) 19.496s (~) 1.623s 2 1.03x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 14.200s (-5.1% 🟢) 15.030s (~) 0.830s 4 1.00x
🐘 Postgres Express 14.548s (~) 15.021s (~) 0.472s 4 1.02x
🐘 Postgres Nitro 14.559s (~) 15.027s (~) 0.468s 4 1.03x
💻 Local Next.js (Turbopack) 14.627s 15.028s 0.402s 4 1.03x
🐘 Postgres Next.js (Turbopack) 14.683s 15.025s 0.342s 4 1.03x
💻 Local Nitro 14.984s (-0.5%) 15.028s (-6.3% 🟢) 0.044s 4 1.06x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 44.834s (-30.4% 🟢) 46.627s (-30.0% 🟢) 1.793s 2 1.00x
▲ Vercel Next.js (Turbopack) 54.334s (+3.4%) 55.789s (+2.2%) 1.455s 2 1.21x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 14.016s (~) 14.595s (~) 0.579s 7 1.00x
🐘 Postgres Nitro 14.031s (~) 14.449s (+1.0%) 0.418s 7 1.00x
🐘 Postgres Next.js (Turbopack) 14.386s 15.192s 0.805s 6 1.03x
💻 Local Express 14.803s (-10.8% 🟢) 15.029s (-11.8% 🟢) 0.226s 6 1.06x
💻 Local Next.js (Turbopack) 16.152s 17.031s 0.878s 6 1.15x
💻 Local Nitro 16.688s (-0.6%) 17.031s (~) 0.343s 6 1.19x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 67.254s (-82.9% 🟢) 69.066s (-82.5% 🟢) 1.812s 2 1.00x
▲ Vercel Nitro 134.134s (-68.3% 🟢) 136.028s (-68.0% 🟢) 1.894s 1 1.99x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.236s 2.010s 0.774s 15 1.00x
🐘 Postgres Nitro 1.267s (-0.6%) 2.010s (~) 0.743s 15 1.02x
🐘 Postgres Express 1.270s (+0.7%) 2.010s (~) 0.740s 15 1.03x
💻 Local Express 1.465s (-1.6%) 2.006s (~) 0.540s 15 1.19x
💻 Local Next.js (Turbopack) 1.511s 2.005s 0.494s 15 1.22x
💻 Local Nitro 1.540s (-5.6% 🟢) 2.005s (-3.3%) 0.465s 15 1.25x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.730s (-19.7% 🟢) 4.217s (-14.5% 🟢) 1.487s 8 1.00x
▲ Vercel Nitro 6.491s (+130.3% 🔺) 7.937s (+83.6% 🔺) 1.446s 4 2.38x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 2.361s (~) 3.010s (~) 0.649s 10 1.00x
🐘 Postgres Express 2.402s (+1.8%) 3.010s (~) 0.607s 10 1.02x
🐘 Postgres Next.js (Turbopack) 2.407s 3.010s 0.603s 10 1.02x
💻 Local Express 2.691s (-8.9% 🟢) 3.108s (-10.0% 🟢) 0.416s 10 1.14x
💻 Local Next.js (Turbopack) 2.871s 3.109s 0.238s 10 1.22x
💻 Local Nitro 3.010s (-4.2%) 3.676s (-5.4% 🟢) 0.666s 9 1.27x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 11.320s (+59.4% 🔺) 13.449s (+51.0% 🔺) 2.129s 3 1.00x
▲ Vercel Nitro 12.883s (+217.9% 🔺) 14.776s (+149.6% 🔺) 1.893s 3 1.14x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.458s (-0.6%) 4.010s (~) 0.553s 8 1.00x
🐘 Postgres Express 3.489s (~) 4.013s (~) 0.524s 8 1.01x
🐘 Postgres Next.js (Turbopack) 3.677s 4.011s 0.334s 8 1.06x
💻 Local Express 6.579s (-21.1% 🟢) 7.017s (-22.3% 🟢) 0.438s 5 1.90x
💻 Local Next.js (Turbopack) 7.552s 8.268s 0.716s 4 2.18x
💻 Local Nitro 8.492s (+1.7%) 9.021s (~) 0.530s 4 2.46x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 6.387s (+81.2% 🔺) 7.628s (+37.8% 🔺) 1.241s 4 1.00x
▲ Vercel Next.js (Turbopack) 10.307s (+15.6% 🔺) 11.979s (+9.3% 🔺) 1.673s 3 1.61x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.228s 2.010s 0.782s 15 1.00x
🐘 Postgres Nitro 1.273s (+1.3%) 2.009s (~) 0.736s 15 1.04x
🐘 Postgres Express 1.279s (+1.7%) 2.008s (~) 0.729s 15 1.04x
💻 Local Express 1.461s (-22.8% 🟢) 2.006s (-15.1% 🟢) 0.545s 15 1.19x
💻 Local Next.js (Turbopack) 1.530s 2.006s 0.476s 15 1.25x
💻 Local Nitro 1.546s (-17.1% 🟢) 2.006s (-14.3% 🟢) 0.461s 15 1.26x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 4.077s (+65.8% 🔺) 5.795s (+39.0% 🔺) 1.718s 6 1.00x
▲ Vercel Next.js (Turbopack) 4.287s (+46.3% 🔺) 6.010s (+29.5% 🔺) 1.723s 6 1.05x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 2.332s (~) 3.008s (~) 0.677s 10 1.00x
🐘 Postgres Express 2.342s (~) 3.010s (~) 0.668s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.403s 3.008s 0.605s 10 1.03x
💻 Local Express 2.653s (-15.3% 🟢) 3.009s (-20.0% 🟢) 0.356s 10 1.14x
💻 Local Next.js (Turbopack) 2.885s 3.564s 0.679s 9 1.24x
💻 Local Nitro 3.017s (-1.6%) 3.885s (~) 0.868s 8 1.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.684s (-17.0% 🟢) 4.176s (-17.8% 🟢) 1.492s 8 1.00x
▲ Vercel Next.js (Turbopack) 2.938s (-6.5% 🟢) 4.892s (+8.2% 🔺) 1.954s 7 1.09x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.484s (~) 4.009s (~) 0.525s 8 1.00x
🐘 Postgres Express 3.498s (~) 4.009s (~) 0.511s 8 1.00x
🐘 Postgres Next.js (Turbopack) 3.691s 4.014s 0.323s 8 1.06x
💻 Local Express 7.194s (-18.3% 🟢) 7.765s (-16.3% 🟢) 0.572s 4 2.06x
💻 Local Next.js (Turbopack) 7.993s 8.526s 0.534s 4 2.29x
💻 Local Nitro 8.874s (-3.0%) 9.271s (-7.5% 🟢) 0.397s 4 2.55x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.072s (-39.7% 🟢) 4.526s (-33.6% 🟢) 1.454s 7 1.00x
▲ Vercel Next.js (Turbopack) 5.338s (-21.0% 🟢) 7.541s (-11.7% 🟢) 2.203s 4 1.74x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.671s (-31.8% 🟢) 1.004s (-6.7% 🟢) 0.333s 60 1.00x
🐘 Postgres Express 0.814s (-3.0%) 1.006s (-1.7%) 0.192s 60 1.21x
🐘 Postgres Next.js (Turbopack) 0.820s 1.024s 0.203s 59 1.22x
🐘 Postgres Nitro 0.827s (+0.7%) 1.006s (~) 0.179s 60 1.23x
💻 Local Next.js (Turbopack) 0.859s 1.004s 0.146s 60 1.28x
💻 Local Nitro 0.989s (+0.8%) 1.137s (+3.9%) 0.148s 53 1.47x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 9.579s (-34.0% 🟢) 11.238s (-30.1% 🟢) 1.659s 6 1.00x
▲ Vercel Nitro 10.837s (-50.9% 🟢) 12.976s (-46.0% 🟢) 2.138s 5 1.13x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.942s (-1.8%) 2.175s (-3.7%) 0.233s 42 1.00x
🐘 Postgres Nitro 1.988s (+3.2%) 2.402s (+14.4% 🔺) 0.414s 38 1.02x
🐘 Postgres Next.js (Turbopack) 2.013s 2.536s 0.523s 36 1.04x
💻 Local Express 2.178s (-27.8% 🟢) 3.007s (-16.1% 🟢) 0.830s 30 1.12x
💻 Local Next.js (Turbopack) 2.696s 3.008s 0.312s 30 1.39x
💻 Local Nitro 3.043s (~) 3.885s (+3.4%) 0.841s 24 1.57x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 30.515s (-22.7% 🟢) 32.124s (-22.2% 🟢) 1.608s 3 1.00x
▲ Vercel Next.js (Turbopack) 38.720s (-22.3% 🟢) 40.377s (-21.9% 🟢) 1.657s 3 1.27x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 3.954s 4.331s 0.377s 28 1.00x
🐘 Postgres Express 3.978s (~) 4.403s (+0.8%) 0.426s 28 1.01x
🐘 Postgres Nitro 4.045s (-1.4%) 4.530s (-1.6%) 0.485s 27 1.02x
💻 Local Express 7.131s (-22.6% 🟢) 7.765s (-22.5% 🟢) 0.634s 16 1.80x
💻 Local Next.js (Turbopack) 8.716s 9.017s 0.300s 14 2.20x
💻 Local Nitro 9.353s (+0.6%) 10.018s (~) 0.665s 12 2.37x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 69.416s (-28.4% 🟢) 70.711s (-28.2% 🟢) 1.294s 2 1.00x
▲ Vercel Next.js (Turbopack) 80.695s (-24.7% 🟢) 83.537s (-23.3% 🟢) 2.843s 2 1.16x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.265s 1.008s 0.742s 60 1.00x
🐘 Postgres Express 0.280s (-0.8%) 1.007s (~) 0.727s 60 1.06x
🐘 Postgres Nitro 0.291s (+2.7%) 1.007s (~) 0.716s 60 1.10x
💻 Local Express 0.539s (-3.8%) 1.004s (~) 0.465s 60 2.03x
💻 Local Nitro 0.588s (-2.8%) 1.005s (-1.6%) 0.417s 60 2.22x
💻 Local Next.js (Turbopack) 0.617s 1.039s 0.422s 58 2.33x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 1.472s (-11.4% 🟢) 3.278s (-2.2%) 1.806s 19 1.00x
▲ Vercel Next.js (Turbopack) 1.472s (-27.2% 🟢) 2.882s (-24.0% 🟢) 1.410s 22 1.00x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.496s (-2.6%) 1.006s (~) 0.510s 90 1.00x
🐘 Postgres Nitro 0.501s (+1.0%) 1.007s (~) 0.505s 90 1.01x
🐘 Postgres Next.js (Turbopack) 0.518s 1.008s 0.489s 90 1.04x
💻 Local Express 2.290s (-8.9% 🟢) 3.007s (~) 0.718s 30 4.61x
💻 Local Nitro 2.522s (-0.6%) 3.009s (~) 0.486s 30 5.08x
💻 Local Next.js (Turbopack) 2.667s 3.042s 0.375s 30 5.37x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.442s (-24.3% 🟢) 4.151s (-13.9% 🟢) 1.710s 22 1.00x
▲ Vercel Next.js (Turbopack) 3.073s (-13.1% 🟢) 4.750s (-8.5% 🟢) 1.677s 19 1.26x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.795s (-2.9%) 1.008s (-1.0%) 0.213s 120 1.00x
🐘 Postgres Nitro 0.812s (+2.8%) 1.017s (+1.0%) 0.205s 118 1.02x
🐘 Postgres Next.js (Turbopack) 0.829s 1.016s 0.188s 119 1.04x
💻 Local Express 9.765s (-12.7% 🟢) 10.357s (-13.3% 🟢) 0.592s 12 12.29x
💻 Local Next.js (Turbopack) 11.130s 11.572s 0.442s 11 14.00x
💻 Local Nitro 11.143s (~) 11.753s (+0.8%) 0.610s 11 14.02x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 6.890s (-33.3% 🟢) 8.661s (-29.5% 🟢) 1.771s 14 1.00x
▲ Vercel Nitro 6.985s (-9.5% 🟢) 8.662s (-7.9% 🟢) 1.677s 14 1.01x
▲ Vercel Express ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.136s (-31.7% 🟢) 1.004s (~) 0.009s (-24.0% 🟢) 1.015s (~) 0.879s 10 1.00x
💻 Local Next.js (Turbopack) 0.177s 1.003s 0.012s 1.018s 0.841s 10 1.30x
🐘 Postgres Nitro 0.200s (-2.7%) 0.996s (~) 0.002s (+20.0% 🔺) 1.010s (~) 0.811s 10 1.47x
💻 Local Nitro 0.203s (-5.0%) 1.004s (~) 0.011s (-8.0% 🟢) 1.018s (~) 0.815s 10 1.49x
🐘 Postgres Next.js (Turbopack) 0.211s 1.002s 0.002s 1.014s 0.803s 10 1.55x
🐘 Postgres Express 0.212s (+3.3%) 0.996s (~) 0.001s (-12.5% 🟢) 1.010s (~) 0.798s 10 1.56x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.676s (-75.5% 🟢) 3.237s (-62.6% 🟢) 0.868s (+37.4% 🔺) 4.540s (-53.6% 🟢) 2.864s 10 1.00x
▲ Vercel Nitro 2.859s (-25.4% 🟢) 4.587s (-13.1% 🟢) 0.587s (-20.9% 🟢) 5.819s (-10.2% 🟢) 2.960s 10 1.71x
▲ Vercel Express ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.621s 1.009s 0.004s 1.022s 0.402s 59 1.00x
🐘 Postgres Express 0.623s (-1.2%) 1.004s (~) 0.007s (+72.6% 🔺) 1.024s (~) 0.402s 59 1.00x
🐘 Postgres Nitro 0.633s (+1.4%) 1.004s (~) 0.004s (-6.6% 🟢) 1.024s (~) 0.391s 59 1.02x
💻 Local Express 0.659s (-12.9% 🟢) 1.011s (-1.7%) 0.009s (-7.0% 🟢) 1.114s (+7.1% 🔺) 0.455s 54 1.06x
💻 Local Nitro 0.746s (-11.0% 🟢) 1.011s (~) 0.009s (~) 1.022s (-8.4% 🟢) 0.276s 59 1.20x
💻 Local Next.js (Turbopack) 0.869s 1.011s 0.010s 1.228s 0.358s 49 1.40x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.938s (-86.6% 🟢) 5.687s (-81.5% 🟢) 0.155s (+38.6% 🔺) 6.288s (-80.2% 🟢) 2.350s 10 1.00x
▲ Vercel Next.js (Turbopack) 4.510s (-73.3% 🟢) 6.157s (-66.2% 🟢) 0.145s (-31.3% 🟢) 6.719s (-64.5% 🟢) 2.209s 9 1.15x
▲ Vercel Express ⚠️ missing - - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.958s (-1.1%) 1.219s (-2.3%) 0.000s (-51.0% 🟢) 1.236s (-1.7%) 0.278s 49 1.00x
🐘 Postgres Express 0.962s (~) 1.194s (-6.6% 🟢) 0.000s (-100.0% 🟢) 1.207s (-7.6% 🟢) 0.245s 50 1.00x
🐘 Postgres Next.js (Turbopack) 0.965s 1.221s 0.000s 1.228s 0.264s 50 1.01x
💻 Local Express 1.116s (-8.9% 🟢) 2.017s (~) 0.000s (+30.0% 🔺) 2.019s (~) 0.903s 30 1.17x
💻 Local Nitro 1.232s (+0.8%) 2.021s (~) 0.000s (+166.7% 🔺) 2.022s (~) 0.790s 30 1.29x
💻 Local Next.js (Turbopack) 1.280s 2.018s 0.000s 2.021s 0.741s 30 1.34x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.656s (-12.9% 🟢) 3.946s (-10.2% 🟢) 0.000s (-7.1% 🟢) 4.464s (-7.2% 🟢) 1.807s 14 1.00x
▲ Vercel Next.js (Turbopack) 2.890s (-71.6% 🟢) 4.149s (-64.0% 🟢) 0.000s (NaN%) 4.684s (-61.1% 🟢) 1.794s 13 1.09x
▲ Vercel Express ⚠️ missing - - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.736s (-2.0%) 2.100s (-3.6%) 0.000s (+Infinity% 🔺) 2.123s (-3.5%) 0.386s 29 1.00x
🐘 Postgres Nitro 1.775s (-0.9%) 2.066s (-3.5%) 0.000s (-3.4%) 2.082s (-4.3%) 0.307s 29 1.02x
🐘 Postgres Next.js (Turbopack) 1.877s 2.146s 0.000s 2.153s 0.276s 28 1.08x
💻 Local Express 3.272s (-5.6% 🟢) 3.970s (-1.6%) 0.001s (-37.5% 🟢) 3.973s (-1.6%) 0.700s 16 1.88x
💻 Local Nitro 3.660s (+8.1% 🔺) 4.100s (+1.7%) 0.001s (+100.0% 🔺) 4.103s (+1.6%) 0.442s 15 2.11x
💻 Local Next.js (Turbopack) 3.722s 4.098s 0.001s 4.102s 0.380s 15 2.14x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 4.026s (-1.6%) 5.100s (-5.1% 🟢) 0.000s (-100.0% 🟢) 5.521s (-4.7%) 1.495s 11 1.00x
▲ Vercel Next.js (Turbopack) 4.169s (-25.8% 🟢) 5.411s (-22.5% 🟢) 0.000s (-27.3% 🟢) 5.832s (-22.7% 🟢) 1.662s 11 1.04x
▲ Vercel Express ⚠️ missing - - - - -

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Express 21/21
🐘 Postgres Express 10/21
▲ Vercel Nitro 13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 15/21
Next.js (Turbopack) 🐘 Postgres 16/21
Nitro 🐘 Postgres 18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@VaguelySerious VaguelySerious marked this pull request as ready for review April 16, 2026 22:10
@VaguelySerious VaguelySerious requested a review from a team as a code owner April 16, 2026 22:10
@VaguelySerious VaguelySerious marked this pull request as draft April 16, 2026 22:14
@VaguelySerious VaguelySerious marked this pull request as ready for review April 16, 2026 22:28
Copy link
Copy Markdown
Member

@TooTallNate TooTallNate left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Straightforward. if: false on both getCommunityWorldsMatrix and e2e-community, dropped from summary and e2e-required-check dependency lists, and the associated warning-comment logic is cleaned up.

The jobs are gated rather than deleted, which is the right choice — easy to re-enable once community worlds ship CBOR support.

The previous workflow-server-test label override (which used to let the label skip community jobs) is now redundant with if: false, but removing it is fine since the label is still honored for the other E2E jobs via e2e-required-check.

The empty changeset (---\n---\n\n<description>) is the correct pattern here since no packages change — satisfies the "every PR needs a changeset" CI rule without triggering a version bump.

One small thought (non-blocking): since this is an indefinite wait on upstream community worlds shipping CBOR, consider leaving a reference to a tracking issue in the comment so the re-enabling condition is discoverable.

@VaguelySerious VaguelySerious merged commit 71d594c into main Apr 17, 2026
160 of 166 checks passed
@VaguelySerious VaguelySerious deleted the peter/skip-community-worlds-ci branch April 17, 2026 01:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants