Skip to content

fix(next,builders): resolve next build failures from stale socket and dynamic imports#1702

Draft
TooTallNate wants to merge 1 commit intomainfrom
fix/next-build-econnrefused-and-dynamic-import
Draft

fix(next,builders): resolve next build failures from stale socket and dynamic imports#1702
TooTallNate wants to merge 1 commit intomainfrom
fix/next-build-econnrefused-and-dynamic-import

Conversation

@TooTallNate
Copy link
Copy Markdown
Member

Summary

Fixes next build failures introduced in 5.0.0-beta.1 caused by two separate regressions:

  • ECONNREFUSED during build (@workflow/next): The loader's getSocketInfoFilePath() filesystem fallback (added in fix(next): skip eager discovery in deferred build mode #1646) unconditionally reads .next/cache/workflow-socket.json, which may contain stale credentials from a previous next dev session. When the eager builder is active (no socket server), this causes connect ECONNREFUSED. Fixed by gating the fallback behind WORKFLOW_NEXT_LAZY_DISCOVERY=1.

  • Module not found: Can't resolve './ROOT' (@workflow/builders): @vercel/queue's import(absolutePath) pattern gets inlined into the generated step route bundle by esbuild. Turbopack traces the dynamic import at build time and fails because path.resolve(process.cwd(), ...) produces an unresolvable path. Fixed by post-processing the step bundle to add /* webpackIgnore: true */ comments to dynamic import() calls with non-literal arguments.

Test plan

  • Verified next build succeeds on a reproduction project that previously failed with 5 build errors (3 ECONNREFUSED + 2 module-not-found), now produces 0 errors
  • All 590 core unit tests pass
  • All 12 local-build e2e tests pass
  • All 256 builders tests pass (2 pre-existing failures in node-module-esbuild-plugin.test.ts)

… dynamic imports

- Guard socket-info filesystem fallback behind WORKFLOW_NEXT_LAZY_DISCOVERY
  to prevent ECONNREFUSED when a stale workflow-socket.json exists from a
  previous dev session
- Post-process step bundles to add webpackIgnore comments to dynamic
  import() calls with non-literal arguments, preventing Turbopack
  'Module not found' errors for runtime-resolved paths
@changeset-bot
Copy link
Copy Markdown

changeset-bot bot commented Apr 11, 2026

🦋 Changeset detected

Latest commit: 92658e3

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
Name Type
@workflow/next Patch
@workflow/builders Patch
workflow Patch
@workflow/astro Patch
@workflow/cli Patch
@workflow/nest Patch
@workflow/nitro Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/vitest Patch
@workflow/ai Patch
@workflow/world-testing Patch
@workflow/nuxt Patch
@workflow/core Patch
@workflow/web-shared Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Apr 11, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 11, 2026 7:18pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 11, 2026 7:18pm
example-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-express-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 11, 2026 7:18pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 11, 2026 7:18pm
workflow-swc-playground Ready Ready Preview, Comment Apr 11, 2026 7:18pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 11, 2026

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 923 0 67 990
✅ 💻 Local Development 664 0 146 810
✅ 📦 Local Production 898 0 182 1080
✅ 🐘 Local Postgres 898 0 182 1080
✅ 🪟 Windows 82 0 8 90
❌ 🌍 Community Worlds 133 74 24 231
✅ 📋 Other 228 0 42 270
Total 3826 74 651 4551

❌ Failed Tests

🌍 Community Worlds (74 failed)

mongodb (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNYZPBSQS61C9B40SYA5J5R5
  • webhookWorkflow | wrun_01KNYZPNRSP9J9V5AMGV85Q10P
  • fetchWorkflow | wrun_01KNYZT75PS3FGFNWA8FFTNF99
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNYZYM1P40KPRF7SX2W0NTJ1
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KNZ05H95H6FMYVHQ9DWRPEMZ

redis (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNYZPBSQS61C9B40SYA5J5R5
  • webhookWorkflow | wrun_01KNYZPNRSP9J9V5AMGV85Q10P
  • fetchWorkflow | wrun_01KNYZT75PS3FGFNWA8FFTNF99
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNYZYM1P40KPRF7SX2W0NTJ1
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KNZ05H95H6FMYVHQ9DWRPEMZ

turso (60 failed):

  • addTenWorkflow | wrun_01KNYZN5B151RPCV9NJ6TDSD3X
  • addTenWorkflow | wrun_01KNYZN5B151RPCV9NJ6TDSD3X
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KNYZQA02VDSJ3BFVE05K3QBQ
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KNYZNCFS7YT10GP3K25EV6X6
  • promiseRaceWorkflow | wrun_01KNYZNH5AA0XWYWJPS7443G80
  • promiseAnyWorkflow | wrun_01KNYZNKBXTS05DYFS70YJW7PT
  • importedStepOnlyWorkflow | wrun_01KNYZQPC7YFM0FKNHYZSZ8B4J
  • hookWorkflow | wrun_01KNYZNZJWNKN36K51HEBWVYJ4
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNYZPBSQS61C9B40SYA5J5R5
  • webhookWorkflow | wrun_01KNYZPNRSP9J9V5AMGV85Q10P
  • sleepingWorkflow | wrun_01KNYZPX4JYVR7N6D73MR092KA
  • parallelSleepWorkflow | wrun_01KNYZQ9BNNQBMWR8TKDNZ4M87
  • nullByteWorkflow | wrun_01KNYZQCS5JF7FEK3FPHT80KWZ
  • workflowAndStepMetadataWorkflow | wrun_01KNYZQG8WVA7CTVRF8PA0DWA1
  • fetchWorkflow | wrun_01KNYZT75PS3FGFNWA8FFTNF99
  • promiseRaceStressTestWorkflow | wrun_01KNYZTAWA1864BTGFNZ0HPW2P
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KNYZY04EJF0KX5F700D7W785
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNYZYM1P40KPRF7SX2W0NTJ1
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KNYZZBQP1SX6CCB9DRRB29X1
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KNZ000TY3NQ9PQDAEHTCZHEJ
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KNZ00ADM78HV76RRYW15745M
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KNZ00G5Y1VCERT7RGG3QYK8A
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KNZ00JDD0A9TP79XMGV591XV
  • runClassSerializationWorkflow - Run instances serialize across workflow/step boundaries | wrun_01KNZ00XD8KCK709YP1MPEQ20B
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KNZ01CHGMX6C0754299YT6WA
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KNZ01JCSX9QJJKQ2S7J4KJRP
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KNZ01R6W9PJFS5Y2YPXDTH1C
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KNZ01ZF1NJ2GD8P14SVVZ8FZ
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KNZ026CJQH2ZZV1PRBA32M9D
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KNZ02DCCV5N06QMPQ7BMY8JV
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KNZ02MQTZM8DYDH6D6X9322K
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KNZ02Z6T5Q989GXFPXFGZFFC
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KNZ037B20DD1J9YH5RW5P8EQ
  • cancelRun - cancelling a running workflow | wrun_01KNZ03EYVT9EKQCBBXM6TN5TK
  • cancelRun via CLI - cancelling a running workflow | wrun_01KNZ03RDRH35PN79N3V5X609P
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KNZ044RZB1BHZFJ62317862R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KNZ04TQPB6KXP70MF6VKJJCJ
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KNZ0557RG27RDWG9QA8QWCP6
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KNZ05BN23X2F30C7YKRBG09G
  • metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_01KNZ05DW4F213E37N5X9251PB
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KNZ05H95H6FMYVHQ9DWRPEMZ
  • getterStepWorkflow - getter functions with "use step" directive | wrun_01KNZ05MMYJ840PV0KMYZVMY0Y

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 83 0 7
✅ example 83 0 7
✅ express 83 0 7
✅ fastify 83 0 7
✅ hono 83 0 7
✅ nextjs-turbopack 88 0 2
✅ nextjs-webpack 88 0 2
✅ nitro 83 0 7
✅ nuxt 83 0 7
✅ sveltekit 83 0 7
✅ vite 83 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 82 0 8
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 6 0 0
❌ mongodb 56 7 8
✅ redis-dev 6 0 0
❌ redis 56 7 8
✅ turso-dev 6 0 0
❌ turso 3 60 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 76 0 14
✅ e2e-local-postgres-nest-stable 76 0 14
✅ e2e-local-prod-nest-stable 76 0 14

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 11, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.041s (+13.2% 🔺) 1.005s (~) 0.964s 10 1.00x
💻 Local Nitro 0.042s (+1.7%) 1.006s (~) 0.963s 10 1.03x
🐘 Postgres Nitro 0.058s (-12.7% 🟢) 1.011s (~) 0.953s 10 1.42x
🐘 Postgres Next.js (Turbopack) 0.059s (+20.4% 🔺) 1.011s (~) 0.952s 10 1.44x
🐘 Postgres Express 0.060s (+5.2% 🔺) 1.009s (~) 0.949s 10 1.47x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.215s (-16.9% 🟢) 1.831s (+1.7%) 1.616s 10 1.00x
▲ Vercel Next.js (Turbopack) 0.288s (+9.9% 🔺) 2.236s (-1.0%) 1.949s 10 1.34x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.127s (~) 2.007s (~) 0.880s 10 1.00x
💻 Local Express 1.135s (+3.5%) 2.006s (~) 0.871s 10 1.01x
🐘 Postgres Next.js (Turbopack) 1.141s (+1.7%) 2.009s (~) 0.868s 10 1.01x
🐘 Postgres Nitro 1.146s (~) 2.010s (~) 0.864s 10 1.02x
🐘 Postgres Express 1.149s (~) 2.010s (~) 0.861s 10 1.02x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.890s (-7.6% 🟢) 4.004s (-2.3%) 2.115s 10 1.00x
▲ Vercel Express 1.911s (-3.6%) 4.032s (+4.4%) 2.121s 10 1.01x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 10.895s (~) 11.356s (+3.0%) 0.461s 3 1.00x
🐘 Postgres Next.js (Turbopack) 10.913s (+1.1%) 11.022s (~) 0.109s 3 1.00x
💻 Local Express 10.921s (+2.7%) 11.025s (~) 0.103s 3 1.00x
🐘 Postgres Express 10.924s (~) 11.025s (~) 0.102s 3 1.00x
💻 Local Nitro 10.932s (~) 11.024s (~) 0.092s 3 1.00x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 16.396s (-7.4% 🟢) 18.392s (-9.0% 🟢) 1.996s 2 1.00x
▲ Vercel Next.js (Turbopack) 16.768s (-4.8%) 18.536s (-5.8% 🟢) 1.768s 2 1.02x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 14.503s (~) 15.027s (~) 0.524s 4 1.00x
🐘 Postgres Next.js (Turbopack) 14.530s (+2.6%) 15.030s (~) 0.500s 4 1.00x
🐘 Postgres Nitro 14.575s (~) 15.022s (~) 0.447s 4 1.00x
💻 Local Nitro 14.906s (-0.7%) 15.029s (~) 0.123s 4 1.03x
💻 Local Express 15.040s (+5.6% 🔺) 15.530s (+3.3%) 0.490s 4 1.04x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 30.631s (-20.1% 🟢) 32.597s (-19.0% 🟢) 1.965s 2 1.00x
▲ Vercel Express 32.922s (-7.9% 🟢) 34.942s (-7.6% 🟢) 2.020s 2 1.07x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Express

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 13.779s (-1.2%) 14.161s (-1.1%) 0.381s 7 1.00x
🐘 Postgres Next.js (Turbopack) 13.884s (+3.5%) 14.164s (~) 0.280s 7 1.01x
🐘 Postgres Nitro 14.008s (-0.8%) 14.451s (-1.9%) 0.443s 7 1.02x
💻 Local Nitro 16.506s (-1.4%) 17.031s (~) 0.525s 6 1.20x
💻 Local Express 16.865s (+12.1% 🔺) 17.197s (+10.7% 🔺) 0.332s 6 1.22x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 52.045s (-4.5%) 54.093s (-4.1%) 2.048s 2 1.00x
▲ Vercel Next.js (Turbopack) 56.595s (-5.1% 🟢) 59.407s (-3.8%) 2.812s 2 1.09x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.250s (+5.3% 🔺) 2.009s (~) 0.760s 15 1.00x
🐘 Postgres Express 1.261s (-1.2%) 2.009s (~) 0.749s 15 1.01x
🐘 Postgres Nitro 1.271s (-0.8%) 2.009s (~) 0.739s 15 1.02x
💻 Local Nitro 1.518s (~) 2.005s (~) 0.487s 15 1.22x
💻 Local Express 1.551s (+7.6% 🔺) 2.007s (~) 0.456s 15 1.24x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.232s (-14.6% 🟢) 4.236s (-5.5% 🟢) 2.004s 8 1.00x
▲ Vercel Express 2.653s (-1.3%) 4.397s (-1.3%) 1.745s 7 1.19x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Express

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.352s (~) 3.008s (~) 0.656s 10 1.00x
🐘 Postgres Nitro 2.359s (~) 3.009s (~) 0.650s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.442s (~) 3.010s (~) 0.568s 10 1.04x
💻 Local Nitro 2.904s (-2.0%) 3.007s (-20.0% 🟢) 0.104s 10 1.23x
💻 Local Express 2.922s (+13.3% 🔺) 3.208s (+6.6% 🔺) 0.285s 10 1.24x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.303s (-12.6% 🟢) 3.998s (-9.1% 🟢) 1.696s 8 1.00x
▲ Vercel Next.js (Turbopack) 2.596s (+1.4%) 4.506s (+8.2% 🔺) 1.910s 7 1.13x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.455s (-1.1%) 4.010s (~) 0.555s 8 1.00x
🐘 Postgres Nitro 3.459s (-0.8%) 4.010s (~) 0.552s 8 1.00x
🐘 Postgres Next.js (Turbopack) 3.700s (+2.8%) 4.013s (~) 0.313s 8 1.07x
💻 Local Nitro 7.827s (-6.5% 🟢) 8.520s (-5.6% 🟢) 0.694s 4 2.27x
💻 Local Express 8.435s (+25.5% 🔺) 9.023s (+28.6% 🔺) 0.588s 4 2.44x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.129s (~) 5.082s (+3.1%) 1.953s 6 1.00x
▲ Vercel Next.js (Turbopack) 3.776s (+17.3% 🔺) 5.511s (+9.0% 🔺) 1.735s 6 1.21x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.242s (+4.3%) 2.009s (~) 0.767s 15 1.00x
🐘 Postgres Express 1.254s (-0.9%) 2.008s (~) 0.754s 15 1.01x
🐘 Postgres Nitro 1.261s (-0.5%) 2.008s (~) 0.747s 15 1.02x
💻 Local Nitro 1.524s (~) 2.005s (~) 0.481s 15 1.23x
💻 Local Express 1.546s (+5.4% 🔺) 2.006s (~) 0.460s 15 1.25x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.980s (-11.2% 🟢) 4.010s (~) 2.030s 8 1.00x
▲ Vercel Express 2.017s (-12.3% 🟢) 4.146s (-4.1%) 2.129s 8 1.02x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack) | Express

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 2.354s (~) 3.009s (~) 0.655s 10 1.00x
🐘 Postgres Express 2.359s (~) 3.009s (~) 0.651s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.401s (+1.5%) 3.009s (~) 0.608s 10 1.02x
💻 Local Nitro 2.964s (-4.3%) 3.762s (-6.2% 🟢) 0.798s 8 1.26x
💻 Local Express 3.044s (+2.4%) 3.885s (+16.2% 🔺) 0.841s 8 1.29x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.291s (-15.2% 🟢) 4.100s (-6.6% 🟢) 1.809s 8 1.00x
▲ Vercel Next.js (Turbopack) 2.664s (-7.7% 🟢) 4.364s (-6.7% 🟢) 1.700s 8 1.16x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.500s (~) 4.011s (~) 0.510s 8 1.00x
🐘 Postgres Express 3.502s (~) 4.010s (~) 0.507s 8 1.00x
🐘 Postgres Next.js (Turbopack) 3.674s (+2.7%) 4.013s (~) 0.340s 8 1.05x
💻 Local Nitro 9.403s (+0.7%) 10.023s (~) 0.619s 3 2.69x
💻 Local Express 9.544s (+18.6% 🔺) 10.024s (+14.3% 🔺) 0.480s 4 2.73x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.195s (-0.7%) 5.222s (+2.0%) 2.027s 6 1.00x
▲ Vercel Next.js (Turbopack) 3.300s (-1.8%) 5.343s (-1.6%) 2.042s 6 1.03x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.804s (+25.5% 🔺) 1.023s (+1.7%) 0.219s 59 1.00x
🐘 Postgres Express 0.817s (-2.0%) 1.006s (~) 0.189s 60 1.02x
🐘 Postgres Nitro 0.824s (-1.6%) 1.023s (+1.6%) 0.199s 59 1.02x
💻 Local Nitro 0.996s (+0.7%) 1.254s (~) 0.258s 48 1.24x
💻 Local Express 0.999s (+42.7% 🔺) 1.361s (+35.5% 🔺) 0.361s 45 1.24x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 9.015s (-6.8% 🟢) 11.137s (-3.6%) 2.122s 6 1.00x
▲ Vercel Next.js (Turbopack) 9.332s (-13.8% 🟢) 11.732s (-7.4% 🟢) 2.400s 6 1.04x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.980s (+2.2%) 2.316s (+2.8%) 0.336s 39 1.00x
🐘 Postgres Next.js (Turbopack) 1.981s (+20.4% 🔺) 2.227s (+9.7% 🔺) 0.246s 41 1.00x
🐘 Postgres Express 1.998s (+1.8%) 2.441s (+9.6% 🔺) 0.443s 37 1.01x
💻 Local Nitro 2.977s (-1.4%) 3.341s (-6.8% 🟢) 0.364s 27 1.50x
💻 Local Express 3.045s (+24.8% 🔺) 3.585s (+12.7% 🔺) 0.540s 26 1.54x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 26.909s (-3.7%) 29.018s (-4.0%) 2.109s 4 1.00x
▲ Vercel Next.js (Turbopack) 29.164s (-1.2%) 31.208s (-1.1%) 2.044s 3 1.08x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.899s (-3.1%) 4.143s (-7.0% 🟢) 0.244s 30 1.00x
🐘 Postgres Next.js (Turbopack) 3.957s (+24.0% 🔺) 4.149s (+4.3%) 0.192s 29 1.01x
🐘 Postgres Nitro 3.993s (+2.6%) 4.492s (+8.3% 🔺) 0.499s 27 1.02x
💻 Local Nitro 9.008s (-2.6%) 9.402s (-6.2% 🟢) 0.394s 13 2.31x
💻 Local Express 9.289s (+27.1% 🔺) 10.018s (+26.0% 🔺) 0.730s 12 2.38x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 70.552s (-0.6%) 72.563s (-1.5%) 2.011s 2 1.00x
▲ Vercel Next.js (Turbopack) 74.400s (-3.0%) 76.980s (-3.1%) 2.580s 2 1.05x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.253s (+19.0% 🔺) 1.007s (~) 0.754s 60 1.00x
🐘 Postgres Express 0.281s (-0.5%) 1.007s (~) 0.726s 60 1.11x
🐘 Postgres Nitro 0.288s (+4.4%) 1.007s (~) 0.719s 60 1.14x
💻 Local Express 0.594s (+2.0%) 1.005s (~) 0.411s 60 2.35x
💻 Local Nitro 0.596s (+2.6%) 1.021s (+1.7%) 0.426s 59 2.35x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.305s (-9.5% 🟢) 2.876s (-10.6% 🟢) 1.571s 21 1.00x
▲ Vercel Next.js (Turbopack) 1.716s (+6.3% 🔺) 3.652s (+5.5% 🔺) 1.936s 17 1.32x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.493s (-2.0%) 1.006s (~) 0.514s 90 1.00x
🐘 Postgres Next.js (Turbopack) 0.510s (+21.2% 🔺) 1.007s (~) 0.497s 90 1.03x
🐘 Postgres Nitro 0.516s (+3.2%) 1.007s (~) 0.491s 90 1.05x
💻 Local Nitro 2.516s (+1.7%) 3.008s (~) 0.492s 30 5.11x
💻 Local Express 2.610s (+9.0% 🔺) 3.077s (+2.3%) 0.467s 30 5.30x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.447s (-6.7% 🟢) 4.506s (+0.6%) 2.058s 21 1.00x
▲ Vercel Next.js (Turbopack) 2.987s (-5.4% 🟢) 5.059s (+3.6%) 2.072s 18 1.22x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.794s (~) 1.017s (+0.9%) 0.223s 119 1.00x
🐘 Postgres Next.js (Turbopack) 0.806s (+21.4% 🔺) 1.007s (~) 0.202s 120 1.02x
🐘 Postgres Nitro 0.819s (+4.7%) 1.009s (~) 0.190s 119 1.03x
💻 Local Nitro 10.892s (-1.9%) 11.482s (-3.1%) 0.590s 11 13.73x
💻 Local Express 11.349s (+13.4% 🔺) 11.942s (+11.7% 🔺) 0.593s 11 14.30x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.455s (-17.3% 🟢) 7.563s (-12.2% 🟢) 2.108s 16 1.00x
▲ Vercel Next.js (Turbopack) 6.693s (+14.7% 🔺) 9.156s (+17.5% 🔺) 2.464s 14 1.23x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express | Next.js (Turbopack)

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.199s (-2.0%) 1.004s (~) 0.012s (-2.5%) 1.018s (~) 0.819s 10 1.00x
🐘 Postgres Express 0.204s (-1.4%) 0.996s (~) 0.002s (+30.8% 🔺) 1.010s (~) 0.807s 10 1.02x
🐘 Postgres Next.js (Turbopack) 0.210s (+26.6% 🔺) 1.001s (~) 0.002s (+60.0% 🔺) 1.011s (~) 0.801s 10 1.05x
🐘 Postgres Nitro 0.210s (-1.6%) 0.997s (~) 0.002s (+46.2% 🔺) 1.010s (~) 0.801s 10 1.05x
💻 Local Express 0.225s (+61.1% 🔺) 1.004s (~) 0.013s (+42.6% 🔺) 1.020s (~) 0.795s 10 1.13x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.520s (-16.4% 🟢) 3.167s (-6.9% 🟢) 0.426s (+60.5% 🔺) 4.057s (-3.6%) 2.537s 10 1.00x
▲ Vercel Express 1.693s (+10.4% 🔺) 2.619s (-5.4% 🟢) 1.402s (+98.1% 🔺) 4.677s (+17.8% 🔺) 2.983s 10 1.11x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack) | Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.607s (~) 1.004s (~) 0.004s (-21.0% 🟢) 1.021s (~) 0.414s 59 1.00x
🐘 Postgres Nitro 0.632s (+3.0%) 1.005s (~) 0.004s (+4.5%) 1.024s (~) 0.392s 59 1.04x
🐘 Postgres Next.js (Turbopack) 0.636s (+10.2% 🔺) 1.009s (~) 0.006s (+58.9% 🔺) 1.024s (~) 0.389s 59 1.05x
💻 Local Express 0.739s (+32.3% 🔺) 1.013s (~) 0.009s (+5.8% 🔺) 1.024s (~) 0.285s 59 1.22x
💻 Local Nitro 0.804s (+10.7% 🔺) 1.012s (~) 0.009s (-7.8% 🟢) 1.115s (+9.0% 🔺) 0.311s 54 1.33x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.916s (-5.7% 🟢) 5.518s (-6.8% 🟢) 0.244s (-11.2% 🟢) 6.251s (-6.0% 🟢) 2.336s 10 1.00x
▲ Vercel Next.js (Turbopack) 4.248s (-6.8% 🟢) 6.090s (-5.7% 🟢) 0.586s (+98.2% 🔺) 7.292s (-1.8%) 3.043s 9 1.08x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.957s (-2.4%) 1.239s (+3.9%) 0.000s (-48.0% 🟢) 1.261s (+3.6%) 0.304s 49 1.00x
🐘 Postgres Express 0.960s (+1.5%) 1.147s (-1.9%) 0.000s (-34.6% 🟢) 1.161s (-1.9%) 0.202s 52 1.00x
🐘 Postgres Next.js (Turbopack) 0.962s (+3.4%) 1.277s (+14.9% 🔺) 0.000s (+53.2% 🔺) 1.299s (+16.0% 🔺) 0.337s 47 1.01x
💻 Local Nitro 1.208s (-2.4%) 2.020s (~) 0.000s (-25.0% 🟢) 2.022s (~) 0.814s 30 1.26x
💻 Local Express 1.252s (+9.8% 🔺) 2.021s (~) 0.000s (+12.5% 🔺) 2.022s (~) 0.771s 30 1.31x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.532s (-3.4%) 4.161s (+8.6% 🔺) 0.000s (-96.0% 🟢) 4.719s (+9.3% 🔺) 2.188s 13 1.00x
▲ Vercel Next.js (Turbopack) 2.936s (-1.3%) 4.665s (~) 0.000s (-100.0% 🟢) 5.196s (~) 2.259s 12 1.16x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.762s (-0.9%) 2.144s (~) 0.000s (NaN%) 2.156s (~) 0.394s 28 1.00x
🐘 Postgres Nitro 1.823s (+3.4%) 2.179s (+3.8%) 0.000s (-100.0% 🟢) 2.189s (+3.6%) 0.366s 28 1.03x
🐘 Postgres Next.js (Turbopack) 1.857s (-1.3%) 2.146s (-5.1% 🟢) 0.000s (NaN%) 2.153s (-5.1% 🟢) 0.295s 28 1.05x
💻 Local Nitro 3.470s (-0.9%) 4.032s (-1.7%) 0.000s (-50.0% 🟢) 4.034s (-1.7%) 0.564s 15 1.97x
💻 Local Express 3.660s (+11.8% 🔺) 4.234s (+8.4% 🔺) 0.000s (-32.1% 🟢) 4.237s (+8.4% 🔺) 0.577s 15 2.08x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.944s (-6.8% 🟢) 5.526s (-2.2%) 0.000s (-54.5% 🟢) 6.037s (-4.2%) 2.093s 11 1.00x
▲ Vercel Next.js (Turbopack) 4.017s (-4.8%) 5.728s (~) 0.000s (-100.0% 🟢) 6.199s (~) 2.182s 10 1.02x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 17/21
🐘 Postgres Express 10/21
▲ Vercel Express 16/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 14/21
Next.js (Turbopack) 🐘 Postgres 20/21
Nitro 🐘 Postgres 18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: failure
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Copy link
Copy Markdown
Member

@VaguelySerious VaguelySerious left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM from testing, also see #1713 which runs this code in e2e tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants