Skip to content

Add serde compliance tooling and improve custom class serialization DX#1552

Merged
TooTallNate merged 4 commits intomainfrom
nrajlich/serde-dx-improvements
Apr 3, 2026
Merged

Add serde compliance tooling and improve custom class serialization DX#1552
TooTallNate merged 4 commits intomainfrom
nrajlich/serde-dx-improvements

Conversation

@TooTallNate
Copy link
Copy Markdown
Member

Summary

  • Add serde compliance checker library (analyzeSerdeCompliance) to @workflow/builders for programmatic analysis of custom class serialization correctness
  • Add build-time warnings when serde-registered classes have Node.js built-in imports remaining in the workflow bundle
  • Add workflow transform <file> CLI command for inspecting SWC transform output with optional --check-serde analysis
  • Implement workflow validate CLI command (replacing the "Coming soon" stub) with serde compliance scanning
  • Add Serde Analysis panel to the SWC playground that automatically appears when serde patterns are detected
  • Update workflow skill file (v1.4 → v1.5) with comprehensive custom class serialization documentation, fixing the incorrect claim that class instances are "not supported"

Motivation

Custom class serde is difficult for both humans and AI agents to implement retroactively. See vercel-labs/just-bash#172 where an AI agent:

  • Defined serde methods outside the class body (not detected by SWC)
  • Used dynamic imports with @vite-ignore to avoid sandbox restrictions
  • Wrote manual hydration shims bypassing the serde system
  • Reimplemented class registry registration manually

These changes provide validation tooling and correct documentation to prevent these mistakes.

@changeset-bot
Copy link
Copy Markdown

changeset-bot bot commented Mar 29, 2026

🦋 Changeset detected

Latest commit: b56c506

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
Name Type
@workflow/cli Patch
@workflow/builders Patch
workflow Patch
@workflow/world-testing Patch
@workflow/astro Patch
@workflow/nest Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/vitest Patch
@workflow/ai Patch
@workflow/nuxt Patch
@workflow/core Patch
@workflow/web-shared Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Mar 29, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 3, 2026 8:26pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 3, 2026 8:26pm
example-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-express-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 3, 2026 8:26pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 3, 2026 8:26pm
workflow-swc-playground Ready Ready Preview, Comment Apr 3, 2026 8:26pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 29, 2026

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 857 0 67 924
✅ 💻 Local Development 830 0 178 1008
✅ 📦 Local Production 830 0 178 1008
✅ 🐘 Local Postgres 830 0 178 1008
✅ 🪟 Windows 76 0 8 84
❌ 🌍 Community Worlds 130 62 24 216
✅ 📋 Other 210 0 42 252
Total 3763 62 675 4500

❌ Failed Tests

🌍 Community Worlds (62 failed)

mongodb (3 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNAGE5MCBJWQG5NZFQM4STFX
  • webhookWorkflow | wrun_01KNAGEDWZ8SFQG3FQ4NDX4FF5
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNAGNRBPWK075EQCESKHXEP6

redis (2 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNAGE5MCBJWQG5NZFQM4STFX
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNAGNRBPWK075EQCESKHXEP6

turso (57 failed):

  • addTenWorkflow | wrun_01KNAGCZGBKN58B4GW517THPVM
  • addTenWorkflow | wrun_01KNAGCZGBKN58B4GW517THPVM
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KNAGE8409BFH762D6V8S9KPY
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KNAGD7W9EB860CSVR33EGHNS
  • promiseRaceWorkflow | wrun_01KNAGDEDWMQSCDE0VRE4F4EZ2
  • promiseAnyWorkflow | wrun_01KNAGDGA901PXZNNC76FJFWZT
  • importedStepOnlyWorkflow | wrun_01KNAGENAA4AZK7BG0YN5K5F3T
  • hookWorkflow | wrun_01KNAGDVZ27GT7KR7NKD7XBKY3
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNAGE5MCBJWQG5NZFQM4STFX
  • webhookWorkflow | wrun_01KNAGEDWZ8SFQG3FQ4NDX4FF5
  • sleepingWorkflow | wrun_01KNAGEM1A34MBQZ10XR7J08JB
  • parallelSleepWorkflow | wrun_01KNAGF0MPA0BJ8HR0JBDXSRXN
  • nullByteWorkflow | wrun_01KNAGF4S6VSKBQB1QN0ZD3Y5X
  • workflowAndStepMetadataWorkflow | wrun_01KNAGF6PDN45V93Y40RXGHY70
  • fetchWorkflow | wrun_01KNAGHQVHXF9RCVTX3NJMCS8W
  • promiseRaceStressTestWorkflow | wrun_01KNAGHTXZH044ATRJ23JNDAGB
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KNAGN5Q9D6JH20VNW6A1116C
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNAGNRBPWK075EQCESKHXEP6
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KNAGPBRGJ5Q8TX93B97TXDG6
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KNAGPYQFMGK2XEK4T8JCYQQ3
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KNAGQ6FNJFPEZW0G3F3X2BVE
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KNAGQCJ4ZDYF6WCVT0B6VZM0
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KNAGQEERT0R635N69NBB7ZQA
  • health check endpoint (HTTP) - workflow and step endpoints respond to __health query parameter
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KNAGQWGAR3HBSEFRJ4A7H61N
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KNAGR1F3QDHPW1MAKG2GX30Z
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KNAGR8RZBXZ8ZB8770QRQKFS
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KNAGREN1FXXMW5XFM6M48K9D
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KNAGRMDP9SKXAMKKX61N224Z
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KNAGRTC7X7Q6H5E2KTJTM2NW
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KNAGS0FFKR0YSY0MM243AVBR
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KNAGSAKSRRBGBE0CMKTWSZ7Z
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KNAGSJNHZCFPTBBTCC8FGKKS
  • cancelRun - cancelling a running workflow | wrun_01KNAGSRNBQ1FC7VTDD068SDTE
  • cancelRun via CLI - cancelling a running workflow | wrun_01KNAGT1JF1HBKYRJH93B6N9ZA
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KNAGTF2DQ2NY68WJWWF00SMW
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KNAGV2GFQZ65CDDM7BJVJ40F
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KNAGVDM12FVTJJNCCAHD9V66
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KNAGVKKPZJ87YG1D0X7PF997

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 77 0 7
✅ example 77 0 7
✅ express 77 0 7
✅ fastify 77 0 7
✅ hono 77 0 7
✅ nextjs-turbopack 82 0 2
✅ nextjs-webpack 82 0 2
✅ nitro 77 0 7
✅ nuxt 77 0 7
✅ sveltekit 77 0 7
✅ vite 77 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 70 0 14
✅ express-stable 70 0 14
✅ fastify-stable 70 0 14
✅ hono-stable 70 0 14
✅ nextjs-turbopack-canary 59 0 25
✅ nextjs-turbopack-stable 76 0 8
✅ nextjs-webpack-canary 59 0 25
✅ nextjs-webpack-stable 76 0 8
✅ nitro-stable 70 0 14
✅ nuxt-stable 70 0 14
✅ sveltekit-stable 70 0 14
✅ vite-stable 70 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 70 0 14
✅ express-stable 70 0 14
✅ fastify-stable 70 0 14
✅ hono-stable 70 0 14
✅ nextjs-turbopack-canary 59 0 25
✅ nextjs-turbopack-stable 76 0 8
✅ nextjs-webpack-canary 59 0 25
✅ nextjs-webpack-stable 76 0 8
✅ nitro-stable 70 0 14
✅ nuxt-stable 70 0 14
✅ sveltekit-stable 70 0 14
✅ vite-stable 70 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 70 0 14
✅ express-stable 70 0 14
✅ fastify-stable 70 0 14
✅ hono-stable 70 0 14
✅ nextjs-turbopack-canary 59 0 25
✅ nextjs-turbopack-stable 76 0 8
✅ nextjs-webpack-canary 59 0 25
✅ nextjs-webpack-stable 76 0 8
✅ nitro-stable 70 0 14
✅ nuxt-stable 70 0 14
✅ sveltekit-stable 70 0 14
✅ vite-stable 70 0 14
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 76 0 8
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 5 0 0
❌ mongodb 56 3 8
✅ redis-dev 5 0 0
❌ redis 57 2 8
✅ turso-dev 5 0 0
❌ turso 2 57 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 70 0 14
✅ e2e-local-postgres-nest-stable 70 0 14
✅ e2e-local-prod-nest-stable 70 0 14

📋 View full workflow run

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 29, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.036s (-30.6% 🟢) 1.006s (~) 0.971s 10 1.00x
💻 Local Express 0.043s (+1.2%) 1.006s (~) 0.963s 10 1.22x
💻 Local Next.js (Turbopack) 0.047s 1.005s 0.958s 10 1.30x
🌐 Redis Next.js (Turbopack) 0.056s 1.005s 0.950s 10 1.55x
🐘 Postgres Next.js (Turbopack) 0.057s 1.012s 0.955s 10 1.59x
🐘 Postgres Nitro 0.061s (+5.6% 🔺) 1.012s (~) 0.951s 10 1.70x
🐘 Postgres Express 0.061s (-7.7% 🟢) 1.011s (~) 0.950s 10 1.72x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 0.393s (-23.3% 🟢) 2.561s (-8.2% 🟢) 2.168s 10 1.00x
▲ Vercel Next.js (Turbopack) 0.464s (-27.8% 🟢) 2.948s (+20.7% 🔺) 2.484s 10 1.18x
▲ Vercel Express 0.515s (+3.9%) 2.627s (+3.7%) 2.112s 10 1.31x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.097s (-3.9%) 2.006s (~) 0.909s 10 1.00x
💻 Local Next.js (Turbopack) 1.123s 2.006s 0.883s 10 1.02x
🐘 Postgres Next.js (Turbopack) 1.132s 2.008s 0.876s 10 1.03x
💻 Local Express 1.133s (~) 2.006s (~) 0.874s 10 1.03x
🌐 Redis Next.js (Turbopack) 1.135s 2.008s 0.873s 10 1.03x
🐘 Postgres Express 1.145s (~) 2.010s (~) 0.865s 10 1.04x
🐘 Postgres Nitro 1.147s (~) 2.011s (~) 0.864s 10 1.05x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.024s (-3.6%) 3.646s (-6.4% 🟢) 1.622s 10 1.00x
▲ Vercel Next.js (Turbopack) 2.100s (-7.4% 🟢) 3.999s (+11.6% 🔺) 1.900s 10 1.04x
▲ Vercel Express 2.407s (+13.7% 🔺) 3.881s (~) 1.474s 10 1.19x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 10.606s (-3.7%) 11.022s (-3.0%) 0.416s 3 1.00x
💻 Local Next.js (Turbopack) 10.780s 11.023s 0.243s 3 1.02x
🌐 Redis Next.js (Turbopack) 10.806s 11.024s 0.219s 3 1.02x
🐘 Postgres Next.js (Turbopack) 10.812s 11.022s 0.210s 3 1.02x
🐘 Postgres Nitro 10.858s (~) 11.023s (~) 0.165s 3 1.02x
🐘 Postgres Express 10.904s (~) 11.020s (~) 0.116s 3 1.03x
💻 Local Express 10.930s (~) 11.022s (~) 0.093s 3 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 17.442s (-5.7% 🟢) 19.380s (-4.2%) 1.938s 2 1.00x
▲ Vercel Express 17.761s (+3.5%) 19.385s (+1.5%) 1.624s 2 1.02x
▲ Vercel Next.js (Turbopack) 18.106s (-1.4%) 20.277s (+0.9%) 2.171s 2 1.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 14.171s (-6.8% 🟢) 15.030s (-6.2% 🟢) 0.859s 4 1.00x
🌐 Redis Next.js (Turbopack) 14.316s 15.031s 0.714s 4 1.01x
🐘 Postgres Next.js (Turbopack) 14.342s 15.023s 0.681s 4 1.01x
🐘 Postgres Nitro 14.497s (~) 15.022s (~) 0.525s 4 1.02x
💻 Local Next.js (Turbopack) 14.590s 15.029s 0.439s 4 1.03x
🐘 Postgres Express 14.679s (~) 15.024s (~) 0.345s 4 1.04x
💻 Local Express 14.976s (~) 15.280s (+1.7%) 0.304s 4 1.06x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 31.256s (-1.3%) 32.373s (-2.9%) 1.118s 2 1.00x
▲ Vercel Next.js (Turbopack) 32.898s (-2.5%) 34.896s (-1.3%) 1.998s 2 1.05x
▲ Vercel Nitro 34.344s (-1.7%) 35.726s (-3.5%) 1.381s 2 1.10x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 13.668s 14.024s 0.356s 7 1.00x
🌐 Redis Next.js (Turbopack) 13.819s 14.027s 0.208s 7 1.01x
🐘 Postgres Nitro 13.854s (-1.1%) 14.020s (-4.0%) 0.165s 7 1.01x
🐘 Postgres Express 14.212s (+1.3%) 14.882s (+3.0%) 0.670s 7 1.04x
💻 Local Nitro 14.672s (-14.5% 🟢) 15.028s (-16.7% 🟢) 0.355s 6 1.07x
💻 Local Next.js (Turbopack) 15.579s 16.029s 0.450s 6 1.14x
💻 Local Express 16.805s (+0.7%) 17.031s (~) 0.226s 6 1.23x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 56.457s (+7.8% 🔺) 57.638s (+6.6% 🔺) 1.181s 2 1.00x
▲ Vercel Nitro 62.923s (+11.4% 🔺) 64.472s (+10.1% 🔺) 1.549s 2 1.11x
▲ Vercel Next.js (Turbopack) 64.282s (+18.1% 🔺) 65.723s (+18.5% 🔺) 1.441s 2 1.14x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.235s 2.010s 0.775s 15 1.00x
🐘 Postgres Nitro 1.269s (+0.7%) 2.011s (~) 0.742s 15 1.03x
🐘 Postgres Express 1.276s (+0.6%) 2.012s (~) 0.736s 15 1.03x
🌐 Redis Next.js (Turbopack) 1.303s 2.007s 0.704s 15 1.06x
💻 Local Nitro 1.464s (-6.5% 🟢) 2.004s (~) 0.540s 15 1.19x
💻 Local Next.js (Turbopack) 1.491s 2.005s 0.514s 15 1.21x
💻 Local Express 1.555s (+0.9%) 2.072s (+3.3%) 0.517s 15 1.26x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.404s (-5.7% 🟢) 3.703s (-12.0% 🟢) 1.300s 9 1.00x
▲ Vercel Express 2.711s (+14.7% 🔺) 4.029s (~) 1.317s 8 1.13x
▲ Vercel Next.js (Turbopack) 2.803s (+0.7%) 4.333s (+11.5% 🔺) 1.530s 7 1.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.337s (~) 3.011s (~) 0.674s 10 1.00x
🐘 Postgres Nitro 2.357s (+1.3%) 3.011s (~) 0.654s 10 1.01x
🐘 Postgres Next.js (Turbopack) 2.369s 3.010s 0.641s 10 1.01x
💻 Local Nitro 2.561s (-17.9% 🟢) 3.008s (-22.6% 🟢) 0.447s 10 1.10x
🌐 Redis Next.js (Turbopack) 2.582s 3.009s 0.427s 10 1.11x
💻 Local Next.js (Turbopack) 2.625s 3.008s 0.384s 10 1.12x
💻 Local Express 3.114s (~) 4.011s (~) 0.897s 8 1.33x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.251s (+6.2% 🔺) 4.558s (-4.0%) 1.307s 7 1.00x
▲ Vercel Nitro 46.480s (+1527.9% 🔺) 47.841s (+984.4% 🔺) 1.361s 7 14.30x
▲ Vercel Next.js (Turbopack) 64.342s (+1969.3% 🔺) 66.190s (+1361.6% 🔺) 1.848s 5 19.79x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.485s (~) 4.014s (~) 0.529s 8 1.00x
🐘 Postgres Nitro 3.538s (+1.8%) 4.014s (~) 0.476s 8 1.02x
🐘 Postgres Next.js (Turbopack) 3.617s 4.013s 0.395s 8 1.04x
🌐 Redis Next.js (Turbopack) 4.143s 5.013s 0.869s 6 1.19x
💻 Local Nitro 6.651s (-20.6% 🟢) 7.215s (-20.1% 🟢) 0.564s 5 1.91x
💻 Local Next.js (Turbopack) 7.257s 7.767s 0.510s 4 2.08x
💻 Local Express 8.439s (+3.6%) 9.025s (~) 0.586s 4 2.42x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.040s (-11.4% 🟢) 4.389s (-15.5% 🟢) 1.349s 7 1.00x
▲ Vercel Next.js (Turbopack) 4.222s (+1.9%) 6.270s (+9.3% 🔺) 2.049s 5 1.39x
▲ Vercel Express 79.152s (+1959.8% 🔺) 80.814s (+1361.8% 🔺) 1.662s 4 26.03x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.223s 2.009s 0.786s 15 1.00x
🐘 Postgres Nitro 1.265s (+0.5%) 2.010s (~) 0.745s 15 1.03x
🐘 Postgres Express 1.267s (~) 2.009s (~) 0.743s 15 1.04x
🌐 Redis Next.js (Turbopack) 1.348s 2.007s 0.659s 15 1.10x
💻 Local Next.js (Turbopack) 1.469s 2.006s 0.537s 15 1.20x
💻 Local Nitro 1.490s (-4.9%) 2.005s (~) 0.516s 15 1.22x
💻 Local Express 1.548s (~) 2.005s (~) 0.457s 15 1.27x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.172s (-3.2%) 3.746s (+4.1%) 1.574s 9 1.00x
▲ Vercel Express 2.319s (-6.0% 🟢) 3.711s (-10.3% 🟢) 1.391s 9 1.07x
▲ Vercel Nitro 2.825s (+11.7% 🔺) 4.146s (-4.5%) 1.321s 8 1.30x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 2.335s (~) 3.011s (~) 0.676s 10 1.00x
🐘 Postgres Express 2.346s (~) 3.012s (~) 0.665s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.435s 3.010s 0.575s 10 1.04x
💻 Local Nitro 2.646s (-17.7% 🟢) 3.008s (-22.6% 🟢) 0.362s 10 1.13x
🌐 Redis Next.js (Turbopack) 2.686s 3.109s 0.423s 10 1.15x
💻 Local Next.js (Turbopack) 2.716s 3.008s 0.292s 10 1.16x
💻 Local Express 2.921s (-6.1% 🟢) 3.760s (-3.2%) 0.840s 8 1.25x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.642s (+2.0%) 3.898s (-1.4%) 1.256s 8 1.00x
▲ Vercel Nitro 2.712s (-27.6% 🟢) 4.364s (-19.3% 🟢) 1.651s 8 1.03x
▲ Vercel Next.js (Turbopack) 3.013s (+3.4%) 4.617s (+15.6% 🔺) 1.604s 8 1.14x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.477s (~) 4.013s (~) 0.536s 8 1.00x
🐘 Postgres Express 3.507s (+1.1%) 4.012s (~) 0.504s 8 1.01x
🐘 Postgres Next.js (Turbopack) 3.630s 4.011s 0.381s 8 1.04x
🌐 Redis Next.js (Turbopack) 4.203s 5.012s 0.810s 6 1.21x
💻 Local Next.js (Turbopack) 6.990s 7.522s 0.531s 4 2.01x
💻 Local Nitro 7.302s (-18.4% 🟢) 8.015s (-13.6% 🟢) 0.713s 4 2.10x
💻 Local Express 8.857s (-1.7%) 9.275s (-2.6%) 0.418s 4 2.55x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.978s (-10.8% 🟢) 4.252s (-11.9% 🟢) 1.274s 8 1.00x
▲ Vercel Nitro 3.146s (-2.0%) 4.562s (-7.2% 🟢) 1.416s 7 1.06x
▲ Vercel Next.js (Turbopack) 3.538s (-3.8%) 5.168s (+0.7%) 1.630s 6 1.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.675s (-34.2% 🟢) 1.004s (-47.5% 🟢) 0.329s 60 1.00x
🌐 Redis Next.js (Turbopack) 0.713s 1.005s 0.292s 60 1.06x
🐘 Postgres Next.js (Turbopack) 0.742s 1.007s 0.264s 60 1.10x
🐘 Postgres Nitro 0.828s (~) 1.059s (+5.2% 🔺) 0.232s 57 1.23x
💻 Local Next.js (Turbopack) 0.838s 1.004s 0.166s 60 1.24x
🐘 Postgres Express 0.863s (+1.3%) 1.025s (+1.7%) 0.163s 59 1.28x
💻 Local Express 0.973s (-2.6%) 1.004s (-29.5% 🟢) 0.032s 60 1.44x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 8.819s (-10.1% 🟢) 10.187s (-15.6% 🟢) 1.368s 6 1.00x
▲ Vercel Nitro 9.058s (-6.5% 🟢) 10.359s (-8.6% 🟢) 1.301s 6 1.03x
▲ Vercel Next.js (Turbopack) 9.754s (-4.8%) 11.492s (-3.1%) 1.738s 6 1.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 1.717s 2.028s 0.311s 45 1.00x
🐘 Postgres Next.js (Turbopack) 1.855s 2.076s 0.221s 44 1.08x
🐘 Postgres Nitro 1.932s (-1.6%) 2.124s (-1.3%) 0.193s 43 1.12x
🐘 Postgres Express 2.066s (+2.1%) 2.855s (+6.3% 🔺) 0.789s 32 1.20x
💻 Local Nitro 2.183s (-29.3% 🟢) 3.007s (-25.0% 🟢) 0.824s 30 1.27x
💻 Local Next.js (Turbopack) 2.611s 3.008s 0.397s 30 1.52x
💻 Local Express 3.005s (~) 3.608s (~) 0.603s 25 1.75x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 28.255s (-6.6% 🟢) 29.889s (-6.4% 🟢) 1.634s 4 1.00x
▲ Vercel Express 29.037s (-3.7%) 30.443s (-4.9%) 1.406s 3 1.03x
▲ Vercel Next.js (Turbopack) 29.411s (-2.2%) 31.455s (-0.7%) 2.044s 3 1.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 3.471s 4.042s 0.571s 30 1.00x
🐘 Postgres Next.js (Turbopack) 3.737s 4.010s 0.273s 30 1.08x
🐘 Postgres Nitro 3.959s (-1.6%) 4.296s (-5.2% 🟢) 0.337s 28 1.14x
🐘 Postgres Express 4.250s (+4.8%) 5.012s (+4.8%) 0.762s 24 1.22x
💻 Local Nitro 7.089s (-24.7% 🟢) 7.640s (-23.8% 🟢) 0.551s 16 2.04x
💻 Local Next.js (Turbopack) 8.219s 8.945s 0.727s 14 2.37x
💻 Local Express 9.198s (+0.6%) 9.941s (+3.2%) 0.743s 13 2.65x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 80.282s (~) 81.452s (-0.9%) 1.170s 2 1.00x
▲ Vercel Express 225.306s (+169.8% 🔺) 226.855s (+164.4% 🔺) 1.549s 2 2.81x
▲ Vercel Next.js (Turbopack) 378.895s (+352.9% 🔺) 380.630s (+343.0% 🔺) 1.735s 1 4.72x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.241s 1.007s 0.767s 60 1.00x
🐘 Postgres Express 0.295s (+6.0% 🔺) 1.009s (~) 0.714s 60 1.22x
🌐 Redis Next.js (Turbopack) 0.298s 1.005s 0.707s 60 1.24x
🐘 Postgres Nitro 0.308s (+12.7% 🔺) 1.010s (~) 0.702s 60 1.28x
💻 Local Nitro 0.563s (-17.6% 🟢) 1.021s (-1.8%) 0.458s 59 2.34x
💻 Local Express 0.575s (-1.1%) 1.004s (~) 0.430s 60 2.39x
💻 Local Next.js (Turbopack) 0.584s 1.022s 0.437s 59 2.43x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.669s (+5.8% 🔺) 3.295s (+6.2% 🔺) 1.626s 19 1.00x
▲ Vercel Nitro 1.808s (+2.4%) 3.349s (-10.7% 🟢) 1.541s 18 1.08x
▲ Vercel Next.js (Turbopack) 2.119s (+6.2% 🔺) 3.536s (-7.7% 🟢) 1.417s 18 1.27x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.482s 1.007s 0.525s 90 1.00x
🐘 Postgres Nitro 0.491s (~) 1.007s (~) 0.517s 90 1.02x
🐘 Postgres Express 0.512s (+2.8%) 1.008s (~) 0.496s 90 1.06x
🌐 Redis Next.js (Turbopack) 1.227s 2.006s 0.779s 45 2.55x
💻 Local Nitro 2.327s (-8.1% 🟢) 3.008s (~) 0.680s 30 4.83x
💻 Local Next.js (Turbopack) 2.420s 3.008s 0.588s 30 5.02x
💻 Local Express 2.548s (~) 3.009s (~) 0.461s 30 5.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.744s (-22.6% 🟢) 4.383s (-17.8% 🟢) 1.639s 21 1.00x
▲ Vercel Next.js (Turbopack) 3.974s (-12.5% 🟢) 5.484s (-10.2% 🟢) 1.510s 17 1.45x
▲ Vercel Nitro 15.036s (+348.4% 🔺) 16.282s (+221.7% 🔺) 1.246s 9 5.48x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.742s 1.007s 0.265s 120 1.00x
🐘 Postgres Nitro 0.774s (~) 1.016s (+0.8%) 0.242s 120 1.04x
🐘 Postgres Express 0.800s (+1.1%) 1.009s (~) 0.209s 119 1.08x
🌐 Redis Next.js (Turbopack) 2.768s 3.033s 0.265s 40 3.73x
💻 Local Nitro 9.987s (-12.0% 🟢) 10.605s (-11.2% 🟢) 0.619s 12 13.46x
💻 Local Next.js (Turbopack) 10.072s 10.607s 0.535s 12 13.58x
💻 Local Express 11.317s (+1.0%) 12.029s (+0.8%) 0.713s 10 15.26x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 6.948s (-24.2% 🟢) 8.606s (-20.6% 🟢) 1.659s 15 1.00x
▲ Vercel Express 7.164s (-13.2% 🟢) 8.650s (-11.6% 🟢) 1.486s 14 1.03x
▲ Vercel Next.js (Turbopack) 7.787s (-5.9% 🟢) 9.723s (~) 1.936s 13 1.12x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.142s (-34.8% 🟢) 1.003s (~) 0.009s (-20.7% 🟢) 1.015s (~) 0.873s 10 1.00x
💻 Local Next.js (Turbopack) 0.171s 1.002s 0.010s 1.016s 0.845s 10 1.20x
🐘 Postgres Next.js (Turbopack) 0.187s 1.001s 0.001s 1.011s 0.824s 10 1.32x
🌐 Redis Next.js (Turbopack) 0.187s 1.000s 0.002s 1.008s 0.821s 10 1.32x
💻 Local Express 0.206s (+1.5%) 1.004s (~) 0.012s (-3.3%) 1.018s (~) 0.812s 10 1.45x
🐘 Postgres Express 0.212s (+4.0%) 0.995s (~) 0.001s (~) 1.010s (~) 0.798s 10 1.50x
🐘 Postgres Nitro 0.214s (+2.5%) 0.994s (~) 0.001s (-13.3% 🟢) 1.011s (~) 0.797s 10 1.51x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.728s (-6.1% 🟢) 2.842s (-3.9%) 0.636s (+8.1% 🔺) 3.993s (-5.9% 🟢) 2.265s 10 1.00x
▲ Vercel Nitro 1.972s (+10.7% 🔺) 3.026s (+3.8%) 0.537s (~) 4.084s (-0.9%) 2.111s 10 1.14x
▲ Vercel Next.js (Turbopack) 2.069s (+3.3%) 3.236s (+8.6% 🔺) 0.253s (-62.4% 🟢) 4.119s (-1.8%) 2.050s 10 1.20x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 0.508s 1.000s 0.006s 1.015s 0.507s 60 1.00x
💻 Local Nitro 0.564s (-25.8% 🟢) 1.010s (~) 0.009s (-6.3% 🟢) 1.023s (~) 0.459s 59 1.11x
🐘 Postgres Next.js (Turbopack) 0.601s 1.009s 0.004s 1.027s 0.426s 59 1.18x
🐘 Postgres Nitro 0.616s (+1.9%) 1.003s (~) 0.004s (-1.7%) 1.023s (~) 0.407s 59 1.21x
🐘 Postgres Express 0.631s (+2.3%) 1.001s (~) 0.004s (-4.0%) 1.037s (+1.3%) 0.406s 58 1.24x
💻 Local Next.js (Turbopack) 0.670s 1.009s 0.009s 1.023s 0.352s 59 1.32x
💻 Local Express 0.735s (+1.5%) 1.010s (~) 0.009s (+8.9% 🔺) 1.022s (~) 0.288s 59 1.45x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.279s (-0.8%) 5.261s (-3.8%) 0.216s (-6.6% 🟢) 6.018s (-6.9% 🟢) 1.739s 10 1.00x
▲ Vercel Next.js (Turbopack) 4.615s (-21.5% 🟢) 5.917s (-14.7% 🟢) 0.272s (-36.0% 🟢) 6.883s (-13.2% 🟢) 2.268s 9 1.08x
▲ Vercel Nitro 65.381s (+1129.9% 🔺) 66.469s (+905.4% 🔺) 0.210s (-63.8% 🟢) 67.366s (+757.6% 🔺) 1.984s 5 15.28x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.907s 1.135s 0.000s 1.163s 0.256s 52 1.00x
🐘 Postgres Nitro 0.939s (-3.8%) 1.102s (-5.4% 🟢) 0.000s (-5.5% 🟢) 1.125s (-5.2% 🟢) 0.187s 55 1.04x
🌐 Redis Next.js (Turbopack) 0.946s 1.052s 0.000s 1.057s 0.111s 57 1.04x
🐘 Postgres Express 0.955s (-2.3%) 1.170s (-2.3%) 0.000s (+Infinity% 🔺) 1.186s (-4.1%) 0.231s 51 1.05x
💻 Local Nitro 1.127s (-13.0% 🟢) 2.017s (~) 0.000s (+18.2% 🔺) 2.020s (~) 0.893s 30 1.24x
💻 Local Next.js (Turbopack) 1.242s 2.019s 0.000s 2.023s 0.781s 30 1.37x
💻 Local Express 1.258s (+0.9%) 2.021s (~) 0.000s (+12.5% 🔺) 2.024s (~) 0.767s 30 1.39x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.928s (-2.5%) 3.778s (-7.8% 🟢) 0.000s (-73.5% 🟢) 4.311s (-10.5% 🟢) 1.383s 14 1.00x
▲ Vercel Nitro 2.998s (+3.9%) 4.007s (+1.0%) 0.001s (+317.9% 🔺) 4.536s (-1.9%) 1.538s 14 1.02x
▲ Vercel Next.js (Turbopack) 3.330s (+2.1%) 4.603s (+11.6% 🔺) 0.000s (+Infinity% 🔺) 5.257s (+12.2% 🔺) 1.927s 12 1.14x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.721s (~) 2.102s (~) 0.000s (-100.0% 🟢) 2.150s (+1.8%) 0.429s 28 1.00x
🌐 Redis Next.js (Turbopack) 1.756s 2.180s 0.000s 2.185s 0.429s 28 1.02x
🐘 Postgres Next.js (Turbopack) 1.787s 2.110s 0.000s 2.155s 0.368s 28 1.04x
🐘 Postgres Express 1.814s (+3.7%) 2.138s (+3.5%) 0.000s (+Infinity% 🔺) 2.161s (+2.8%) 0.347s 28 1.05x
💻 Local Nitro 3.401s (-8.9% 🟢) 3.970s (-6.3% 🟢) 0.000s (-57.4% 🟢) 3.973s (-6.3% 🟢) 0.572s 16 1.98x
💻 Local Express 3.431s (-5.3% 🟢) 4.034s (-1.6%) 0.001s (+114.3% 🔺) 4.037s (-1.6%) 0.606s 15 1.99x
💻 Local Next.js (Turbopack) 3.474s 4.032s 0.001s 4.037s 0.563s 15 2.02x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.133s (+10.6% 🔺) 5.294s (+5.2% 🔺) 0.000s (-100.0% 🟢) 5.858s (+3.7%) 1.726s 11 1.00x
▲ Vercel Nitro 4.172s (~) 5.292s (-1.5%) 0.000s (NaN%) 5.829s (-3.4%) 1.657s 11 1.01x
▲ Vercel Next.js (Turbopack) 4.519s (-14.3% 🟢) 5.627s (-9.6% 🟢) 0.001s (+Infinity% 🔺) 6.347s (-6.2% 🟢) 1.828s 10 1.09x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 19/21
🐘 Postgres Next.js (Turbopack) 16/21
▲ Vercel Express 12/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 17/21
Next.js (Turbopack) 🐘 Postgres 10/21
Nitro 🐘 Postgres 12/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants