Skip to content

docs: add error monitoring & alerting recipe#1114

Closed
johnlindquist wants to merge 8 commits intomainfrom
docs/error-monitoring
Closed

docs: add error monitoring & alerting recipe#1114
johnlindquist wants to merge 8 commits intomainfrom
docs/error-monitoring

Conversation

@johnlindquist
Copy link
Contributor

Summary

  • Adds a new Recipes section to the documentation with an Error Monitoring & Alerting guide
  • Covers error triage, alert processing pipelines, real-time alert dispatch, external system monitoring, and content security scanning
  • Motivated by usage data: 39% of ALL runs (4.7M) are error handling workflows - the update docs sidebar to auto expand #1 use case by volume
  • All 6 TypeScript code samples pass type checking; all links validated

Test plan

  • Verify MDX renders correctly in local dev server
  • Verify code examples are syntactically valid (all pass pnpm test:docs)
  • Verify meta.json navigation works (Recipes section appears after AI)
  • Verify link validation passes (bun run lint:links - 0 errors)

swarm:codex-next-readme and others added 8 commits February 18, 2026 09:48
Replaces the placeholder @workflow/next README with a complete package-level reference.
The new content documents installation, withWorkflow() API usage/signature,
configuration examples, internal behavior, env vars, exports, generated files,
runtime routing, public manifest exposure, and troubleshooting.

Verified: rg -n "^## Install|^### Type signature|^### Example: object config|^### Example: async config function|^## What .* does|^## Serving the manifest publicly|^## Troubleshooting" packages/next/README.md
Verified: rg -n "WORKFLOW_TARGET_WORLD|WORKFLOW_LOCAL_DATA_DIR|PORT|WORKFLOW_NEXT_PRIVATE_BUILT|WORKFLOW_PUBLIC_MANIFEST|WATCHPACK_WATCHER_LIMIT" packages/next/README.md
Verified: rg -n "@workflow/next|@workflow/next/loader|@workflow/next/runtime|\.well-known/workflow/v1/flow/route\.js|\.well-known/workflow/v1/step/route\.js|\.well-known/workflow/v1/webhook/\[token\]/route\.js" packages/next/README.md

How to test: open packages/next/README.md and confirm all required sections and tables render correctly.
Update spec.md to resolve the static/instance method contradiction, document forbidden step-expression validation errors, and add import compatibility guidance for serialization-file discovery.

Verified: git diff --check -- packages/swc-plugin-workflow/spec.md
Verified: npx --yes markdownlint-cli@0.41.0 packages/swc-plugin-workflow/spec.md --disable MD013 (fails with pre-existing file-wide markdown style issues unrelated to this change)
Add the requested blog markdown file at .blog/durable-execution-layer.md\nwith exact content and preserved formatting/code blocks.\n\nVerified: diff -u <(cat <<'EOF' ... ) .blog/durable-execution-layer.md (no diff; exact match)\nVerified: pnpm exec biome check .blog/durable-execution-layer.md (file is ignored by repo biome config)
Add the requested blog draft as an exact markdown copy for agent reliability content.

Verified: cat <<'EOF' | cmp -s - .blog/stateless-retries-multiply-agent-side-effects.md && echo "Exact content match verified"
Verified: git status --short -- .blog/stateless-retries-multiply-agent-side-effects.md
Overwrite .blog/durable-execution-layer.md with the exact requested markdown content, including code blocks and section structure.

Verified: git diff --check -- .blog/durable-execution-layer.md

Verified: git diff -- .blog/durable-execution-layer.md
Overwrite the blog markdown with the exact provided copy for Workflow DevKit deterministic replay behavior and code patterns.

Verified: diff -u .blog/how-deterministic-replay-works-for-ai-agents.md <(cat <<'EOF' ... EOF) (no differences)

Verified: pnpm exec biome check .blog/how-deterministic-replay-works-for-ai-agents.md (path ignored by biome config; no file-level lint available)
Overwrite the target blog file with the exact markdown content provided for this task.\n\nThis preserves all headings, prose, and fenced code examples verbatim.\n\nVerified: cat <<'EOF' | diff -u - .blog/stateless-retries-multiply-agent-side-effects.md (no diff; exit 0)\nVerified: repository Biome config does not include Markdown files (.md), so no project-scoped markdown linter applies
@changeset-bot
Copy link

changeset-bot bot commented Feb 18, 2026

⚠️ No Changeset found

Latest commit: d2d283e

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel
Copy link
Contributor

vercel bot commented Feb 18, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Feb 18, 2026 5:59pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Feb 18, 2026 5:59pm
example-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-astro-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-express-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-fastify-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-hono-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-nitro-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-nuxt-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workbench-vite-workflow Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Feb 18, 2026 5:59pm
workflow-nest Ready Ready Preview, Comment Feb 18, 2026 5:59pm
workflow-swc-playground Ready Ready Preview, Comment Feb 18, 2026 5:59pm

@github-actions
Copy link
Contributor

github-actions bot commented Feb 18, 2026

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
❌ ▲ Vercel Production 532 2 38 572
✅ 💻 Local Development 556 0 68 624
✅ 📦 Local Production 556 0 68 624
✅ 🐘 Local Postgres 556 0 68 624
✅ 🪟 Windows 49 0 3 52
❌ 🌍 Community Worlds 110 46 9 165
✅ 📋 Other 135 0 21 156
Total 2494 48 275 2817

❌ Failed Tests

▲ Vercel Production (2 failed)

express (1 failed):

  • hookCleanupTestWorkflow - hook token reuse after workflow completion

nextjs-webpack (1 failed):

  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
🌍 Community Worlds (46 failed)

mongodb (1 failed):

  • webhookWorkflow

turso (45 failed):

  • addTenWorkflow
  • addTenWorkflow
  • should work with react rendering in step
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • hookWorkflow
  • webhookWorkflow
  • sleepingWorkflow
  • parallelSleepWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling retry behavior workflow completes despite transient 5xx on step_completed
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
  • instanceMethodStepWorkflow - instance methods with "use step" directive
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument
  • cancelRun - cancelling a running workflow
  • cancelRun via CLI - cancelling a running workflow
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router

Details by Category

❌ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 48 0 4
✅ example 48 0 4
❌ express 47 1 4
✅ fastify 48 0 4
✅ hono 48 0 4
✅ nextjs-turbopack 51 0 1
❌ nextjs-webpack 50 1 1
✅ nitro 48 0 4
✅ nuxt 48 0 4
✅ sveltekit 48 0 4
✅ vite 48 0 4
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 45 0 7
✅ express-stable 45 0 7
✅ fastify-stable 45 0 7
✅ hono-stable 45 0 7
✅ nextjs-turbopack-canary 49 0 3
✅ nextjs-turbopack-stable 49 0 3
✅ nextjs-webpack-canary 49 0 3
✅ nextjs-webpack-stable 49 0 3
✅ nitro-stable 45 0 7
✅ nuxt-stable 45 0 7
✅ sveltekit-stable 45 0 7
✅ vite-stable 45 0 7
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 45 0 7
✅ express-stable 45 0 7
✅ fastify-stable 45 0 7
✅ hono-stable 45 0 7
✅ nextjs-turbopack-canary 49 0 3
✅ nextjs-turbopack-stable 49 0 3
✅ nextjs-webpack-canary 49 0 3
✅ nextjs-webpack-stable 49 0 3
✅ nitro-stable 45 0 7
✅ nuxt-stable 45 0 7
✅ sveltekit-stable 45 0 7
✅ vite-stable 45 0 7
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 45 0 7
✅ express-stable 45 0 7
✅ fastify-stable 45 0 7
✅ hono-stable 45 0 7
✅ nextjs-turbopack-canary 49 0 3
✅ nextjs-turbopack-stable 49 0 3
✅ nextjs-webpack-canary 49 0 3
✅ nextjs-webpack-stable 49 0 3
✅ nitro-stable 45 0 7
✅ nuxt-stable 45 0 7
✅ sveltekit-stable 45 0 7
✅ vite-stable 45 0 7
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 49 0 3
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 3 0 0
❌ mongodb 48 1 3
✅ redis-dev 3 0 0
✅ redis 49 0 3
✅ turso-dev 3 0 0
❌ turso 4 45 3
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 45 0 7
✅ e2e-local-postgres-nest-stable 45 0 7
✅ e2e-local-prod-nest-stable 45 0 7

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 18, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.026s (-22.8% 🟢) 1.005s (~) 0.979s 10 1.00x
💻 Local Express 0.032s (~) 1.005s (~) 0.973s 10 1.25x
🌐 Redis Next.js (Turbopack) 0.047s 1.005s 0.958s 10 1.80x
🐘 Postgres Express 0.098s (-4.9%) 1.011s (~) 0.912s 10 3.78x
🌐 MongoDB Next.js (Turbopack) 0.107s 1.007s 0.900s 10 4.13x
🐘 Postgres Nitro 0.397s (-16.8% 🟢) 1.010s (~) 0.613s 10 15.25x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.599s (-13.1% 🟢) 1.935s (-6.8% 🟢) 1.336s 10 1.00x
▲ Vercel Next.js (Turbopack) 0.610s (-24.9% 🟢) 1.964s (-5.0% 🟢) 1.353s 10 1.02x
▲ Vercel Nitro 0.631s (-40.8% 🟢) 2.083s (-16.1% 🟢) 1.452s 10 1.05x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.073s (-2.9%) 2.006s (~) 0.933s 10 1.00x
💻 Local Express 1.106s (~) 2.006s (~) 0.900s 10 1.03x
🌐 Redis Next.js (Turbopack) 1.112s 2.006s 0.894s 10 1.04x
🌐 MongoDB Next.js (Turbopack) 1.314s 2.008s 0.694s 10 1.22x
🐘 Postgres Nitro 2.269s (-3.4%) 3.014s (~) 0.746s 10 2.11x
🐘 Postgres Express 2.464s (-0.5%) 3.014s (~) 0.550s 10 2.30x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.565s (+11.9% 🔺) 3.865s (+23.1% 🔺) 1.299s 10 1.00x
▲ Vercel Express 3.247s (+48.8% 🔺) 4.330s (+37.3% 🔺) 1.082s 10 1.27x
▲ Vercel Next.js (Turbopack) 4.053s (+80.3% 🔺) 5.227s (+68.3% 🔺) 1.174s 10 1.58x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 10.544s (-2.6%) 11.022s (~) 0.478s 3 1.00x
🌐 Redis Next.js (Turbopack) 10.714s 11.023s 0.309s 3 1.02x
💻 Local Express 10.815s (~) 11.022s (~) 0.207s 3 1.03x
🌐 MongoDB Next.js (Turbopack) 12.229s 13.021s 0.792s 3 1.16x
🐘 Postgres Nitro 20.122s (~) 21.060s (~) 0.937s 2 1.91x
🐘 Postgres Express 20.315s (~) 21.060s (~) 0.745s 2 1.93x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 29.232s (+66.0% 🔺) 30.456s (+58.2% 🔺) 1.224s 1 1.00x
▲ Vercel Next.js (Turbopack) 30.702s (+54.2% 🔺) 31.999s (+53.3% 🔺) 1.297s 1 1.05x
▲ Vercel Express 36.162s (+104.7% 🔺) 37.477s (+99.5% 🔺) 1.315s 2 1.24x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 26.790s (-2.5%) 27.048s (-3.6%) 0.257s 3 1.00x
🌐 Redis Next.js (Turbopack) 26.900s 27.052s 0.152s 3 1.00x
💻 Local Express 27.476s (~) 28.050s (~) 0.574s 3 1.03x
🌐 MongoDB Next.js (Turbopack) 30.597s 31.051s 0.454s 2 1.14x
🐘 Postgres Express 50.347s (~) 51.128s (+1.0%) 0.781s 2 1.88x
🐘 Postgres Nitro 50.401s (~) 51.137s (~) 0.736s 2 1.88x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 46.784s (+8.1% 🔺) 48.602s (+9.7% 🔺) 1.818s 2 1.00x
▲ Vercel Next.js (Turbopack) 47.395s (+9.6% 🔺) 48.318s (+7.8% 🔺) 0.923s 2 1.01x
▲ Vercel Express 49.590s (+15.6% 🔺) 51.026s (+15.8% 🔺) 1.436s 2 1.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 54.389s 55.103s 0.714s 2 1.00x
💻 Local Nitro 55.659s (-2.8%) 56.101s (-3.4%) 0.442s 2 1.02x
💻 Local Express 57.190s (~) 58.100s (~) 0.910s 2 1.05x
🌐 MongoDB Next.js (Turbopack) 61.395s 62.089s 0.694s 2 1.13x
🐘 Postgres Nitro 93.570s (-6.6% 🟢) 94.235s (-6.0% 🟢) 0.665s 1 1.72x
🐘 Postgres Express 100.231s (~) 101.232s (~) 1.001s 1 1.84x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 88.393s (+2.0%) 90.209s (+2.7%) 1.816s 1 1.00x
▲ Vercel Express 89.983s (+1.8%) 90.626s (+1.7%) 0.643s 1 1.02x
▲ Vercel Next.js (Turbopack) 90.459s (+2.7%) 92.537s (+3.5%) 2.078s 1 1.02x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 1.257s 2.006s 0.749s 15 1.00x
💻 Local Nitro 1.371s (-4.5%) 2.005s (~) 0.634s 15 1.09x
💻 Local Express 1.411s (+0.7%) 2.006s (~) 0.595s 15 1.12x
🐘 Postgres Nitro 1.904s (-10.8% 🟢) 2.598s (-13.8% 🟢) 0.695s 12 1.51x
🌐 MongoDB Next.js (Turbopack) 2.153s 3.008s 0.856s 10 1.71x
🐘 Postgres Express 2.256s (-6.3% 🟢) 3.015s (~) 0.759s 10 1.79x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.544s (+53.5% 🔺) 4.590s (+39.2% 🔺) 1.045s 7 1.00x
▲ Vercel Next.js (Turbopack) 3.800s (+11.3% 🔺) 4.663s (+8.2% 🔺) 0.863s 8 1.07x
▲ Vercel Express 35.644s (+1368.4% 🔺) 35.999s (+967.0% 🔺) 0.355s 1 10.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 2.289s (-12.1% 🟢) 3.007s (~) 0.718s 10 1.00x
🌐 Redis Next.js (Turbopack) 2.519s 3.008s 0.489s 10 1.10x
💻 Local Express 2.544s (~) 3.008s (~) 0.464s 10 1.11x
🌐 MongoDB Next.js (Turbopack) 4.732s 5.178s 0.446s 6 2.07x
🐘 Postgres Express 7.779s (-3.6%) 8.534s (+3.1%) 0.755s 4 3.40x
🐘 Postgres Nitro 8.342s (-1.7%) 9.031s (~) 0.689s 4 3.64x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 14.377s (+362.7% 🔺) 15.820s (+274.0% 🔺) 1.443s 2 1.00x
▲ Vercel Nitro 31.262s (+1076.5% 🔺) 32.278s (+833.4% 🔺) 1.015s 2 2.17x
▲ Vercel Next.js (Turbopack) 32.243s (+911.1% 🔺) 32.987s (+742.5% 🔺) 0.744s 1 2.24x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 4.115s 4.726s 0.611s 7 1.00x
💻 Local Nitro 6.347s (-13.6% 🟢) 7.013s (-12.5% 🟢) 0.666s 5 1.54x
💻 Local Express 7.184s (-1.3%) 8.017s (~) 0.833s 4 1.75x
🌐 MongoDB Next.js (Turbopack) 10.098s 10.688s 0.590s 3 2.45x
🐘 Postgres Express 45.411s (+9.1% 🔺) 46.145s (+9.6% 🔺) 0.734s 1 11.04x
🐘 Postgres Nitro 48.855s (+1.1%) 49.136s (~) 0.281s 1 11.87x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 14.295s (+208.2% 🔺) 15.202s (+170.5% 🔺) 0.907s 2 1.00x
▲ Vercel Next.js (Turbopack) 15.300s (+201.2% 🔺) 15.868s (+160.1% 🔺) 0.568s 2 1.07x
▲ Vercel Nitro 17.376s (+420.0% 🔺) 18.232s (+324.0% 🔺) 0.856s 2 1.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 1.275s 2.006s 0.732s 15 1.00x
💻 Local Nitro 1.361s (-4.8%) 2.005s (~) 0.644s 15 1.07x
💻 Local Express 1.415s (~) 2.004s (~) 0.589s 15 1.11x
🐘 Postgres Nitro 2.061s (-9.3% 🟢) 2.600s (-3.1%) 0.540s 12 1.62x
🐘 Postgres Express 2.146s (+9.3% 🔺) 2.597s (+3.3%) 0.451s 12 1.68x
🌐 MongoDB Next.js (Turbopack) 2.155s 3.008s 0.852s 10 1.69x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.464s (+11.4% 🔺) 3.387s (+3.5%) 0.923s 9 1.00x
▲ Vercel Nitro 4.148s (+55.9% 🔺) 5.339s (+46.8% 🔺) 1.192s 6 1.68x
▲ Vercel Next.js (Turbopack) 11.720s (+421.2% 🔺) 12.852s (+299.6% 🔺) 1.132s 3 4.76x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 2.383s (-11.1% 🟢) 3.007s (~) 0.624s 10 1.00x
🌐 Redis Next.js (Turbopack) 2.491s 3.008s 0.517s 10 1.05x
💻 Local Express 2.695s (~) 3.007s (~) 0.313s 10 1.13x
🌐 MongoDB Next.js (Turbopack) 4.789s 5.179s 0.390s 6 2.01x
🐘 Postgres Express 10.894s (-4.9%) 11.032s (-8.3% 🟢) 0.139s 3 4.57x
🐘 Postgres Nitro 12.359s (-7.2% 🟢) 12.702s (-7.3% 🟢) 0.343s 3 5.19x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.188s (+27.1% 🔺) 3.856s (+12.1% 🔺) 0.668s 8 1.00x
▲ Vercel Nitro 6.046s (+162.2% 🔺) 6.730s (+111.6% 🔺) 0.684s 5 1.90x
▲ Vercel Express 27.074s (+923.3% 🔺) 27.555s (+674.6% 🔺) 0.481s 2 8.49x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Redis 🥇 Next.js (Turbopack) 4.078s 4.582s 0.503s 7 1.00x
💻 Local Nitro 6.799s (-13.6% 🟢) 7.013s (-15.2% 🟢) 0.214s 5 1.67x
💻 Local Express 7.808s (-3.3%) 8.271s (~) 0.463s 4 1.91x
🌐 MongoDB Next.js (Turbopack) 10.106s 10.685s 0.579s 3 2.48x
🐘 Postgres Express 50.006s (-2.9%) 50.108s (-3.9%) 0.102s 1 12.26x
🐘 Postgres Nitro 50.306s (-3.2%) 51.122s (-1.9%) 0.816s 1 12.33x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 8.640s (+124.0% 🔺) 10.201s (+102.8% 🔺) 1.561s 3 1.00x
▲ Vercel Nitro 23.673s (+664.4% 🔺) 24.807s (+522.5% 🔺) 1.134s 2 2.74x
▲ Vercel Express 28.133s (+629.3% 🔺) 29.043s (+524.6% 🔺) 0.910s 2 3.26x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.115s (-34.3% 🟢) 1.003s (~) 0.010s (-9.0% 🟢) 1.016s (~) 0.900s 10 1.00x
🌐 Redis Next.js (Turbopack) 0.152s 1.000s 0.001s 1.007s 0.855s 10 1.32x
💻 Local Express 0.174s (+3.4%) 1.002s (~) 0.011s (-4.3%) 1.016s (~) 0.842s 10 1.52x
🌐 MongoDB Next.js (Turbopack) 0.490s 0.957s 0.001s 1.009s 0.519s 10 4.26x
🐘 Postgres Nitro 1.207s (-45.8% 🟢) 1.904s (-32.4% 🟢) 0.001s (-23.5% 🟢) 2.014s (-33.2% 🟢) 0.806s 10 10.49x
🐘 Postgres Express 2.341s (-4.7%) 2.699s (+4.4%) 0.001s (~) 3.015s (~) 0.674s 10 20.34x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.107s (-15.3% 🟢) 2.575s (-16.1% 🟢) 0.589s (+153.7% 🔺) 3.693s (-4.3%) 1.585s 10 1.00x
▲ Vercel Nitro 2.270s (+17.2% 🔺) 2.690s (~) 0.175s (-70.3% 🟢) 3.588s (-6.1% 🟢) 1.318s 10 1.08x
▲ Vercel Express 3.868s (+96.7% 🔺) 4.366s (+65.7% 🔺) 0.639s (+5.4% 🔺) 5.555s (+46.3% 🔺) 1.687s 10 1.84x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 12/12
🐘 Postgres Express 6/12
▲ Vercel Nitro 5/12
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 💻 Local 12/12
Next.js (Turbopack) 🌐 Redis 12/12
Nitro 💻 Local 12/12
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@johnlindquist
Copy link
Contributor Author

Superseded by #1116 which consolidates all recipes into a single PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant