Skip to content

[cli] Fix false "data expired" warning in CLI for non-expired runs#1736

Merged
karthikscale3 merged 85 commits intomainfrom
karthik/fi-cli
Apr 15, 2026
Merged

[cli] Fix false "data expired" warning in CLI for non-expired runs#1736
karthikscale3 merged 85 commits intomainfrom
karthik/fi-cli

Conversation

@karthikscale3
Copy link
Copy Markdown
Collaborator

@karthikscale3 karthikscale3 commented Apr 14, 2026

Summary

  • The CLI's hasExpiredData check only verified that expiredAt was non-null, without comparing it against the current time. Any run with a retention policy (which sets expiredAt to a future date at creation) would incorrectly trigger the "This run's data has expired" warning.
  • Added a new Date(expiredAt) < new Date() comparison in both hasExpiredData and formatTableValue, matching the logic already used in the web-shared UI.
  • Added tests for both functions.

@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
ad8b7f1
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
e0cb61b
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
051cadc
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
af8ac1f
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
e68e7d2
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
8305e5b
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
f3da688
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
f8ee413
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
589cbd7
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
e979fdf
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
d4baed2
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
53503a4
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
d51e2e4
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
5123088
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
dd1a307
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
00bcfcd
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
f6a157b
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
816f35b
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
2b87dce
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
146de28
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
0ef6455
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
2d8c690
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
3513471
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
0f5d29e
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
c76001e
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
f97184f
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
f71c531
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
530e598
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
ea38511
@karthikscale3
Merge branch 'main' of github.com:vercel/workflow
19b1a3f
@changeset-bot
Copy link
Copy Markdown

changeset-bot bot commented Apr 14, 2026

🦋 Changeset detected

Latest commit: 955f11b

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
Name Type
@workflow/cli Patch
workflow Patch
@workflow/world-testing Patch
@workflow/ai Patch
@workflow/core Patch
@workflow/builders Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/vitest Patch
@workflow/web-shared Patch
@workflow/web Patch
@workflow/astro Patch
@workflow/nest Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Apr 14, 2026 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 14, 2026 11:10pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 14, 2026 11:10pm
example-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-express-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 14, 2026 11:10pm
workflow-swc-playground Ready Ready Preview, Comment Apr 14, 2026 11:10pm
workflow-web Ready Ready Preview, Comment Apr 14, 2026 11:10pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.043s (+5.6% 🔺) 1.006s (~) 0.963s 10 1.00x
💻 Local Express 0.044s (+2.6%) 1.005s (~) 0.962s 10 1.01x
💻 Local Next.js (Turbopack) 0.048s 1.006s 0.958s 10 1.10x
🐘 Postgres Next.js (Turbopack) 0.056s 1.010s 0.954s 10 1.30x
🐘 Postgres Express 0.060s (-15.2% 🟢) 1.009s (-0.9%) 0.950s 10 1.38x
🐘 Postgres Nitro 0.060s (+29.2% 🔺) 1.011s (~) 0.951s 10 1.39x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.193s (-62.2% 🟢) 1.490s (-40.9% 🟢) 1.298s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 1.123s (~) 2.006s (~) 0.883s 10 1.00x
💻 Local Next.js (Turbopack) 1.127s 2.006s 0.879s 10 1.00x
💻 Local Nitro 1.132s (~) 2.007s (~) 0.875s 10 1.01x
🐘 Postgres Next.js (Turbopack) 1.140s 2.011s 0.871s 10 1.02x
🐘 Postgres Nitro 1.149s (+3.2%) 2.011s (~) 0.861s 10 1.02x
🐘 Postgres Express 1.161s (+0.9%) 2.020s (~) 0.859s 10 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.011s (-4.6%) 3.786s (+7.1% 🔺) 1.775s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 10.772s 11.025s 0.253s 3 1.00x
🐘 Postgres Express 10.869s (~) 11.023s (~) 0.154s 3 1.01x
🐘 Postgres Next.js (Turbopack) 10.881s 11.022s 0.141s 3 1.01x
💻 Local Express 10.935s (~) 11.024s (~) 0.089s 3 1.02x
🐘 Postgres Nitro 10.944s (+2.5%) 11.025s (~) 0.081s 3 1.02x
💻 Local Nitro 10.964s (~) 11.023s (~) 0.059s 3 1.02x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 16.488s (-9.7% 🟢) 18.128s (-12.3% 🟢) 1.641s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 14.551s (~) 15.030s (~) 0.479s 4 1.00x
🐘 Postgres Nitro 14.671s (+4.6%) 15.029s (+2.8%) 0.357s 4 1.01x
🐘 Postgres Next.js (Turbopack) 14.683s 15.278s 0.595s 4 1.01x
💻 Local Next.js (Turbopack) 14.688s 15.030s 0.342s 4 1.01x
💻 Local Express 14.997s (~) 15.281s (-1.6%) 0.284s 4 1.03x
💻 Local Nitro 15.082s (+0.8%) 16.032s (+6.7% 🔺) 0.949s 4 1.04x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 30.508s (-6.4% 🟢) 32.539s (-5.5% 🟢) 2.031s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 13.895s (~) 14.164s (~) 0.269s 7 1.00x
🐘 Postgres Next.js (Turbopack) 14.019s 14.739s 0.721s 7 1.01x
🐘 Postgres Nitro 14.174s (+9.8% 🔺) 15.023s (+15.4% 🔺) 0.849s 6 1.02x
💻 Local Next.js (Turbopack) 16.213s 17.032s 0.819s 6 1.17x
💻 Local Express 16.757s (+1.2%) 17.032s (~) 0.275s 6 1.21x
💻 Local Nitro 17.014s (+3.8%) 17.534s (+3.0%) 0.520s 6 1.22x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 52.276s (-15.7% 🟢) 54.198s (-15.0% 🟢) 1.922s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.241s 2.011s 0.770s 15 1.00x
🐘 Postgres Express 1.262s (-1.2%) 2.009s (~) 0.747s 15 1.02x
🐘 Postgres Nitro 1.266s (+5.9% 🔺) 2.009s (~) 0.743s 15 1.02x
💻 Local Express 1.495s (-1.1%) 2.006s (~) 0.510s 15 1.21x
💻 Local Nitro 1.526s (+2.0%) 2.006s (~) 0.480s 15 1.23x
💻 Local Next.js (Turbopack) 1.568s 2.006s 0.438s 15 1.26x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.376s (-6.9% 🟢) 3.995s (+3.7%) 1.619s 8 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.327s (~) 3.009s (~) 0.682s 10 1.00x
🐘 Postgres Nitro 2.347s (+2.5%) 3.010s (~) 0.662s 10 1.01x
🐘 Postgres Next.js (Turbopack) 2.401s 3.010s 0.609s 10 1.03x
💻 Local Next.js (Turbopack) 2.961s 3.564s 0.603s 9 1.27x
💻 Local Express 3.061s (+5.9% 🔺) 3.565s (+14.7% 🔺) 0.504s 9 1.32x
💻 Local Nitro 3.142s (+15.6% 🔺) 4.010s (+33.3% 🔺) 0.868s 8 1.35x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.160s (+72.2% 🔺) 5.863s (+59.8% 🔺) 1.703s 7 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.450s (+1.8%) 4.012s (~) 0.562s 8 1.00x
🐘 Postgres Express 3.531s (+1.3%) 4.010s (~) 0.479s 8 1.02x
🐘 Postgres Next.js (Turbopack) 3.688s 4.012s 0.324s 8 1.07x
💻 Local Express 8.282s (+4.5%) 9.024s (+5.9% 🔺) 0.743s 4 2.40x
💻 Local Next.js (Turbopack) 8.366s 8.767s 0.401s 4 2.42x
💻 Local Nitro 8.625s (+12.8% 🔺) 9.022s (+12.5% 🔺) 0.397s 4 2.50x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.906s (-21.5% 🟢) 4.319s (-19.5% 🟢) 1.413s 8 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.228s 2.008s 0.780s 15 1.00x
🐘 Postgres Nitro 1.256s (+4.5%) 2.009s (~) 0.752s 15 1.02x
🐘 Postgres Express 1.271s (+1.4%) 2.008s (~) 0.736s 15 1.04x
💻 Local Next.js (Turbopack) 1.537s 2.005s 0.469s 15 1.25x
💻 Local Express 1.561s (-18.3% 🟢) 2.006s (-16.1% 🟢) 0.445s 15 1.27x
💻 Local Nitro 1.589s (+2.3%) 2.006s (~) 0.417s 15 1.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.835s (-19.7% 🟢) 3.648s (-7.6% 🟢) 1.812s 9 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.349s (~) 3.011s (~) 0.662s 10 1.00x
🐘 Postgres Nitro 2.350s (+2.8%) 3.010s (~) 0.660s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.422s 3.009s 0.587s 10 1.03x
💻 Local Next.js (Turbopack) 2.963s 3.759s 0.797s 8 1.26x
💻 Local Express 3.163s (~) 4.011s (~) 0.848s 8 1.35x
💻 Local Nitro 3.163s (+7.1% 🔺) 3.885s (+21.1% 🔺) 0.722s 8 1.35x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.180s (-19.5% 🟢) 3.654s (-5.1% 🟢) 1.474s 9 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.477s (+2.5%) 4.010s (~) 0.533s 8 1.00x
🐘 Postgres Express 3.477s (~) 4.010s (~) 0.533s 8 1.00x
🐘 Postgres Next.js (Turbopack) 3.667s 4.013s 0.346s 8 1.05x
💻 Local Next.js (Turbopack) 8.254s 8.767s 0.513s 4 2.37x
💻 Local Nitro 9.336s (+15.7% 🔺) 10.023s (+14.3% 🔺) 0.687s 3 2.69x
💻 Local Express 9.407s (+5.9% 🔺) 10.027s (+8.1% 🔺) 0.621s 3 2.71x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.973s (+10.2% 🔺) 4.507s (+5.8% 🔺) 1.534s 7 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.794s 1.024s 0.229s 59 1.00x
🐘 Postgres Express 0.802s (-5.0% 🟢) 1.023s (-1.7%) 0.221s 59 1.01x
🐘 Postgres Nitro 0.835s (+43.3% 🔺) 1.023s (+1.7%) 0.188s 59 1.05x
💻 Local Next.js (Turbopack) 0.843s 1.005s 0.162s 60 1.06x
💻 Local Express 0.985s (~) 1.181s (+3.9%) 0.197s 51 1.24x
💻 Local Nitro 1.026s (+1.4%) 1.942s (+29.0% 🔺) 0.916s 31 1.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 9.680s (-1.9%) 11.353s (+2.8%) 1.674s 6 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.879s (-4.5%) 2.053s (-10.1% 🟢) 0.174s 44 1.00x
🐘 Postgres Next.js (Turbopack) 2.032s 2.467s 0.435s 37 1.08x
🐘 Postgres Nitro 2.042s (+44.5% 🔺) 2.536s (+26.3% 🔺) 0.493s 36 1.09x
💻 Local Next.js (Turbopack) 2.706s 3.008s 0.301s 30 1.44x
💻 Local Express 3.021s (~) 3.649s (+4.0%) 0.628s 25 1.61x
💻 Local Nitro 3.099s (+2.4%) 4.011s (+8.7% 🔺) 0.911s 23 1.65x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 27.749s (-8.1% 🟢) 29.768s (-5.7% 🟢) 2.019s 4 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 3.828s 4.042s 0.214s 30 1.00x
🐘 Postgres Express 3.852s (-3.8%) 4.042s (-11.5% 🟢) 0.191s 30 1.01x
🐘 Postgres Nitro 4.043s (+38.1% 🔺) 4.456s (+38.4% 🔺) 0.412s 27 1.06x
💻 Local Next.js (Turbopack) 8.715s 9.232s 0.518s 14 2.28x
💻 Local Express 9.233s (~) 9.864s (-1.5%) 0.631s 13 2.41x
💻 Local Nitro 9.394s (+5.0% 🔺) 10.020s (+4.9%) 0.625s 12 2.45x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 75.013s (-0.8%) 76.630s (-0.7%) 1.618s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.258s 1.007s 0.750s 60 1.00x
🐘 Postgres Nitro 0.280s (+30.5% 🔺) 1.007s (~) 0.727s 60 1.09x
🐘 Postgres Express 0.283s (-2.1%) 1.007s (~) 0.724s 60 1.10x
💻 Local Next.js (Turbopack) 0.563s 1.004s 0.441s 60 2.18x
💻 Local Express 0.583s (~) 1.004s (~) 0.422s 60 2.26x
💻 Local Nitro 0.608s (+7.3% 🔺) 1.005s (~) 0.396s 60 2.36x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.779s (+29.8% 🔺) 3.171s (+12.4% 🔺) 1.392s 19 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.484s (-1.5%) 1.007s (~) 0.523s 90 1.00x
🐘 Postgres Nitro 0.490s (+37.9% 🔺) 1.007s (~) 0.516s 90 1.01x
🐘 Postgres Next.js (Turbopack) 0.492s 1.007s 0.514s 90 1.02x
💻 Local Nitro 2.518s (+4.5%) 3.009s (~) 0.492s 30 5.20x
💻 Local Next.js (Turbopack) 2.598s 3.009s 0.411s 30 5.37x
💻 Local Express 2.743s (+5.2% 🔺) 3.182s (+5.7% 🔺) 0.439s 29 5.67x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.589s (-4.4%) 4.201s (-2.0%) 1.612s 22 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.777s (-1.8%) 1.007s (-0.9%) 0.230s 120 1.00x
🐘 Postgres Next.js (Turbopack) 0.797s 1.007s 0.210s 120 1.03x
🐘 Postgres Nitro 0.817s (+43.9% 🔺) 1.017s (+1.1%) 0.200s 118 1.05x
💻 Local Next.js (Turbopack) 10.674s 11.209s 0.535s 11 13.74x
💻 Local Nitro 11.108s (+7.4% 🔺) 11.759s (+6.6% 🔺) 0.651s 11 14.30x
💻 Local Express 11.283s (~) 11.940s (+0.8%) 0.658s 11 14.52x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.955s (-26.1% 🟢) 7.708s (-20.2% 🟢) 1.753s 16 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 0.187s 1.003s 0.013s 1.019s 0.832s 10 1.00x
🐘 Postgres Next.js (Turbopack) 0.198s 1.001s 0.002s 1.010s 0.813s 10 1.06x
💻 Local Express 0.200s (-1.1%) 1.004s (~) 0.013s (+9.4% 🔺) 1.019s (~) 0.819s 10 1.07x
🐘 Postgres Nitro 0.202s (+27.7% 🔺) 1.002s (~) 0.001s (-43.8% 🟢) 1.010s (~) 0.809s 10 1.08x
🐘 Postgres Express 0.202s (-2.1%) 0.995s (~) 0.002s (~) 1.010s (~) 0.808s 10 1.08x
💻 Local Nitro 0.209s (+1.4%) 1.005s (~) 0.014s (+34.7% 🔺) 1.020s (~) 0.811s 10 1.12x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.326s (-9.0% 🟢) 2.171s (-29.5% 🟢) 1.467s (+54.9% 🔺) 4.079s (-6.3% 🟢) 2.753s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.591s (-4.4%) 1.006s (~) 0.004s (-2.6%) 1.021s (~) 0.430s 59 1.00x
🐘 Postgres Nitro 0.613s (+23.0% 🔺) 1.005s (~) 0.004s (+12.6% 🔺) 1.022s (~) 0.409s 59 1.04x
🐘 Postgres Next.js (Turbopack) 0.637s 1.009s 0.004s 1.023s 0.386s 59 1.08x
💻 Local Next.js (Turbopack) 0.649s 1.011s 0.009s 1.023s 0.373s 59 1.10x
💻 Local Express 0.728s (-2.8%) 1.012s (~) 0.009s (-1.4%) 1.023s (~) 0.295s 59 1.23x
💻 Local Nitro 0.731s (-1.9%) 1.012s (~) 0.010s (+10.3% 🔺) 1.024s (~) 0.293s 59 1.24x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.914s (-0.5%) 5.533s (+6.4% 🔺) 0.247s (-22.3% 🟢) 6.298s (+5.8% 🔺) 2.384s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.931s (+3.2%) 1.129s (+5.6% 🔺) 0.000s (+111.3% 🔺) 1.140s (+3.9%) 0.209s 53 1.00x
🐘 Postgres Next.js (Turbopack) 0.949s 1.176s 0.000s 1.187s 0.238s 51 1.02x
🐘 Postgres Express 0.960s (~) 1.125s (-11.1% 🟢) 0.000s (+35.8% 🔺) 1.140s (-11.1% 🟢) 0.180s 53 1.03x
💻 Local Nitro 1.234s (+1.6%) 2.022s (~) 0.000s (+33.3% 🔺) 2.024s (~) 0.790s 30 1.33x
💻 Local Express 1.242s (-2.7%) 2.022s (~) 0.000s (-31.3% 🟢) 2.024s (~) 0.782s 30 1.33x
💻 Local Next.js (Turbopack) 1.262s 2.020s 0.000s 2.022s 0.761s 30 1.36x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.464s (+25.9% 🔺) 4.788s (+23.5% 🔺) 0.000s (-37.5% 🟢) 5.253s (+24.3% 🔺) 1.789s 12 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.797s (+11.1% 🔺) 2.143s (+3.6%) 0.000s (+55.4% 🔺) 2.153s (+3.6%) 0.356s 28 1.00x
🐘 Postgres Express 1.806s (+5.9% 🔺) 2.175s (+5.2% 🔺) 0.000s (-48.2% 🟢) 2.188s (+5.2% 🔺) 0.381s 28 1.01x
🐘 Postgres Next.js (Turbopack) 1.833s 2.071s 0.000s 2.078s 0.246s 29 1.02x
💻 Local Next.js (Turbopack) 3.563s 4.031s 0.000s 4.035s 0.472s 15 1.98x
💻 Local Express 3.594s (-1.2%) 3.969s (-3.2%) 0.001s (+275.0% 🔺) 3.971s (-3.2%) 0.378s 16 2.00x
💻 Local Nitro 3.624s (+7.3% 🔺) 4.168s (+3.3%) 0.001s (+157.1% 🔺) 4.172s (+3.3%) 0.548s 15 2.02x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.024s (-15.2% 🟢) 5.267s (-11.9% 🟢) 0.002s (+566.7% 🔺) 5.786s (-8.3% 🟢) 1.762s 11 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Next.js (Turbopack) 15/21
🐘 Postgres Express 9/21
▲ Vercel Express 21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 15/21
Next.js (Turbopack) 🐘 Postgres 17/21
Nitro 🐘 Postgres 19/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

❌ Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

🧪 E2E Test Results

❌ Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 923 0 67 990
✅ 💻 Local Development 898 0 182 1080
✅ 📦 Local Production 898 0 182 1080
✅ 🐘 Local Postgres 898 0 182 1080
❌ 🌍 Community Worlds 133 74 24 231
✅ 📋 Other 228 0 42 270
Total 3978 74 679 4731

❌ Failed Tests

🌍 Community Worlds (74 failed)

mongodb (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KP743BJNAZH3EN62ZGCJD595
  • webhookWorkflow | wrun_01KP743KVYES9MNXMVQ1VNW9F6
  • fetchWorkflow | wrun_01KP747AAT0TJYB3AA7Y46RQRK
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KP74B3NMKFA3HWV9FNQ3H637
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KP74H3HQH8FPEJ92BHCC6XZ4

redis (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KP743BJNAZH3EN62ZGCJD595
  • webhookWorkflow | wrun_01KP743KVYES9MNXMVQ1VNW9F6
  • fetchWorkflow | wrun_01KP747AAT0TJYB3AA7Y46RQRK
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KP74B3NMKFA3HWV9FNQ3H637
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KP74H3HQH8FPEJ92BHCC6XZ4

turso (60 failed):

  • addTenWorkflow | wrun_01KP7422WR5MCVC4K5ABXZMDEQ
  • addTenWorkflow | wrun_01KP7422WR5MCVC4K5ABXZMDEQ
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KP7AC7MYNERT995B6BBBG3RA
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KP742F887XPMQS0MN00AXJ8N
  • promiseRaceWorkflow | wrun_01KP742K9VGT28CAHBW7FGY6QY
  • promiseAnyWorkflow | wrun_01KP742N2JBMHXST1XWS5WD7CP
  • importedStepOnlyWorkflow | wrun_01KP7ACJ2N9NXNG7E6J77GDDF9
  • hookWorkflow | wrun_01KP7431HHSYWY82GFX9NE1M6J
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KP743BJNAZH3EN62ZGCJD595
  • webhookWorkflow | wrun_01KP743KVYES9MNXMVQ1VNW9F6
  • sleepingWorkflow | wrun_01KP743SYZF9EG0YPK52F2G12Y
  • parallelSleepWorkflow | wrun_01KP7445M8BAX8KEYZGK25RZAA
  • nullByteWorkflow | wrun_01KP7448KZRASQZSJP6C24541M
  • workflowAndStepMetadataWorkflow | wrun_01KP744A5AH91JN703GZAMJ0BE
  • fetchWorkflow | wrun_01KP747AAT0TJYB3AA7Y46RQRK
  • promiseRaceStressTestWorkflow | wrun_01KP747D9ME5BNPMFHB1T7PVKE
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KP74AGVP1MARKBVKNPBGJBAW
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KP74B3NMKFA3HWV9FNQ3H637
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KP74BPPQZS2NKNVVKXSE92RH
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KP74C8FGDDAQQSRBJ244QFYQ
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KP74CGABR7199XXR055C63V3
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KP74CN2686JE7BY9YKVJPPWM
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KP74CPY88HWZ0R1WB1EW3F4N
  • runClassSerializationWorkflow - Run instances serialize across workflow/step boundaries | wrun_01KP74D0YNYPQET6T5G0PDS645
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KP74DEDWT7A6ZHH8MBFSPV1K
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KP74DK6D3QFWM9T1XPWM0GYJ
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KP74DSB1CZ5ATBMKD3CFM9PG
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KP74DZ13YQQ4M9FDYJSTNHXB
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KP74E4VTZSKZSER35S0XBJV4
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KP74EANKFJD4ZMVSD64WDMHX
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KP74EGHB4KSWT65G91RRXTXQ
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KP74ETH2Y01N57569AJT6M9M
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KP74F2FDBMJ2Z77PYJB8NY6S
  • cancelRun - cancelling a running workflow | wrun_01KP74F88W95GQBTA0VBV34N34
  • cancelRun via CLI - cancelling a running workflow | wrun_01KP74FGMGQRE65JMN3XB7AP49
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KP74FVFGEPW9H155JX126DMM
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KP74GFDNE5FVEM7WS26J7Q91
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KP74GT7GZTMMH9H8VPE3W80N
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KP74H017ATBP6HMNTNJE20NG
  • metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_01KP74H1SFC3XMXHARW2BTFJN9
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KP74H3HQH8FPEJ92BHCC6XZ4
  • getterStepWorkflow - getter functions with "use step" directive | wrun_01KP74H6DPMYGSJHX8B25QA7ZY

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 83 0 7
✅ example 83 0 7
✅ express 83 0 7
✅ fastify 83 0 7
✅ hono 83 0 7
✅ nextjs-turbopack 88 0 2
✅ nextjs-webpack 88 0 2
✅ nitro 83 0 7
✅ nuxt 83 0 7
✅ sveltekit 83 0 7
✅ vite 83 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 6 0 0
❌ mongodb 56 7 8
✅ redis-dev 6 0 0
❌ redis 56 7 8
✅ turso-dev 6 0 0
❌ turso 3 60 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 76 0 14
✅ e2e-local-postgres-nest-stable 76 0 14
✅ e2e-local-prod-nest-stable 76 0 14

📋 View full workflow run

@karthikscale3 karthikscale3 marked this pull request as ready for review April 14, 2026 23:08
@karthikscale3 karthikscale3 requested a review from a team as a code owner April 14, 2026 23:08
@karthikscale3 karthikscale3 enabled auto-merge (squash) April 14, 2026 23:10
@karthikscale3 karthikscale3 disabled auto-merge April 15, 2026 00:58
@karthikscale3 karthikscale3 merged commit eba7df3 into main Apr 15, 2026
157 of 170 checks passed
@karthikscale3 karthikscale3 deleted the karthik/fi-cli branch April 15, 2026 02:12
@workflow-devkit-release-bot workflow-devkit-release-bot bot mentioned this pull request Apr 14, 2026
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@TooTallNate TooTallNate TooTallNate approved these changes

@VaguelySerious VaguelySerious VaguelySerious approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@karthikscale3 @TooTallNate @VaguelySerious