test(e2e): prove background task semantics end to end by ruiconti · Pull Request #1759 · vercel/eve

ruiconti · 2026-08-07T03:36:11Z

Seven deterministic mock-model evals over a new fixture-tasks fixture, sitting directly above the last semantic PR so every contract the stack ships is proven before any rendering code consumes it.

Each eval is named by the invariant it gates:

task-hitl-routing — child input requests surface on the parent; responses route back without a parent turn
session-create-idempotency — concurrent + serial create retries yield one message.received / one step.started
task-input-batch-ordering — answers bind to the batch they answer
child-task-exclusivity — same-batch duplicate sends admit exactly one
task-fanout-parent-updates — 10-task fanout behind an approval-gated barrier; parent stays interactive; per-task completion updates
task-fan-in-join — one wake per ready transition; model-side join predicate
task-cancellation — cancellation is final; a late child result cannot revive the task

Replaces closed #1748. Two changes against that revision:

Exclusivity race hardened. The world-agnostic flake in test(e2e): add background task golden paths #1748's CI (also seen on postgres at an earlier commit): a completion notification coalescing into the RACE turn's model request made the scripted model ACK instead of running the same-batch sends. The notification branch now delegates to the race script, same pattern the fan-in eval already used.
task_await comment references swept — the primitive no longer exists anywhere in the stack.

Known red: task-fanout-parent-updates fails deterministically on e2e-vercel only — the parked parent's continuation token doesn't resolve on the vercel session-driver resume path while 10 children hold HITL (Session is not active and cannot be resumed, session-continue route). Local and postgres pass. That is a product bug under investigation, not an eval assumption; it reproduced identically on both prior CI runs.

Local run at this revision: 7 evals, 43 gates, all green.

Seven deterministic mock-model evals over the fixture-tasks fixture: HITL routing, session-create idempotency, input batch ordering, child task exclusivity, fanout parent updates, fan-in join, and cancellation finality. Hardens the exclusivity race against wake-notification coalescing: the scripted model delegates notification turns to the race script (same pattern as fan-in), so a completion notice landing in the RACE turn's request no longer strands the same-batch sends. Signed-off-by: Rui Conti <ruiconti@gmail.com>

vercel · 2026-08-07T03:36:20Z

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
eve-docs	Ready	Preview	Aug 7, 2026 3:37am

github-actions · 2026-08-07T03:40:00Z

Bundle + Package Summary: `apps/fixtures/weather-agent`

Key takeaways

No notable deltas vs tasks/08-agent-identity (ca6a724).

Delta vs `tasks/08-agent-identity (ca6a724)`

Area	Metric	Baseline	Current	Delta
Package	Packed tarball	7.68 MB	7.68 MB	-52 B ✅
Package	Unpacked publish size	28.80 MB	28.80 MB	0 B ➖
Package	Installed footprint	72.22 MB	72.22 MB	0 B ➖
Package	Published files	3076	3076	0
Package	Installed files	6784	6784	0
Runtime	Unique function payloads	2	2	0
Runtime	Total function bytes	17.25 MB	17.25 MB	-40 B ✅
Runtime	Public routes	13	13	0

Changed function payloads vs tasks/08-agent-identity (ca6a724) (2)

Function	Status	Baseline	Current	Delta	Route changes
`functions/__server.func`	changed	8.63 MB	8.63 MB	-20 B ✅	none
`functions/.well-known/workflow/v1/flow.func`	changed	8.63 MB	8.63 MB	-20 B ✅	none

`eve init` install

Metric	Baseline	Current	Delta
Installed footprint	110.63 MB	110.63 MB	0 B ➖
Installed packages	121	121	0
dependencies	4	4	0
devDependencies	2	2	0
Dependency package bytes	43.27 MB	43.27 MB	0 B ➖
devDependency package bytes	5.04 MB	5.04 MB	0 B ➖

Build Metadata

Preset: vercel
Nitro: nitro@3.0.260610-beta
Output directory: apps/fixtures/weather-agent/.vercel/output
Build metadata timestamp: 2026-08-07T03:39:07.118Z
Route aliases: 13 public, 1 internal (14 total aliases)
Vercel routes in config: 16
Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small

Package Drill-Down

Package Details

Package: eve@0.30.7
Package directory: packages/eve
Tarball: 7.68 MB (eve-0.30.7.tgz)
Unpacked payload: 28.80 MB across 3076 published files
Installed footprint: 72.22 MB across 6784 installed files
Installed root package: 27.44 MB
Installed dependencies: 44.78 MB
Runtime dependencies: 2
Peer dependencies: 5 (4 optional)

Installed footprint is measured from an isolated temporary npm install of the packed tarball.

Heavy installed dependencies

eve: 27.44 MB (38.0%)
@rolldown/binding-linux-x64-gnu: 19.35 MB (26.8%)
ai: 6.67 MB (9.2%)
zod: 5.07 MB (7.0%)
undici: 3.50 MB (4.9%)

Publish payload breakdown

Published file size
🔴 dist/src/compiled/shadcn-registry/index.js       [################........] 9.68 MB 33.6%
🟠 dist/src/compiled/@photon-ai/chat-adapter-ime... [####....................] 2.42 MB 8.4%
🟠 dist/src/compiled/experimental-ai-sdk-code-mo... [###.....................] 1.51 MB 5.2%
🟡 dist/src/compiled/_chunks/node/undici-DWL_MYm... [#.......................] 502.4 kB 1.7%
🟡 dist/src/compiled/_chunks/workflow/undici-DWL... [#.......................] 502.4 kB 1.7%
🔴 Other published files                            [########################] 14.18 MB 49.2%

Installed footprint breakdown

Installed package size
🔴 eve                             [########################] 27.44 MB 38.0%
🔴 @rolldown/binding-linux-x64-gnu [#################.......] 19.35 MB 26.8%
🔴 ai                              [######..................] 6.67 MB 9.2%
🔴 zod                             [####....................] 5.07 MB 7.0%
🟠 undici                          [###.....................] 3.50 MB 4.9%
🟠 nitro                           [##......................] 2.41 MB 3.3%
🔴 Other installed packages        [#######.................] 7.79 MB 10.8%

Runtime dependencies (2)

Package	Range	Notes
`nitro`	`3.0.260610-beta`
`undici`	`8.9.0`

Peer dependencies (5)

Package	Range	Notes
`@opentelemetry/api`	`^1.0.0`	optional peer
`ai`	`catalog:`
`braintrust`	`^3.0.0`	optional peer
`just-bash`	`^3.0.0`	optional peer
`microsandbox`	`^0.5.0`	optional peer

eve init install drill-down

`eve init` install details

Command: eve init my-agent
Package manager: npm
Installed footprint: 110.63 MB across 8660 installed files
Installed packages: 121 total (115 transitive-only)
dependencies: 4 direct packages totaling 43.27 MB
devDependencies: 2 direct packages totaling 5.04 MB
Other transitive package files: 62.32 MB

Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.

Heavy installed dependencies

@typescript/typescript-linux-x64: 27.95 MB (25.3%)
eve: 27.44 MB (24.8%)
@rolldown/binding-linux-x64-gnu: 19.35 MB (17.5%)
zod: 9.02 MB (8.2%)
ai: 6.67 MB (6.0%)

Installed footprint breakdown

Installed package size
🔴 @typescript/typescript-linux-x64 [########################] 27.95 MB 25.3%
🔴 eve                              [########################] 27.44 MB 24.8%
🔴 @rolldown/binding-linux-x64-gnu  [#################.......] 19.35 MB 17.5%
🔴 zod                              [########................] 9.02 MB 8.2%
🔴 ai                               [######..................] 6.67 MB 6.0%
🟠 undici                           [###.....................] 3.50 MB 3.2%
🔴 Other installed packages         [##############..........] 16.70 MB 15.1%

dependencies (4)

Package	Range	Installed size	Share
`@vercel/connect`	`0.4.3`	141.0 kB	0.1%
`ai`	`^7.0.38`	6.67 MB	6.0%
`eve`	`file:eve-0.30.7.tgz`	27.44 MB	24.8%
`zod`	`4.4.3`	9.02 MB	8.2%

devDependencies (2)

Package	Range	Installed size	Share
`@types/node`	`24.x`	2.54 MB	2.3%
`typescript`	`7.0.2`	2.50 MB	2.3%

Function Drill-Down

Payload Size Graph

Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func     [########################] 8.63 MB 50.0%
🔴 functions/__server.func                         [########################] 8.63 MB 50.0%

Top Function Payloads

🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 8.63 MB

Metric	Value
Public routes	`/.well-known/workflow/v1/flow`
Runtime	`nodejs24.x`
Handler	`index.mjs`
Payload	8.63 MB
Function files	8.63 MB across 44 files
Traced dependencies	0 B
Signal	🟠 Bundled file `index.mjs` is 2.44 MB (28.2%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                       [########################] 2.44 MB 28.2%
🟠 _chunks/runtime-artifacts.mjs   [################........] 1.63 MB 18.9%
🟡 _libs/undici.mjs                [##########..............] 980.5 kB 11.4%
🟡 _chunks/sandbox.mjs             [########................] 769.0 kB 8.9%
🟡 _libs/@ai-sdk/gateway+[...].mjs [####....................] 432.8 kB 5.0%
🟠 Other bundled files             [#######################.] 2.38 MB 27.6%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x",
  "maxDuration": "max",
  "experimentalTriggers": [
    {
      "type": "queue/v2beta",
      "topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
      "consumer": "default",
      "retryAfterSeconds": 5,
      "initialDelaySeconds": 0
    }
  ],
  "environment": {
    "WORKFLOW_PRECONDITION_GUARD": "1"
  }
}

🟠 functions/__server.func • 12 public routes, 1 internal alias • 8.63 MB

Metric	Value
Public routes	`/` `/eve/v1/callback/[token]` `/eve/v1/connections/[name]/callback/[token]` `/eve/v1/health` `/eve/v1/info` `/eve/v1/session` `/eve/v1/session/[sessionId]` `/eve/v1/session/[sessionId]/cancel` `/eve/v1/session/[sessionId]/stream` `/eve/v1/session/clear` `/eve/v1/session/compact` `/eve/v1/session/reset`
Internal aliases	`/__server`
Runtime	`nodejs24.x`
Handler	`index.mjs`
Payload	8.63 MB
Function files	8.63 MB across 44 files
Traced dependencies	0 B
Signal	🟠 Bundled file `index.mjs` is 2.44 MB (28.2%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                       [########################] 2.44 MB 28.2%
🟠 _chunks/runtime-artifacts.mjs   [################........] 1.63 MB 18.9%
🟡 _libs/undici.mjs                [##########..............] 980.5 kB 11.4%
🟡 _chunks/sandbox.mjs             [########................] 769.0 kB 8.9%
🟡 _libs/@ai-sdk/gateway+[...].mjs [####....................] 432.8 kB 5.0%
🟠 Other bundled files             [#######################.] 2.38 MB 27.6%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x"
}

Build Timing: `e2e/fixtures/agent-tools-sandbox`

This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.

Build mode: deployable Vercel build with sandbox template prewarm included.

Build pipeline: 2.19 s -> 2.23 s (+35.8 ms) vs tasks/08-agent-identity (ca6a724).
Timing is informational: shared GitHub runners are too variable for a hard timing budget.

Detailed phase timings vs `tasks/08-agent-identity (ca6a724)`

Phase	Baseline	Current	Delta
`extension.check`	9.2 ms	9.0 ms	-0.2 ms
`project.resolve`	3.5 ms	3.5 ms	0.0 ms
`workspace.create`	4.6 ms	1.1 ms	-3.5 ms
`host.prepare`	237.7 ms	218.9 ms	-18.8 ms
`vercel.service-prefix.resolve`	2.3 ms	2.4 ms	+0.1 ms
`nitro.create`	238.2 ms	248.3 ms	+10.1 ms
`sandbox.prewarm`	300.0 ms	307.4 ms	+7.4 ms
`nitro.cache.prepare`	0.3 ms	0.3 ms	0.0 ms
`nitro.prepare`	0.9 ms	1.0 ms	+0.1 ms
`nitro.public-assets`	0.7 ms	0.8 ms	+0.1 ms
`nitro.prerender`	0.5 ms	0.5 ms	0.0 ms
`nitro.bundle`	1.36 s	1.40 s	+39.5 ms
`nitro.cache.write`	0.3 ms	0.3 ms	0.0 ms
`vercel.workflow-function.materialize`	23.6 ms	24.2 ms	+0.6 ms
`agent-summary.emit`	0.4 ms	0.6 ms	+0.2 ms
`nitro.close`	0.2 ms	0.2 ms	0.0 ms
`output.publish`	3.7 ms	3.7 ms	0.0 ms
`workspace.remove`	2.3 ms	2.5 ms	+0.2 ms

ruiconti · 2026-08-07T06:00:19Z

Superseded by #1774. The new acceptance suite fixes the false-positive oracles, adds hard timeouts, and is green on local/Postgres/Vercel.

ruiconti mentioned this pull request Aug 7, 2026

test(e2e): add background task golden paths #1748

Closed

vercel Bot deployed to Preview – eve-docs August 7, 2026 03:37 View deployment

ruiconti closed this Aug 7, 2026

Navigation Menu

Uh oh!

test(e2e): prove background task semantics end to end - #1759

test(e2e): prove background task semantics end to end#1759
ruiconti wants to merge 1 commit into
tasks/08-agent-identityfrom
tasks/12-evals

ruiconti commented Aug 7, 2026

Uh oh!

vercel Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026

Package Details

`eve init` install details

Payload Size Graph

Top Function Payloads

Uh oh!

ruiconti commented Aug 7, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

ruiconti commented Aug 7, 2026

Uh oh!

vercel Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Aug 7, 2026

Bundle + Package Summary: apps/fixtures/weather-agent

Delta vs tasks/08-agent-identity (ca6a724)

eve init install

Package Details

eve init install details

Payload Size Graph

Top Function Payloads

Build Timing: e2e/fixtures/agent-tools-sandbox

Uh oh!

ruiconti commented Aug 7, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

vercel Bot commented Aug 7, 2026 •

edited

Loading

Bundle + Package Summary: `apps/fixtures/weather-agent`

Delta vs `tasks/08-agent-identity (ca6a724)`

`eve init` install

`eve init` install details

Build Timing: `e2e/fixtures/agent-tools-sandbox`