Skip to content

feat(eve): add per-session model token-cost limits - #2950

Merged
ctgowrie merged 2 commits into
mainfrom
feat/token-cost-limit
Sep 3, 2026
Merged

feat(eve): add per-session model token-cost limits#2950
ctgowrie merged 2 commits into
mainfrom
feat/token-cost-limit

Conversation

@ctgowrie

@ctgowrie ctgowrie commented Sep 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Summary

Adds an optional maxTokenCostUsdPerSession limit that uses the model token cost reported with each step. Once accumulated cost reaches the limit, eve follows the existing session-limit HITL flow: Approve grants another configured window, while Stop cancels the turn; runs without HITL fail with a token-cost-specific error. The limit is unset by default, excludes tool and infrastructure spend, and follows existing token-budget inheritance and fan-out rules for subagents.

Cost now travels with delegated usage reports. Session inbox wire v5 carries the additive field while preserving older wire contracts, and extension capability epochs retain compatibility with existing authoring APIs.

Validation

Validated the behavior with the full unit suite (7,860 passing), workspace type checking and linting, then reran 356 focused compiler, session, HITL, wire, accounting, subagent, and task tests after rebasing onto the latest main. The affected mounted-extension scenario also passes with the new capability epochs. pnpm guard:invariants and pnpm docs:check also pass.

Checklist

  • This change was requested or approved by a maintainer
  • I ran the relevant checks from CONTRIBUTING.md
  • I added tests and documentation where relevant
  • I added a changeset if this touches the published eve package
  • DCO sign-off passes for every commit (git commit --signoff)

Diff size

Docs — 2 files · +29 / -19

Updates the runtime-limit guide and adds release metadata for the new public option.

Implementation — 40 files · +856 / -271

The core limit logic reuses the existing session-limit path. Much of this category is protocol and generated extension-contract metadata needed to carry token cost across delegated sessions without rewriting immutable wire history.

Protocol and compatibility metadata

Session inbox wire v5 adds cost to delegated usage reports while v1–v4 remain byte-for-byte stable. The public additive usage field also requires new retained extension capability epochs and generated declaration reports across the authoring surfaces that expose shared runtime types.

Tests — 26 files · +647 / -142

Covers configuration validation, cost accumulation and enforcement, HITL continuation, subagent inheritance, task propagation, wire migration, and retained extension compatibility. The v5 schema snapshot accounts for most test additions.

@ctgowrie
feat(eve): add session token-cost limits
f4a016b 
Signed-off-by: Casey Gowrie <ctgowrie@gmail.com>
@vercel

vercel Bot commented Sep 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
eve-docs Ready Ready Preview, v0 Sep 3, 2026 2:19pm UTC
eve-docs-4759 Ready Ready Preview, v0 Sep 3, 2026 2:19pm UTC
1 Skipped Deployment
Project Deployment Actions Updated
eve-pkg Skipped Skipped v0 Sep 3, 2026 2:19pm UTC

@github-actions

github-actions Bot commented Sep 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Bundle + Package Summary: apps/fixtures/weather-agent

Key takeaways

  • No notable deltas vs main (3cccd71).

Delta vs main (3cccd71)

Area Metric Baseline Current Delta
Package Packed tarball 8.64 MB 8.64 MB +4.3 kB ⚠️
Package Unpacked publish size 32.57 MB 32.60 MB +32.4 kB ⚠️
Package Installed footprint 77.73 MB 77.76 MB +32.4 kB ⚠️
Package Published files 3815 3819 +4
Package Installed files 7661 7665 +4
Package Installed package instances 35 35 0
Package Distinct installed package names 34 34 0
Package Installed dependency edges 53 53 0
Package Installed optional peer edges 47 47 0
Runtime Unique function payloads 2 2 0
Runtime Total function bytes 20.44 MB 20.46 MB +23.3 kB ⚠️
Runtime Public routes 18 18 0
Changed function payloads vs main (3cccd71) (2)
Function Status Baseline Current Delta Route changes
functions/__server.func changed 10.22 MB 10.23 MB +11.7 kB ⚠️ none
functions/.well-known/workflow/v1/flow.func changed 10.22 MB 10.23 MB +11.7 kB ⚠️ none

eve init install

Metric Baseline Current Delta
Installed footprint 116.17 MB 116.20 MB +32.4 kB ⚠️
Installed packages 120 120 0
dependencies 4 4 0
devDependencies 2 2 0
Dependency package bytes 48.63 MB 48.66 MB +32.4 kB ⚠️
devDependency package bytes 5.04 MB 5.04 MB 0 B ➖
Build Metadata
  • Preset: vercel
  • Nitro: nitro@3.0.260610-beta
  • Output directory: apps/fixtures/weather-agent/.vercel/output
  • Build metadata timestamp: 2026-09-03T14:20:05.021Z
  • Route aliases: 18 public, 1 internal (19 total aliases)
  • Vercel routes in config: 21
  • Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down

Package Details

  • Package: eve@0.50.0
  • Package directory: packages/eve
  • Tarball: 8.64 MB (eve-0.50.0.tgz)
  • Unpacked payload: 32.60 MB across 3819 published files
  • Installed footprint: 77.76 MB across 7665 installed files
  • Installed root package: 31.14 MB
  • Installed dependencies: 46.63 MB
  • Installed package instances: 35
  • Distinct installed package names: 34
  • Installed dependency edges: 53
  • Installed optional peer edges: 47
  • Runtime dependencies: 2
  • Peer dependencies: 5 (4 optional)

Installed footprint is measured from an isolated temporary npm install of the packed tarball.
Graph metrics read only package.json files in package directories directly beneath a node_modules boundary, including nested boundaries. Each directory is one package instance; distinct names come from those manifests. Dependency edges count each unique name in dependencies or optionalDependencies per instance; optional peer edges count peerDependencies marked optional.

Heavy installed dependencies

  • eve: 31.14 MB (40.0%)
  • @rolldown/binding-linux-x64-gnu: 19.31 MB (24.8%)
  • ai: 6.98 MB (9.0%)
  • zod: 6.41 MB (8.2%)
  • undici: 3.50 MB (4.5%)
Publish payload breakdown 
Published file size
🔴 dist/src/compiled/shadcn-registry/index.js       [#############...........] 9.76 MB 29.9%
🟠 dist/src/compiled/@photon-ai/chat-adapter-ime... [###.....................] 2.27 MB 7.0%
🟠 dist/src/compiled/@ai-sdk/code-mode/index.js     [#.......................] 1.03 MB 3.1%
🟡 dist/src/compiled/@vercel/blob/index.js          [#.......................] 901.8 kB 2.8%
🟡 dist/src/compiled/_chunks/workflow/undici-Dfx... [#.......................] 512.5 kB 1.6%
🔴 Other published files                            [########################] 18.13 MB 55.6%
Installed footprint breakdown 
Installed package size
🔴 eve                             [########################] 31.14 MB 40.0%
🔴 @rolldown/binding-linux-x64-gnu [###############.........] 19.31 MB 24.8%
🔴 ai                              [#####...................] 6.98 MB 9.0%
🔴 zod                             [#####...................] 6.41 MB 8.2%
🟠 undici                          [###.....................] 3.50 MB 4.5%
🟠 nitro                           [##......................] 2.41 MB 3.1%
🔴 Other installed packages        [######..................] 8.00 MB 10.3%
Runtime dependencies (2)
Package Range Notes
nitro 3.0.260610-beta
undici 8.9.0
Peer dependencies (5)
Package Range Notes
@opentelemetry/api ^1.0.0 optional peer
ai catalog:
braintrust ^3.0.0 optional peer
just-bash ^3.1.0 optional peer
microsandbox ^0.5.0 optional peer
eve init install drill-down

eve init install details

  • Command: eve init my-agent
  • Package manager: npm
  • Installed footprint: 116.20 MB across 9561 installed files
  • Installed packages: 120 total (114 transitive-only)
  • dependencies: 4 direct packages totaling 48.66 MB
  • devDependencies: 2 direct packages totaling 5.04 MB
  • Other transitive package files: 62.50 MB

Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.

Heavy installed dependencies

  • eve: 31.14 MB (26.8%)
  • @typescript/typescript-linux-x64: 27.95 MB (24.0%)
  • @rolldown/binding-linux-x64-gnu: 19.31 MB (16.6%)
  • zod: 10.37 MB (8.9%)
  • ai: 6.98 MB (6.0%)
Installed footprint breakdown 
Installed package size
🔴 eve                              [########################] 31.14 MB 26.8%
🔴 @typescript/typescript-linux-x64 [######################..] 27.95 MB 24.0%
🔴 @rolldown/binding-linux-x64-gnu  [###############.........] 19.31 MB 16.6%
🔴 zod                              [########................] 10.37 MB 8.9%
🔴 ai                               [#####...................] 6.98 MB 6.0%
🟠 undici                           [###.....................] 3.50 MB 3.0%
🔴 Other installed packages         [#############...........] 16.94 MB 14.6%
dependencies (4)
Package Range Installed size Share
@vercel/connect 1.0.0 167.9 kB 0.1%
ai ^7.0.82 6.98 MB 6.0%
eve file:eve-0.50.0.tgz 31.14 MB 26.8%
zod 4.5.4 10.37 MB 8.9%
devDependencies (2)
Package Range Installed size Share
@types/node 24.x 2.54 MB 2.2%
typescript 7.0.2 2.50 MB 2.1%
Function Drill-Down

Payload Size Graph

Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func     [########################] 10.23 MB 50.0%
🔴 functions/__server.func                         [########################] 10.23 MB 50.0%

Top Function Payloads

🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 10.23 MB
Metric Value
Public routes /.well-known/workflow/v1/flow
Runtime nodejs24.x
Handler index.mjs
Payload 10.23 MB
Function files 10.23 MB across 112 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.20 MB (21.5%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                       [###########.............] 2.20 MB 21.5%
🟡 _libs/undici.mjs                [#####...................] 980.5 kB 9.6%
🟡 _chunks/decode_jwt-Col8JOnf.mjs [###.....................] 702.6 kB 6.9%
🟡 _chunks/rename-with-retry.mjs   [###.....................] 696.3 kB 6.8%
🟡 _chunks/frames-CZ9eHShe.mjs     [###.....................] 679.1 kB 6.6%
🔴 Other bundled files             [########################] 4.97 MB 48.6%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x",
  "maxDuration": "max",
  "experimentalTriggers": [
    {
      "type": "queue/v2beta",
      "topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
      "consumer": "default",
      "retryAfterSeconds": 5,
      "initialDelaySeconds": 0
    }
  ],
  "environment": {
    "WORKFLOW_PRECONDITION_GUARD": "1"
  }
}
🟠 functions/__server.func • 17 public routes, 1 internal alias • 10.23 MB
Metric Value
Public routes /
/.well-known/workflow/v1/webhook/[token]
/eve/v1/activity/[token]
/eve/v1/callback/[token]
/eve/v1/connections/[name]/callback/[attemptId]/[token]
/eve/v1/connections/[name]/callback/[token]
/eve/v1/health
/eve/v1/info
/eve/v1/session
/eve/v1/session/[parentSessionId]/subagents/[callId]/[childSessionId]/stream
/eve/v1/session/[sessionId]
/eve/v1/session/[sessionId]/cancel
/eve/v1/session/[sessionId]/clear
/eve/v1/session/[sessionId]/compact
/eve/v1/session/[sessionId]/reset
/eve/v1/session/[sessionId]/stream
/eve/v1/task-input/[token]
Internal aliases /__server
Runtime nodejs24.x
Handler index.mjs
Payload 10.23 MB
Function files 10.23 MB across 112 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.20 MB (21.5%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                       [###########.............] 2.20 MB 21.5%
🟡 _libs/undici.mjs                [#####...................] 980.5 kB 9.6%
🟡 _chunks/decode_jwt-Col8JOnf.mjs [###.....................] 702.6 kB 6.9%
🟡 _chunks/rename-with-retry.mjs   [###.....................] 696.3 kB 6.8%
🟡 _chunks/frames-CZ9eHShe.mjs     [###.....................] 679.1 kB 6.6%
🔴 Other bundled files             [########################] 4.97 MB 48.6%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x"
}

Build Timing: e2e/fixtures/agent-tools-sandbox

This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.

Build mode: deployable Vercel build with sandbox template prewarm included.

  • Build pipeline: 2.98 s -> 2.96 s (-19.0 ms) vs main (3cccd71).
  • Timing is informational: shared GitHub runners are too variable for a hard timing budget.
Detailed phase timings vs `main (3cccd71)`
Phase Baseline Current Delta
extension.check 1.3 ms 11.3 ms +10.0 ms
project.resolve 0.4 ms 0.4 ms 0.0 ms
workspace.create 0.8 ms 0.8 ms 0.0 ms
host.prepare 482.6 ms 463.1 ms -19.5 ms
vercel.service-prefix.resolve 2.6 ms 2.1 ms -0.5 ms
nitro.create 562.2 ms 569.5 ms +7.3 ms
sandbox.prewarm 303.9 ms 334.1 ms +30.2 ms
nitro.cache.prepare 0.2 ms 0.2 ms 0.0 ms
nitro.prepare 0.8 ms 0.8 ms 0.0 ms
nitro.public-assets 0.8 ms 0.8 ms 0.0 ms
nitro.prerender 0.5 ms 0.6 ms +0.1 ms
nitro.bundle 1.56 s 1.52 s -47.4 ms
nitro.cache.write 0.5 ms 0.4 ms -0.1 ms
vercel.workflow-function.materialize 51.1 ms 51.4 ms +0.3 ms
agent-summary.emit 0.8 ms 0.8 ms 0.0 ms
nitro.close 0.1 ms 0.1 ms 0.0 ms
output.publish 3.4 ms 3.7 ms +0.3 ms
workspace.remove 2.3 ms 2.4 ms +0.1 ms

@ctgowrie
test(eve): update extension capability epochs
1e51bfd 
Signed-off-by: Casey Gowrie <ctgowrie@gmail.com>
@vercel
vercel Bot temporarily deployed to Preview – eve-pkg September 3, 2026 14:16 Inactive
@ctgowrie
ctgowrie requested a review from ruiconti September 3, 2026 14:23
@ctgowrie
ctgowrie enabled auto-merge (squash) September 3, 2026 14:34
@ctgowrie
ctgowrie merged commit 73aec25 into main Sep 3, 2026
173 of 177 checks passed
@ctgowrie
ctgowrie deleted the feat/token-cost-limit branch September 3, 2026 16:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ruiconti ruiconti ruiconti approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@ctgowrie @ruiconti