Skip to content

Invoke performance improvements#2986

Merged
vigoo merged 27 commits intomainfrom
invoke-performance-improvements
Mar 16, 2026
Merged

Invoke performance improvements#2986
vigoo merged 27 commits intomainfrom
invoke-performance-improvements

Conversation

@vigoo
Copy link
Contributor

@vigoo vigoo commented Mar 13, 2026

Resolves #2931

  • Fixes the broken benchmark tracing, adds some new spans
  • Rust and TS SDK specific optimizations
  • Passing around environment_id in various invocation related code paths to reduce the need for remote queries
  • Using the new component_revision coming in the invocation result where possible

Further big optimization can be done when #2431 is available

Some example results:

Benchmark Variant Config Prev Avg Latest Avg Prev p95 Latest p95 Avg Δ
latency-small hot 500 workers 424.33ms 48.53ms 529.46ms 64.40ms -89%
throughput-echo ts-agent 1×1 8.13ms 2.31ms 9.56ms 2.75ms -72%
throughput-large-input ts-agent 5×10, len=100 13.65ms 3.12ms 17.53ms 3.86ms -77%
throughput-cpu-intensive rust-agent 5×10 13.58ms 4.19ms 17.78ms 5.80ms -69%

Full results will be available when the daily benchmark runs

@vigoo vigoo marked this pull request as ready for review March 16, 2026 09:08
@vigoo vigoo merged commit 57e49b0 into main Mar 16, 2026
29 checks passed
@vigoo vigoo deleted the invoke-performance-improvements branch March 16, 2026 10:43
@github-actions github-actions bot locked and limited conversation to collaborators Mar 16, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Investigate performance regressions after first class agents

2 participants