-
Notifications
You must be signed in to change notification settings - Fork 318
[performance] Regression in CompileComplexWorkflow: 17.1% slowerΒ #22612
Copy link
Copy link
Closed as not planned
Closed as not planned
Copy link
Labels
Description
π Performance Regression Detected
Benchmark: BenchmarkCompileComplexWorkflow
Current Performance: 9,564,329 ns/op (β9.56ms)
Historical Average: 8,170,013 ns/op (β8.17ms)
Change: +17.1% slower
Threshold: Regressions flagged at >10% change
π Detailed Performance Metrics
Performance Comparison
| Metric | Value |
|---|---|
| Current ns/op | 9,564,329 (~9.56ms) |
| Historical Average ns/op | 8,170,013 (~8.17ms) |
| Change | +17.1% |
| Memory (B/op) | 2,633,690 |
| Allocations (allocs/op) | 30,570 |
| Historical Data Points | 9 |
Baseline Targets
- Simple workflows: <100ms β (well within)
- Complex workflows: <500ms β (still within, but regressing)
- MCP-heavy workflows: <1s β (well within)
Historical Trend (last 9 runs)
| Date | ns/op |
|---|---|
| 2026-03-15 | 5,975,399 |
| 2026-03-16 | 5,717,419 |
| 2026-03-17 | 6,358,182 |
| 2026-03-18 | 6,419,939 |
| 2026-03-19 | 6,312,211 |
| 2026-03-20 | 6,196,322 |
| 2026-03-21 | 8,653,953 |
| 2026-03-22 | 13,943,459 |
| 2026-03-23 | 9,306,029 |
| 2026-03-24 | 9,564,329 |
Note: The regression appears to have started around 2026-03-21 and has remained elevated.
π‘ Recommended Actions
- Review recent changes to the complex workflow compilation pipeline (around 2026-03-21)
- Run
make bench-memoryto generate memory profiles forCompileComplexWorkflow - Use
go tool pprofto identify performance hotspots in complex workflow handling - Compare with previous benchmark results using
benchstat - Check if any new validation steps were added to the complex workflow path
π Additional Context
- Run ID: Β§23474858139
- Date: 2026-03-24
- Other Benchmarks: 5 improvements, 1 stable (only CompileComplexWorkflow regressed)
- Detection Method: Compared against 7-day rolling average of historical data
Notable: Most other benchmarks showed significant improvements today (CompileSimpleWorkflow: -70.4%, Validation: -60.8%, CompileMCPWorkflow: -44.6%), suggesting the complex workflow path may have a specific issue while general compilation improved.
References:
Generated by Daily CLI Performance Agent Β· β·
- expires on Mar 26, 2026, 5:43 AM UTC
Reactions are currently unavailable
Metadata
Metadata
Labels
Type
Fields
Give feedbackNo fields configured for issues without a type.