Skip to content

Pin system tests to 1.60.x release branch#10722

Merged
sarahchen6 merged 1 commit intorelease/v1.60.xfrom
sarahchen6/pin-system-tests-sha
Mar 3, 2026
Merged

Pin system tests to 1.60.x release branch#10722
sarahchen6 merged 1 commit intorelease/v1.60.xfrom
sarahchen6/pin-system-tests-sha

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

@sarahchen6 sarahchen6 commented Mar 3, 2026

What Does This Do

Pin current system-tests SHA to the release/v1.60.x branch

Motivation

Patch releases made off of this branch will be tested against the version of system-tests that the minor release was made off of

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@sarahchen6 sarahchen6 requested a review from a team as a code owner March 3, 2026 14:16
@sarahchen6 sarahchen6 requested review from amarziali and removed request for a team March 3, 2026 14:16
@sarahchen6 sarahchen6 added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Mar 3, 2026
@sarahchen6 sarahchen6 requested a review from PerfectSlayer March 3, 2026 14:16
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 3, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/pin-system-tests-sha
git_commit_date 1772492986 1772546748
git_commit_sha 0f5d84f 7504c7c
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~7504c7cf37
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772548934 1772548934
ci_job_id 1471004799 1471004799
ci_pipeline_id 100015604 100015604
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-te85uhw1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-te85uhw1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066105
Total [baseline] (8.762 s) : 0, 8761663
Agent [candidate] (1.062 s) : 0, 1061806
Total [candidate] (8.766 s) : 0, 8766115
section iast
Agent [baseline] (1.249 s) : 0, 1249252
Total [baseline] (9.401 s) : 0, 9400549
Agent [candidate] (1.228 s) : 0, 1228391
Total [candidate] (9.39 s) : 0, 9390211
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.249 s 183.146 ms (17.2%)
Total tracing 8.762 s -
Total iast 9.401 s 638.886 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.228 s 166.585 ms (15.7%)
Total tracing 8.766 s -
Total iast 9.39 s 624.095 ms (7.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (628.85 ms) : 0, 628850
BytebuddyAgent [candidate] (627.628 ms) : 0, 627628
AgentMeter [baseline] (29.152 ms) : 0, 29152
AgentMeter [candidate] (29.083 ms) : 0, 29083
GlobalTracer [baseline] (257.678 ms) : 0, 257678
GlobalTracer [candidate] (256.742 ms) : 0, 256742
AppSec [baseline] (33.26 ms) : 0, 33260
AppSec [candidate] (32.925 ms) : 0, 32925
Debugger [baseline] (63.166 ms) : 0, 63166
Debugger [candidate] (64.085 ms) : 0, 64085
Remote Config [baseline] (633.091 µs) : 0, 633
Remote Config [candidate] (601.033 µs) : 0, 601
Telemetry [baseline] (9.945 ms) : 0, 9945
Telemetry [candidate] (9.8 ms) : 0, 9800
Flare Poller [baseline] (6.118 ms) : 0, 6118
Flare Poller [candidate] (3.678 ms) : 0, 3678
section iast
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (808.966 ms) : 0, 808966
BytebuddyAgent [candidate] (793.899 ms) : 0, 793899
AgentMeter [baseline] (11.762 ms) : 0, 11762
AgentMeter [candidate] (11.257 ms) : 0, 11257
GlobalTracer [baseline] (250.038 ms) : 0, 250038
GlobalTracer [candidate] (246.546 ms) : 0, 246546
AppSec [baseline] (32.67 ms) : 0, 32670
AppSec [candidate] (33.164 ms) : 0, 33164
Debugger [baseline] (67.918 ms) : 0, 67918
Debugger [candidate] (66.788 ms) : 0, 66788
Remote Config [baseline] (554.62 µs) : 0, 555
Remote Config [candidate] (527.782 µs) : 0, 528
Telemetry [baseline] (8.716 ms) : 0, 8716
Telemetry [candidate] (8.599 ms) : 0, 8599
Flare Poller [baseline] (3.544 ms) : 0, 3544
Flare Poller [candidate] (3.416 ms) : 0, 3416
IAST [baseline] (27.569 ms) : 0, 27569
IAST [candidate] (27.036 ms) : 0, 27036
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1084074
Total [baseline] (10.996 s) : 0, 10996121
Agent [candidate] (1.072 s) : 0, 1071675
Total [candidate] (10.993 s) : 0, 10993445
section appsec
Agent [baseline] (1.25 s) : 0, 1250120
Total [baseline] (11.068 s) : 0, 11068149
Agent [candidate] (1.239 s) : 0, 1238792
Total [candidate] (11.053 s) : 0, 11053275
section iast
Agent [baseline] (1.23 s) : 0, 1229945
Total [baseline] (11.16 s) : 0, 11160030
Agent [candidate] (1.24 s) : 0, 1240008
Total [candidate] (11.226 s) : 0, 11225885
section profiling
Agent [baseline] (1.2 s) : 0, 1200229
Total [baseline] (10.972 s) : 0, 10971539
Agent [candidate] (1.204 s) : 0, 1204320
Total [candidate] (11.033 s) : 0, 11032688
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent appsec 1.25 s 166.046 ms (15.3%)
Agent iast 1.23 s 145.871 ms (13.5%)
Agent profiling 1.2 s 116.156 ms (10.7%)
Total tracing 10.996 s -
Total appsec 11.068 s 72.028 ms (0.7%)
Total iast 11.16 s 163.909 ms (1.5%)
Total profiling 10.972 s -24.582 ms (-0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.239 s 167.117 ms (15.6%)
Agent iast 1.24 s 168.333 ms (15.7%)
Agent profiling 1.204 s 132.646 ms (12.4%)
Total tracing 10.993 s -
Total appsec 11.053 s 59.83 ms (0.5%)
Total iast 11.226 s 232.44 ms (2.1%)
Total profiling 11.033 s 39.243 ms (0.4%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (639.764 ms) : 0, 639764
BytebuddyAgent [candidate] (631.663 ms) : 0, 631663
AgentMeter [baseline] (29.797 ms) : 0, 29797
AgentMeter [candidate] (29.102 ms) : 0, 29102
GlobalTracer [baseline] (262.856 ms) : 0, 262856
GlobalTracer [candidate] (257.933 ms) : 0, 257933
AppSec [baseline] (33.993 ms) : 0, 33993
AppSec [candidate] (33.073 ms) : 0, 33073
Debugger [baseline] (62.801 ms) : 0, 62801
Debugger [candidate] (66.633 ms) : 0, 66633
Remote Config [baseline] (649.95 µs) : 0, 650
Remote Config [candidate] (620.354 µs) : 0, 620
Telemetry [baseline] (10.903 ms) : 0, 10903
Telemetry [candidate] (9.968 ms) : 0, 9968
Flare Poller [baseline] (5.433 ms) : 0, 5433
Flare Poller [candidate] (5.351 ms) : 0, 5351
section appsec
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (664.174 ms) : 0, 664174
BytebuddyAgent [candidate] (657.682 ms) : 0, 657682
AgentMeter [baseline] (12.046 ms) : 0, 12046
AgentMeter [candidate] (12.015 ms) : 0, 12015
GlobalTracer [baseline] (260.204 ms) : 0, 260204
GlobalTracer [candidate] (258.211 ms) : 0, 258211
IAST [baseline] (25.713 ms) : 0, 25713
IAST [candidate] (25.443 ms) : 0, 25443
AppSec [baseline] (168.571 ms) : 0, 168571
AppSec [candidate] (168.056 ms) : 0, 168056
Debugger [baseline] (67.43 ms) : 0, 67430
Debugger [candidate] (66.662 ms) : 0, 66662
Remote Config [baseline] (690.603 µs) : 0, 691
Remote Config [candidate] (722.505 µs) : 0, 723
Telemetry [baseline] (9.498 ms) : 0, 9498
Telemetry [candidate] (9.223 ms) : 0, 9223
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (3.596 ms) : 0, 3596
section iast
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (793.806 ms) : 0, 793806
BytebuddyAgent [candidate] (801.854 ms) : 0, 801854
AgentMeter [baseline] (11.241 ms) : 0, 11241
AgentMeter [candidate] (11.567 ms) : 0, 11567
GlobalTracer [baseline] (247.137 ms) : 0, 247137
GlobalTracer [candidate] (248.719 ms) : 0, 248719
IAST [baseline] (27.055 ms) : 0, 27055
IAST [candidate] (27.298 ms) : 0, 27298
AppSec [baseline] (32.269 ms) : 0, 32269
AppSec [candidate] (34.056 ms) : 0, 34056
Debugger [baseline] (68.683 ms) : 0, 68683
Debugger [candidate] (66.662 ms) : 0, 66662
Remote Config [baseline] (543.487 µs) : 0, 543
Remote Config [candidate] (530.393 µs) : 0, 530
Telemetry [baseline] (8.652 ms) : 0, 8652
Telemetry [candidate] (8.572 ms) : 0, 8572
Flare Poller [baseline] (3.463 ms) : 0, 3463
Flare Poller [candidate] (3.417 ms) : 0, 3417
section profiling
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.165 ms) : 0, 1165
BytebuddyAgent [baseline] (688.075 ms) : 0, 688075
BytebuddyAgent [candidate] (691.067 ms) : 0, 691067
AgentMeter [baseline] (8.591 ms) : 0, 8591
AgentMeter [candidate] (8.694 ms) : 0, 8694
GlobalTracer [baseline] (217.362 ms) : 0, 217362
GlobalTracer [candidate] (217.957 ms) : 0, 217957
AppSec [baseline] (33.122 ms) : 0, 33122
AppSec [candidate] (33.224 ms) : 0, 33224
Debugger [baseline] (67.505 ms) : 0, 67505
Debugger [candidate] (67.034 ms) : 0, 67034
Remote Config [baseline] (633.289 µs) : 0, 633
Remote Config [candidate] (635.339 µs) : 0, 635
Telemetry [baseline] (8.947 ms) : 0, 8947
Telemetry [candidate] (9.797 ms) : 0, 9797
Flare Poller [baseline] (3.834 ms) : 0, 3834
Flare Poller [candidate] (3.823 ms) : 0, 3823
ProfilingAgent [baseline] (99.681 ms) : 0, 99681
ProfilingAgent [candidate] (99.949 ms) : 0, 99949
Profiling [baseline] (100.257 ms) : 0, 100257
Profiling [candidate] (100.534 ms) : 0, 100534
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/pin-system-tests-sha
git_commit_date 1772492986 1772546748
git_commit_sha 0f5d84f 7504c7c
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~7504c7cf37
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772549556 1772549556
ci_job_id 1471004800 1471004800
ci_pipeline_id 100015604 100015604
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-ftk2gyzl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-ftk2gyzl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-245.185µs; -67.746µs] or [-12.460%; -3.443%]		 unstable
[-1193.645µs; -257.220µs] or [-19.904%; -4.289%]		 unstable
[-52.717op/s; +422.842op/s] or [-2.908%; +23.322%]		 1.811ms 5.272ms 1998.094op/s 1.968ms 5.997ms 1813.031op/s
scenario:load:petclinic:code_origins:high_load better
[-1.923ms; -1.008ms] or [-9.940%; -5.211%]		 better
[-3.270ms; -1.665ms] or [-10.340%; -5.266%]		 unstable
[-5.423op/s; +43.860op/s] or [-2.282%; +18.455%]		 17.881ms 29.158ms 256.875op/s 19.347ms 31.625ms 237.656op/s
scenario:load:petclinic:profiling:high_load worse
[+0.656ms; +1.957ms] or [+3.466%; +10.340%]		 unsure
[+0.377ms; +3.212ms] or [+1.233%; +10.515%]		 unstable
[-36.776op/s; +10.713op/s] or [-15.220%; +4.434%]		 20.231ms 32.341ms 228.594op/s 18.925ms 30.546ms 241.625op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (20.13 ms) : 19919, 20341
.   : milestone, 20130,
appsec (18.98 ms) : 18785, 19175
.   : milestone, 18980,
code_origins (19.638 ms) : 19433, 19842
.   : milestone, 19638,
iast (18.004 ms) : 17821, 18187
.   : milestone, 18004,
profiling (19.315 ms) : 19123, 19507
.   : milestone, 19315,
tracing (18.196 ms) : 18012, 18380
.   : milestone, 18196,
section candidate
no_agent (19.717 ms) : 19515, 19920
.   : milestone, 19717,
appsec (19.389 ms) : 19192, 19585
.   : milestone, 19389,
code_origins (18.17 ms) : 17989, 18351
.   : milestone, 18170,
iast (18.469 ms) : 18281, 18658
.   : milestone, 18469,
profiling (20.427 ms) : 20208, 20646
.   : milestone, 20427,
tracing (18.176 ms) : 17993, 18360
.   : milestone, 18176,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 20.13 ms [19.919 ms, 20.341 ms] -
appsec 18.98 ms [18.785 ms, 19.175 ms] -1.15 ms (-5.7%)
code_origins 19.638 ms [19.433 ms, 19.842 ms] -492.581 µs (-2.4%)
iast 18.004 ms [17.821 ms, 18.187 ms] -2.126 ms (-10.6%)
profiling 19.315 ms [19.123 ms, 19.507 ms] -814.904 µs (-4.0%)
tracing 18.196 ms [18.012 ms, 18.38 ms] -1.934 ms (-9.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.717 ms [19.515 ms, 19.92 ms] -
appsec 19.389 ms [19.192 ms, 19.585 ms] -328.781 µs (-1.7%)
code_origins 18.17 ms [17.989 ms, 18.351 ms] -1.547 ms (-7.8%)
iast 18.469 ms [18.281 ms, 18.658 ms] -1.248 ms (-6.3%)
profiling 20.427 ms [20.208 ms, 20.646 ms] 709.875 µs (3.6%)
tracing 18.176 ms [17.993 ms, 18.36 ms] -1.541 ms (-7.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.281 ms) : 1268, 1294
.   : milestone, 1281,
iast (3.423 ms) : 3373, 3473
.   : milestone, 3423,
iast_FULL (6.448 ms) : 6380, 6517
.   : milestone, 6448,
iast_GLOBAL (3.713 ms) : 3655, 3771
.   : milestone, 3713,
profiling (2.506 ms) : 2480, 2532
.   : milestone, 2506,
tracing (1.994 ms) : 1975, 2012
.   : milestone, 1994,
section candidate
no_agent (1.295 ms) : 1282, 1308
.   : milestone, 1295,
iast (3.497 ms) : 3447, 3547
.   : milestone, 3497,
iast_FULL (6.261 ms) : 6197, 6325
.   : milestone, 6261,
iast_GLOBAL (3.688 ms) : 3625, 3750
.   : milestone, 3688,
profiling (2.267 ms) : 2243, 2291
.   : milestone, 2267,
tracing (2.057 ms) : 2039, 2075
.   : milestone, 2057,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.281 ms [1.268 ms, 1.294 ms] -
iast 3.423 ms [3.373 ms, 3.473 ms] 2.142 ms (167.2%)
iast_FULL 6.448 ms [6.38 ms, 6.517 ms] 5.168 ms (403.4%)
iast_GLOBAL 3.713 ms [3.655 ms, 3.771 ms] 2.432 ms (189.9%)
profiling 2.506 ms [2.48 ms, 2.532 ms] 1.225 ms (95.6%)
tracing 1.994 ms [1.975 ms, 2.012 ms] 712.911 µs (55.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.295 ms [1.282 ms, 1.308 ms] -
iast 3.497 ms [3.447 ms, 3.547 ms] 2.202 ms (170.1%)
iast_FULL 6.261 ms [6.197 ms, 6.325 ms] 4.966 ms (383.6%)
iast_GLOBAL 3.688 ms [3.625 ms, 3.75 ms] 2.393 ms (184.8%)
profiling 2.267 ms [2.243 ms, 2.291 ms] 972.173 µs (75.1%)
tracing 2.057 ms [2.039 ms, 2.075 ms] 762.578 µs (58.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/pin-system-tests-sha
git_commit_date 1772492986 1772546748
git_commit_sha 0f5d84f 7504c7c
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~7504c7cf37
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772549149 1772549149
ci_job_id 1471004801 1471004801
ci_pipeline_id 100015604 100015604
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-5-tqgdk4t8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-5-tqgdk4t8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.329 s) : 15329000, 15329000
.   : milestone, 15329000,
appsec (14.996 s) : 14996000, 14996000
.   : milestone, 14996000,
iast (18.186 s) : 18186000, 18186000
.   : milestone, 18186000,
iast_GLOBAL (17.793 s) : 17793000, 17793000
.   : milestone, 17793000,
profiling (15.103 s) : 15103000, 15103000
.   : milestone, 15103000,
tracing (14.564 s) : 14564000, 14564000
.   : milestone, 14564000,
section candidate
no_agent (15.504 s) : 15504000, 15504000
.   : milestone, 15504000,
appsec (15.19 s) : 15190000, 15190000
.   : milestone, 15190000,
iast (18.707 s) : 18707000, 18707000
.   : milestone, 18707000,
iast_GLOBAL (17.702 s) : 17702000, 17702000
.   : milestone, 17702000,
profiling (15.353 s) : 15353000, 15353000
.   : milestone, 15353000,
tracing (14.891 s) : 14891000, 14891000
.   : milestone, 14891000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.329 s [15.329 s, 15.329 s] -
appsec 14.996 s [14.996 s, 14.996 s] -333.0 ms (-2.2%)
iast 18.186 s [18.186 s, 18.186 s] 2.857 s (18.6%)
iast_GLOBAL 17.793 s [17.793 s, 17.793 s] 2.464 s (16.1%)
profiling 15.103 s [15.103 s, 15.103 s] -226.0 ms (-1.5%)
tracing 14.564 s [14.564 s, 14.564 s] -765.0 ms (-5.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.504 s [15.504 s, 15.504 s] -
appsec 15.19 s [15.19 s, 15.19 s] -314.0 ms (-2.0%)
iast 18.707 s [18.707 s, 18.707 s] 3.203 s (20.7%)
iast_GLOBAL 17.702 s [17.702 s, 17.702 s] 2.198 s (14.2%)
profiling 15.353 s [15.353 s, 15.353 s] -151.0 ms (-1.0%)
tracing 14.891 s [14.891 s, 14.891 s] -613.0 ms (-4.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~7504c7cf37, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (2.504 ms) : 2450, 2559
.   : milestone, 2504,
iast (2.257 ms) : 2188, 2327
.   : milestone, 2257,
iast_GLOBAL (2.302 ms) : 2232, 2371
.   : milestone, 2302,
profiling (2.108 ms) : 2052, 2165
.   : milestone, 2108,
tracing (2.067 ms) : 2014, 2121
.   : milestone, 2067,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.729 ms) : 3512, 3946
.   : milestone, 3729,
iast (2.26 ms) : 2191, 2329
.   : milestone, 2260,
iast_GLOBAL (2.306 ms) : 2237, 2376
.   : milestone, 2306,
profiling (2.103 ms) : 2046, 2159
.   : milestone, 2103,
tracing (2.064 ms) : 2011, 2118
.   : milestone, 2064,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 2.504 ms [2.45 ms, 2.559 ms] 1.023 ms (69.0%)
iast 2.257 ms [2.188 ms, 2.327 ms] 775.708 µs (52.4%)
iast_GLOBAL 2.302 ms [2.232 ms, 2.371 ms] 819.891 µs (55.3%)
profiling 2.108 ms [2.052 ms, 2.165 ms] 626.326 µs (42.3%)
tracing 2.067 ms [2.014 ms, 2.121 ms] 585.495 µs (39.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 3.729 ms [3.512 ms, 3.946 ms] 2.252 ms (152.4%)
iast 2.26 ms [2.191 ms, 2.329 ms] 782.928 µs (53.0%)
iast_GLOBAL 2.306 ms [2.237 ms, 2.376 ms] 829.13 µs (56.1%)
profiling 2.103 ms [2.046 ms, 2.159 ms] 625.632 µs (42.4%)
tracing 2.064 ms [2.011 ms, 2.118 ms] 587.323 µs (39.8%)

@sarahchen6 sarahchen6 merged commit 881ccb7 into release/v1.60.x Mar 3, 2026
590 of 595 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/pin-system-tests-sha branch March 3, 2026 16:21
@jandro996 jandro996 mentioned this pull request Mar 18, 2026
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer

Assignees

No one assigned

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sarahchen6 @amarziali