Skip to content

Pin system tests for release branch#11065

Merged
PerfectSlayer merged 2 commits intorelease/v1.61.xfrom
ci/pin-system-tests-20260408
Apr 9, 2026
Merged

Pin system tests for release branch#11065
PerfectSlayer merged 2 commits intorelease/v1.61.xfrom
ci/pin-system-tests-20260408

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts bot commented Apr 8, 2026

This PR pins the system-tests reference for the release branch.

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts bot added the tag: no release notes Changes to exclude from release notes label Apr 8, 2026
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner April 8, 2026 12:44
@dd-octo-sts dd-octo-sts bot added the tag: dependencies Dependencies related changes label Apr 8, 2026
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner April 8, 2026 12:44
@dd-octo-sts dd-octo-sts bot requested review from sarahchen6 and removed request for a team April 8, 2026 12:44
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Apr 8, 2026
@dd-octo-sts dd-octo-sts bot requested review from erikayasuda and removed request for a team April 8, 2026 12:44
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 8, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/pin-system-tests-20260408
git_commit_date 1775720215 1775736689
git_commit_sha 68a2e63 d1d243f
release_version 1.62.0-SNAPSHOT~68a2e632a8 1.62.0-SNAPSHOT~d1d243ff95
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1775738588 1775738588
ci_job_id 1581030126 1581030126
ci_pipeline_id 106864713 106864713
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-e54ppxav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-e54ppxav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055690
Total [baseline] (8.848 s) : 0, 8848009
Agent [candidate] (1.053 s) : 0, 1053459
Total [candidate] (8.819 s) : 0, 8818944
section iast
Agent [baseline] (1.222 s) : 0, 1222280
Total [baseline] (9.579 s) : 0, 9578776
Agent [candidate] (1.23 s) : 0, 1229846
Total [candidate] (9.561 s) : 0, 9561195
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.222 s 166.59 ms (15.8%)
Total tracing 8.848 s -
Total iast 9.579 s 730.767 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.23 s 176.387 ms (16.7%)
Total tracing 8.819 s -
Total iast 9.561 s 742.251 ms (8.4%)
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (631.381 ms) : 0, 631381
BytebuddyAgent [candidate] (631.302 ms) : 0, 631302
AgentMeter [baseline] (29.352 ms) : 0, 29352
AgentMeter [candidate] (29.472 ms) : 0, 29472
GlobalTracer [baseline] (248.848 ms) : 0, 248848
GlobalTracer [candidate] (248.149 ms) : 0, 248149
AppSec [baseline] (32.026 ms) : 0, 32026
AppSec [candidate] (31.974 ms) : 0, 31974
Debugger [baseline] (59.069 ms) : 0, 59069
Debugger [candidate] (59.178 ms) : 0, 59178
Remote Config [baseline] (600.507 µs) : 0, 601
Remote Config [candidate] (603.717 µs) : 0, 604
Telemetry [baseline] (8.116 ms) : 0, 8116
Telemetry [candidate] (8.081 ms) : 0, 8081
Flare Poller [baseline] (8.955 ms) : 0, 8955
Flare Poller [candidate] (7.498 ms) : 0, 7498
section iast
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (800.858 ms) : 0, 800858
BytebuddyAgent [candidate] (806.128 ms) : 0, 806128
AgentMeter [baseline] (11.307 ms) : 0, 11307
AgentMeter [candidate] (11.47 ms) : 0, 11470
GlobalTracer [baseline] (238.453 ms) : 0, 238453
GlobalTracer [candidate] (239.962 ms) : 0, 239962
AppSec [baseline] (30.363 ms) : 0, 30363
AppSec [candidate] (31.378 ms) : 0, 31378
Debugger [baseline] (61.891 ms) : 0, 61891
Debugger [candidate] (62.165 ms) : 0, 62165
Remote Config [baseline] (539.292 µs) : 0, 539
Remote Config [candidate] (542.303 µs) : 0, 542
Telemetry [baseline] (12.033 ms) : 0, 12033
Telemetry [candidate] (11.195 ms) : 0, 11195
Flare Poller [baseline] (3.476 ms) : 0, 3476
Flare Poller [candidate] (3.473 ms) : 0, 3473
IAST [baseline] (25.732 ms) : 0, 25732
IAST [candidate] (25.987 ms) : 0, 25987
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062160
Total [baseline] (11.003 s) : 0, 11003315
Agent [candidate] (1.058 s) : 0, 1057946
Total [candidate] (11.092 s) : 0, 11091662
section appsec
Agent [baseline] (1.253 s) : 0, 1252702
Total [baseline] (11.202 s) : 0, 11201952
Agent [candidate] (1.248 s) : 0, 1247889
Total [candidate] (11.157 s) : 0, 11157010
section iast
Agent [baseline] (1.238 s) : 0, 1238050
Total [baseline] (11.258 s) : 0, 11257551
Agent [candidate] (1.224 s) : 0, 1224187
Total [candidate] (11.323 s) : 0, 11322515
section profiling
Agent [baseline] (1.187 s) : 0, 1186914
Total [baseline] (10.983 s) : 0, 10982592
Agent [candidate] (1.182 s) : 0, 1181834
Total [candidate] (11.07 s) : 0, 11070309
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.253 s 190.542 ms (17.9%)
Agent iast 1.238 s 175.89 ms (16.6%)
Agent profiling 1.187 s 124.754 ms (11.7%)
Total tracing 11.003 s -
Total appsec 11.202 s 198.636 ms (1.8%)
Total iast 11.258 s 254.235 ms (2.3%)
Total profiling 10.983 s -20.723 ms (-0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.248 s 189.943 ms (18.0%)
Agent iast 1.224 s 166.24 ms (15.7%)
Agent profiling 1.182 s 123.888 ms (11.7%)
Total tracing 11.092 s -
Total appsec 11.157 s 65.348 ms (0.6%)
Total iast 11.323 s 230.853 ms (2.1%)
Total profiling 11.07 s -21.353 ms (-0.2%)
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.249 ms) : 0, 1249
crashtracking [candidate] (1.239 ms) : 0, 1239
BytebuddyAgent [baseline] (636.754 ms) : 0, 636754
BytebuddyAgent [candidate] (633.152 ms) : 0, 633152
AgentMeter [baseline] (29.569 ms) : 0, 29569
AgentMeter [candidate] (29.421 ms) : 0, 29421
GlobalTracer [baseline] (250.429 ms) : 0, 250429
GlobalTracer [candidate] (248.864 ms) : 0, 248864
AppSec [baseline] (32.168 ms) : 0, 32168
AppSec [candidate] (31.928 ms) : 0, 31928
Debugger [baseline] (60.226 ms) : 0, 60226
Debugger [candidate] (59.814 ms) : 0, 59814
Remote Config [baseline] (599.508 µs) : 0, 600
Remote Config [candidate] (590.46 µs) : 0, 590
Telemetry [baseline] (8.175 ms) : 0, 8175
Telemetry [candidate] (8.07 ms) : 0, 8070
Flare Poller [baseline] (6.753 ms) : 0, 6753
Flare Poller [candidate] (8.78 ms) : 0, 8780
section appsec
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.224 ms) : 0, 1224
BytebuddyAgent [baseline] (664.628 ms) : 0, 664628
BytebuddyAgent [candidate] (661.653 ms) : 0, 661653
AgentMeter [baseline] (12.03 ms) : 0, 12030
AgentMeter [candidate] (12.035 ms) : 0, 12035
GlobalTracer [baseline] (249.665 ms) : 0, 249665
GlobalTracer [candidate] (248.697 ms) : 0, 248697
AppSec [baseline] (185.07 ms) : 0, 185070
AppSec [candidate] (184.337 ms) : 0, 184337
Debugger [baseline] (66.187 ms) : 0, 66187
Debugger [candidate] (66.246 ms) : 0, 66246
Remote Config [baseline] (606.257 µs) : 0, 606
Remote Config [candidate] (592.723 µs) : 0, 593
Telemetry [baseline] (8.665 ms) : 0, 8665
Telemetry [candidate] (8.644 ms) : 0, 8644
Flare Poller [baseline] (3.57 ms) : 0, 3570
Flare Poller [candidate] (3.582 ms) : 0, 3582
IAST [baseline] (24.628 ms) : 0, 24628
IAST [candidate] (24.578 ms) : 0, 24578
section iast
crashtracking [baseline] (1.25 ms) : 0, 1250
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (810.953 ms) : 0, 810953
BytebuddyAgent [candidate] (801.7 ms) : 0, 801700
AgentMeter [baseline] (11.841 ms) : 0, 11841
AgentMeter [candidate] (11.382 ms) : 0, 11382
GlobalTracer [baseline] (242.309 ms) : 0, 242309
GlobalTracer [candidate] (238.663 ms) : 0, 238663
AppSec [baseline] (33.542 ms) : 0, 33542
AppSec [candidate] (32.273 ms) : 0, 32273
Debugger [baseline] (59.337 ms) : 0, 59337
Debugger [candidate] (58.737 ms) : 0, 58737
Remote Config [baseline] (528.932 µs) : 0, 529
Remote Config [candidate] (1.646 ms) : 0, 1646
Telemetry [baseline] (12.339 ms) : 0, 12339
Telemetry [candidate] (13.077 ms) : 0, 13077
Flare Poller [baseline] (3.41 ms) : 0, 3410
Flare Poller [candidate] (3.456 ms) : 0, 3456
IAST [baseline] (26.199 ms) : 0, 26199
IAST [candidate] (25.721 ms) : 0, 25721
section profiling
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (693.847 ms) : 0, 693847
BytebuddyAgent [candidate] (690.08 ms) : 0, 690080
AgentMeter [baseline] (9.174 ms) : 0, 9174
AgentMeter [candidate] (9.05 ms) : 0, 9050
GlobalTracer [baseline] (207.157 ms) : 0, 207157
GlobalTracer [candidate] (206.66 ms) : 0, 206660
AppSec [baseline] (32.445 ms) : 0, 32445
AppSec [candidate] (32.498 ms) : 0, 32498
Debugger [baseline] (65.599 ms) : 0, 65599
Debugger [candidate] (65.293 ms) : 0, 65293
Remote Config [baseline] (575.816 µs) : 0, 576
Remote Config [candidate] (570.723 µs) : 0, 571
Telemetry [baseline] (7.839 ms) : 0, 7839
Telemetry [candidate] (7.915 ms) : 0, 7915
Flare Poller [baseline] (3.561 ms) : 0, 3561
Flare Poller [candidate] (3.594 ms) : 0, 3594
ProfilingAgent [baseline] (94.141 ms) : 0, 94141
ProfilingAgent [candidate] (93.845 ms) : 0, 93845
Profiling [baseline] (94.719 ms) : 0, 94719
Profiling [candidate] (94.414 ms) : 0, 94414
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/pin-system-tests-20260408
git_commit_date 1775720215 1775736689
git_commit_sha 68a2e63 d1d243f
release_version 1.62.0-SNAPSHOT~68a2e632a8 1.62.0-SNAPSHOT~d1d243ff95
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1775739066 1775739066
ci_job_id 1581030127 1581030127
ci_pipeline_id 106864713 106864713
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-dstdrilr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-dstdrilr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+162.013µs; +284.873µs] or [+6.584%; +11.576%]
worse
[+381.611µs; +857.805µs] or [+5.358%; +12.044%]
unstable
[-266.340op/s; +48.277op/s] or [-18.379%; +3.331%]
2.684ms 7.742ms 1340.156op/s 2.461ms 7.122ms 1449.188op/s
scenario:load:petclinic:profiling:high_load worse
[+2.238ms; +2.914ms] or [+12.359%; +16.087%]
worse
[+2.248ms; +4.666ms] or [+7.725%; +16.036%]
unstable
[-55.062op/s; -6.313op/s] or [-21.713%; -2.489%]
20.689ms 32.556ms 222.906op/s 18.113ms 29.099ms 253.594op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.215 ms) : 18028, 18402
.   : milestone, 18215,
appsec (18.647 ms) : 18458, 18835
.   : milestone, 18647,
code_origins (18.089 ms) : 17911, 18266
.   : milestone, 18089,
iast (18.393 ms) : 18208, 18577
.   : milestone, 18393,
profiling (18.399 ms) : 18220, 18578
.   : milestone, 18399,
tracing (17.834 ms) : 17659, 18009
.   : milestone, 17834,
section candidate
no_agent (18.082 ms) : 17901, 18264
.   : milestone, 18082,
appsec (18.601 ms) : 18417, 18784
.   : milestone, 18601,
code_origins (17.721 ms) : 17548, 17893
.   : milestone, 17721,
iast (18.066 ms) : 17887, 18244
.   : milestone, 18066,
profiling (20.95 ms) : 20735, 21165
.   : milestone, 20950,
tracing (17.848 ms) : 17671, 18024
.   : milestone, 17848,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.215 ms [18.028 ms, 18.402 ms] -
appsec 18.647 ms [18.458 ms, 18.835 ms] 431.457 µs (2.4%)
code_origins 18.089 ms [17.911 ms, 18.266 ms] -126.237 µs (-0.7%)
iast 18.393 ms [18.208 ms, 18.577 ms] 177.52 µs (1.0%)
profiling 18.399 ms [18.22 ms, 18.578 ms] 183.701 µs (1.0%)
tracing 17.834 ms [17.659 ms, 18.009 ms] -381.562 µs (-2.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.082 ms [17.901 ms, 18.264 ms] -
appsec 18.601 ms [18.417 ms, 18.784 ms] 518.27 µs (2.9%)
code_origins 17.721 ms [17.548 ms, 17.893 ms] -361.7 µs (-2.0%)
iast 18.066 ms [17.887 ms, 18.244 ms] -16.673 µs (-0.1%)
profiling 20.95 ms [20.735 ms, 21.165 ms] 2.867 ms (15.9%)
tracing 17.848 ms [17.671 ms, 18.024 ms] -234.904 µs (-1.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.256 ms) : 1244, 1269
.   : milestone, 1256,
iast (3.155 ms) : 3115, 3194
.   : milestone, 3155,
iast_FULL (6.042 ms) : 5981, 6104
.   : milestone, 6042,
iast_GLOBAL (3.704 ms) : 3642, 3765
.   : milestone, 3704,
profiling (2.164 ms) : 2145, 2184
.   : milestone, 2164,
tracing (1.914 ms) : 1898, 1930
.   : milestone, 1914,
section candidate
no_agent (1.239 ms) : 1226, 1251
.   : milestone, 1239,
iast (3.418 ms) : 3370, 3466
.   : milestone, 3418,
iast_FULL (6.03 ms) : 5969, 6092
.   : milestone, 6030,
iast_GLOBAL (3.79 ms) : 3719, 3862
.   : milestone, 3790,
profiling (2.071 ms) : 2053, 2089
.   : milestone, 2071,
tracing (1.857 ms) : 1842, 1873
.   : milestone, 1857,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.256 ms [1.244 ms, 1.269 ms] -
iast 3.155 ms [3.115 ms, 3.194 ms] 1.898 ms (151.1%)
iast_FULL 6.042 ms [5.981 ms, 6.104 ms] 4.786 ms (380.9%)
iast_GLOBAL 3.704 ms [3.642 ms, 3.765 ms] 2.447 ms (194.8%)
profiling 2.164 ms [2.145 ms, 2.184 ms] 907.751 µs (72.2%)
tracing 1.914 ms [1.898 ms, 1.93 ms] 657.454 µs (52.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.239 ms [1.226 ms, 1.251 ms] -
iast 3.418 ms [3.37 ms, 3.466 ms] 2.18 ms (176.0%)
iast_FULL 6.03 ms [5.969 ms, 6.092 ms] 4.792 ms (386.9%)
iast_GLOBAL 3.79 ms [3.719 ms, 3.862 ms] 2.552 ms (206.0%)
profiling 2.071 ms [2.053 ms, 2.089 ms] 832.661 µs (67.2%)
tracing 1.857 ms [1.842 ms, 1.873 ms] 618.757 µs (50.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/pin-system-tests-20260408
git_commit_date 1775720215 1775736689
git_commit_sha 68a2e63 d1d243f
release_version 1.62.0-SNAPSHOT~68a2e632a8 1.62.0-SNAPSHOT~d1d243ff95
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1775738783 1775738783
ci_job_id 1581030130 1581030130
ci_pipeline_id 106864713 106864713
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-x6o966rx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-x6o966rx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.261 s) : 15261000, 15261000
.   : milestone, 15261000,
appsec (14.941 s) : 14941000, 14941000
.   : milestone, 14941000,
iast (18.292 s) : 18292000, 18292000
.   : milestone, 18292000,
iast_GLOBAL (18.045 s) : 18045000, 18045000
.   : milestone, 18045000,
profiling (15.032 s) : 15032000, 15032000
.   : milestone, 15032000,
tracing (14.695 s) : 14695000, 14695000
.   : milestone, 14695000,
section candidate
no_agent (15.542 s) : 15542000, 15542000
.   : milestone, 15542000,
appsec (14.519 s) : 14519000, 14519000
.   : milestone, 14519000,
iast (18.266 s) : 18266000, 18266000
.   : milestone, 18266000,
iast_GLOBAL (18.305 s) : 18305000, 18305000
.   : milestone, 18305000,
profiling (14.722 s) : 14722000, 14722000
.   : milestone, 14722000,
tracing (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.261 s [15.261 s, 15.261 s] -
appsec 14.941 s [14.941 s, 14.941 s] -320.0 ms (-2.1%)
iast 18.292 s [18.292 s, 18.292 s] 3.031 s (19.9%)
iast_GLOBAL 18.045 s [18.045 s, 18.045 s] 2.784 s (18.2%)
profiling 15.032 s [15.032 s, 15.032 s] -229.0 ms (-1.5%)
tracing 14.695 s [14.695 s, 14.695 s] -566.0 ms (-3.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.542 s [15.542 s, 15.542 s] -
appsec 14.519 s [14.519 s, 14.519 s] -1.023 s (-6.6%)
iast 18.266 s [18.266 s, 18.266 s] 2.724 s (17.5%)
iast_GLOBAL 18.305 s [18.305 s, 18.305 s] 2.763 s (17.8%)
profiling 14.722 s [14.722 s, 14.722 s] -820.0 ms (-5.3%)
tracing 14.987 s [14.987 s, 14.987 s] -555.0 ms (-3.6%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.493 ms) : 1482, 1505
.   : milestone, 1493,
appsec (3.838 ms) : 3613, 4063
.   : milestone, 3838,
iast (2.285 ms) : 2215, 2355
.   : milestone, 2285,
iast_GLOBAL (2.325 ms) : 2255, 2395
.   : milestone, 2325,
profiling (2.102 ms) : 2046, 2157
.   : milestone, 2102,
tracing (2.092 ms) : 2038, 2147
.   : milestone, 2092,
section candidate
no_agent (1.488 ms) : 1476, 1499
.   : milestone, 1488,
appsec (3.802 ms) : 3579, 4026
.   : milestone, 3802,
iast (2.277 ms) : 2207, 2347
.   : milestone, 2277,
iast_GLOBAL (2.326 ms) : 2256, 2396
.   : milestone, 2326,
profiling (2.517 ms) : 2299, 2736
.   : milestone, 2517,
tracing (2.086 ms) : 2032, 2140
.   : milestone, 2086,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.493 ms [1.482 ms, 1.505 ms] -
appsec 3.838 ms [3.613 ms, 4.063 ms] 2.345 ms (157.1%)
iast 2.285 ms [2.215 ms, 2.355 ms] 791.521 µs (53.0%)
iast_GLOBAL 2.325 ms [2.255 ms, 2.395 ms] 831.508 µs (55.7%)
profiling 2.102 ms [2.046 ms, 2.157 ms] 608.399 µs (40.7%)
tracing 2.092 ms [2.038 ms, 2.147 ms] 599.214 µs (40.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.488 ms [1.476 ms, 1.499 ms] -
appsec 3.802 ms [3.579 ms, 4.026 ms] 2.315 ms (155.6%)
iast 2.277 ms [2.207 ms, 2.347 ms] 789.265 µs (53.0%)
iast_GLOBAL 2.326 ms [2.256 ms, 2.396 ms] 837.865 µs (56.3%)
profiling 2.517 ms [2.299 ms, 2.736 ms] 1.03 ms (69.2%)
tracing 2.086 ms [2.032 ms, 2.14 ms] 597.862 µs (40.2%)

@PerfectSlayer
Copy link
Copy Markdown
Contributor

Retrying parametric tests

@PerfectSlayer PerfectSlayer enabled auto-merge (squash) April 9, 2026 13:02
@PerfectSlayer PerfectSlayer merged commit 3b8e85d into release/v1.61.x Apr 9, 2026
564 checks passed
@PerfectSlayer PerfectSlayer deleted the ci/pin-system-tests-20260408 branch April 9, 2026 13:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant