Skip to content

Conversation

mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Oct 9, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Oct 9, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1760032247 1760032592
end_time 2025-10-09T17:52:07 2025-10-09T17:57:54
git_branch master mhlidd/test
git_commit_sha dc8540a 348f975
start_time 2025-10-09T17:50:48 2025-10-09T17:56:33
See matching parameters
Baseline Candidate
ci_job_id 1172450274 1172450274
ci_pipeline_id 78884531 78884531
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1758568684 1758568684

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 5 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-19.551µs; +32.657µs] or [-7.021%; +11.727%]
unstable
[-28.191µs; +49.504µs] or [-8.901%; +15.630%]
unstable
[-37.545µs; +61.729µs] or [-11.356%; +18.671%]
unstable
[-109.521µs; +98.826µs] or [-11.139%; +10.051%]
same
scenario:basic same same same unstable
[-99.165µs; +79.493µs] or [-12.942%; +10.375%]
same
scenario:loop unsure
[+6.722µs; +13.902µs] or [+0.076%; +0.157%]
unsure
[+0.576µs; +10.168µs] or [+0.006%; +0.113%]
unsure
[+8.074µs; +18.305µs] or [+0.090%; +0.203%]
unsure
[+14.807µs; +114.493µs] or [+0.162%; +1.256%]
same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (316.719 µs) : 284, 349
.   : milestone, 317,
basic (277.816 µs) : 272, 283
.   : milestone, 278,
loop (8.962 ms) : 8959, 8966
.   : milestone, 8962,
section candidate
noprobe (327.375 µs) : 287, 368
.   : milestone, 327,
basic (281.034 µs) : 275, 287
.   : milestone, 281,
loop (8.967 ms) : 8962, 8973
.   : milestone, 8967,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 316.719 µs [284.076 µs, 349.361 µs]
basic 277.816 µs [272.189 µs, 283.443 µs]
loop 8.962 ms [8.959 ms, 8.966 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 327.375 µs [286.517 µs, 368.234 µs]
basic 281.034 µs [275.319 µs, 286.749 µs]
loop 8.967 ms [8.962 ms, 8.973 ms]

@pr-commenter
Copy link

pr-commenter bot commented Oct 9, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/test
git_commit_date 1760029598 1758568684
git_commit_sha dc8540a 348f975
release_version 1.55.0-SNAPSHOT~dc8540ab92 1.54.0-SNAPSHOT~348f9751b8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760033477 1760033477
ci_job_id 1172450267 1172450267
ci_pipeline_id 78884531 78884531
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-27y5o2p0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-27y5o2p0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 3 performance improvements and 6 performance regressions! Performance is the same for 43 metrics, 7 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer worse
[+15.904ms; +21.602ms] or [+6.884%; +9.350%]
249.779ms 231.026ms
scenario:startup:insecure-bank:tracing:GlobalTracer worse
[+10.534ms; +19.967ms] or [+4.313%; +8.176%]
259.471ms 244.221ms
scenario:startup:petclinic:appsec:GlobalTracer worse
[+9.351ms; +17.515ms] or [+3.951%; +7.401%]
250.103ms 236.670ms
scenario:startup:petclinic:iast:GlobalTracer worse
[+14.863ms; +20.038ms] or [+6.417%; +8.651%]
249.084ms 231.633ms
scenario:startup:petclinic:profiling:ProfilingAgent better
[-7.137ms; -3.630ms] or [-6.633%; -3.373%]
102.220ms 107.603ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+15.043ms; +18.297ms] or [+6.916%; +8.412%]
234.193ms 217.523ms
scenario:startup:petclinic:profiling:AppSec better
[-1.891ms; -1.274ms] or [-5.785%; -3.897%]
31.109ms 32.692ms
scenario:startup:petclinic:profiling:Profiling better
[-7.133ms; -3.590ms] or [-6.593%; -3.318%]
102.829ms 108.190ms
scenario:startup:petclinic:tracing:GlobalTracer worse
[+15.635ms; +17.623ms] or [+6.485%; +7.310%]
257.708ms 241.079ms
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.031 s) : 0, 1030581
Total [baseline] (8.675 s) : 0, 8675290
Agent [candidate] (1.026 s) : 0, 1025512
Total [candidate] (8.654 s) : 0, 8653697
section iast
Agent [baseline] (1.149 s) : 0, 1148705
Total [baseline] (9.291 s) : 0, 9291222
Agent [candidate] (1.164 s) : 0, 1163534
Total [candidate] (9.35 s) : 0, 9350033
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.031 s -
Agent iast 1.149 s 118.124 ms (11.5%)
Total tracing 8.675 s -
Total iast 9.291 s 615.931 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.164 s 138.022 ms (13.5%)
Total tracing 8.654 s -
Total iast 9.35 s 696.336 ms (8.0%)
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (703.596 ms) : 0, 703596
BytebuddyAgent [candidate] (690.962 ms) : 0, 690962
GlobalTracer [baseline] (244.221 ms) : 0, 244221
GlobalTracer [candidate] (259.471 ms) : 0, 259471
AppSec [baseline] (33.004 ms) : 0, 33004
AppSec [candidate] (31.81 ms) : 0, 31810
Debugger [baseline] (6.498 ms) : 0, 6498
Debugger [candidate] (6.396 ms) : 0, 6396
Remote Config [baseline] (697.657 µs) : 0, 698
Remote Config [candidate] (693.177 µs) : 0, 693
Telemetry [baseline] (9.415 ms) : 0, 9415
Telemetry [candidate] (13.602 ms) : 0, 13602
Flare Poller [baseline] (10.378 ms) : 0, 10378
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.489 ms) : 0, 1489
BytebuddyAgent [baseline] (813.465 ms) : 0, 813465
BytebuddyAgent [candidate] (815.934 ms) : 0, 815934
GlobalTracer [baseline] (231.026 ms) : 0, 231026
GlobalTracer [candidate] (249.779 ms) : 0, 249779
IAST [baseline] (26.551 ms) : 0, 26551
IAST [candidate] (29.663 ms) : 0, 29663
AppSec [baseline] (35.249 ms) : 0, 35249
AppSec [candidate] (30.29 ms) : 0, 30290
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.196 ms) : 0, 6196
Remote Config [baseline] (613.888 µs) : 0, 614
Remote Config [candidate] (606.167 µs) : 0, 606
Telemetry [baseline] (8.668 ms) : 0, 8668
Telemetry [candidate] (8.52 ms) : 0, 8520
Flare Poller [baseline] (4.24 ms) : 0, 4240
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.015 s) : 0, 1014543
Total [baseline] (10.636 s) : 0, 10635865
Agent [candidate] (1.019 s) : 0, 1018723
Total [candidate] (10.657 s) : 0, 10657366
section appsec
Agent [baseline] (1.206 s) : 0, 1206444
Total [baseline] (11.08 s) : 0, 11080160
Agent [candidate] (1.198 s) : 0, 1197895
Total [candidate] (10.992 s) : 0, 10992068
section iast
Agent [baseline] (1.151 s) : 0, 1151114
Total [baseline] (10.992 s) : 0, 10991564
Agent [candidate] (1.161 s) : 0, 1161162
Total [candidate] (11.167 s) : 0, 11167422
section profiling
Agent [baseline] (1.161 s) : 0, 1160822
Total [baseline] (11.027 s) : 0, 11027414
Agent [candidate] (1.163 s) : 0, 1163420
Total [candidate] (11.11 s) : 0, 11109953
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.015 s -
Agent appsec 1.206 s 191.902 ms (18.9%)
Agent iast 1.151 s 136.571 ms (13.5%)
Agent profiling 1.161 s 146.279 ms (14.4%)
Total tracing 10.636 s -
Total appsec 11.08 s 444.295 ms (4.2%)
Total iast 10.992 s 355.699 ms (3.3%)
Total profiling 11.027 s 391.549 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.198 s 179.172 ms (17.6%)
Agent iast 1.161 s 142.439 ms (14.0%)
Agent profiling 1.163 s 144.697 ms (14.2%)
Total tracing 10.657 s -
Total appsec 10.992 s 334.702 ms (3.1%)
Total iast 11.167 s 510.056 ms (4.8%)
Total profiling 11.11 s 452.587 ms (4.2%)
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (692.047 ms) : 0, 692047
BytebuddyAgent [candidate] (685.645 ms) : 0, 685645
GlobalTracer [baseline] (241.079 ms) : 0, 241079
GlobalTracer [candidate] (257.708 ms) : 0, 257708
AppSec [baseline] (32.292 ms) : 0, 32292
AppSec [candidate] (31.738 ms) : 0, 31738
Debugger [baseline] (6.414 ms) : 0, 6414
Debugger [candidate] (6.355 ms) : 0, 6355
Remote Config [baseline] (688.165 µs) : 0, 688
Remote Config [candidate] (675.763 µs) : 0, 676
Telemetry [baseline] (9.277 ms) : 0, 9277
Telemetry [candidate] (14.158 ms) : 0, 14158
Flare Poller [baseline] (10.093 ms) : 0, 10093
section appsec
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (726.796 ms) : 0, 726796
BytebuddyAgent [candidate] (711.818 ms) : 0, 711818
GlobalTracer [baseline] (236.67 ms) : 0, 236670
GlobalTracer [candidate] (250.103 ms) : 0, 250103
IAST [baseline] (24.918 ms) : 0, 24918
IAST [candidate] (25.153 ms) : 0, 25153
AppSec [baseline] (176.127 ms) : 0, 176127
AppSec [candidate] (170.189 ms) : 0, 170189
Debugger [baseline] (6.105 ms) : 0, 6105
Debugger [candidate] (6.102 ms) : 0, 6102
Remote Config [baseline] (636.699 µs) : 0, 637
Remote Config [candidate] (612.864 µs) : 0, 613
Telemetry [baseline] (8.478 ms) : 0, 8478
Telemetry [candidate] (11.403 ms) : 0, 11403
Flare Poller [baseline] (3.934 ms) : 0, 3934
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (815.581 ms) : 0, 815581
BytebuddyAgent [candidate] (815.114 ms) : 0, 815114
GlobalTracer [baseline] (231.633 ms) : 0, 231633
GlobalTracer [candidate] (249.084 ms) : 0, 249084
IAST [baseline] (27.255 ms) : 0, 27255
IAST [candidate] (29.295 ms) : 0, 29295
AppSec [baseline] (34.176 ms) : 0, 34176
AppSec [candidate] (30.084 ms) : 0, 30084
Debugger [baseline] (6.121 ms) : 0, 6121
Debugger [candidate] (6.149 ms) : 0, 6149
Remote Config [baseline] (630.412 µs) : 0, 630
Remote Config [candidate] (598.751 µs) : 0, 599
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.311 ms) : 0, 8311
Flare Poller [baseline] (4.255 ms) : 0, 4255
section profiling
crashtracking [baseline] (1.432 ms) : 0, 1432
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (720.745 ms) : 0, 720745
BytebuddyAgent [candidate] (719.341 ms) : 0, 719341
GlobalTracer [baseline] (217.523 ms) : 0, 217523
GlobalTracer [candidate] (234.193 ms) : 0, 234193
AppSec [baseline] (32.692 ms) : 0, 32692
AppSec [candidate] (31.109 ms) : 0, 31109
Debugger [baseline] (6.471 ms) : 0, 6471
Debugger [candidate] (6.469 ms) : 0, 6469
Remote Config [baseline] (700.078 µs) : 0, 700
Remote Config [candidate] (717.496 µs) : 0, 717
Telemetry [baseline] (16.909 ms) : 0, 16909
Telemetry [candidate] (16.832 ms) : 0, 16832
Flare Poller [baseline] (4.202 ms) : 0, 4202
ProfilingAgent [baseline] (107.603 ms) : 0, 107603
ProfilingAgent [candidate] (102.22 ms) : 0, 102220
Profiling [baseline] (108.19 ms) : 0, 108190
Profiling [candidate] (102.829 ms) : 0, 102829
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/test
git_commit_date 1760029598 1758568684
git_commit_sha dc8540a 348f975
release_version 1.55.0-SNAPSHOT~dc8540ab92 1.54.0-SNAPSHOT~348f9751b8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760033186 1760033186
ci_job_id 1172450268 1172450268
ci_pipeline_id 78884531 78884531
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-k03pg94z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-k03pg94z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-782.098µs; -342.279µs] or [-7.059%; -3.089%]
unstable
[-49.441op/s; +67.100op/s] or [-11.782%; +15.991%]
10.517ms 428.455op/s 11.080ms 419.625op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+0.723ms; +1.340ms] or [+5.278%; +9.781%]
unstable
[-74.366op/s; +8.122op/s] or [-21.870%; +2.388%]
14.732ms 306.909op/s 13.700ms 340.031op/s
scenario:load:petclinic:iast:high_load better
[-2.593ms; -1.746ms] or [-5.602%; -3.774%]
unstable
[-0.823op/s; +13.534op/s] or [-0.814%; +13.388%]
44.110ms 107.443op/s 46.280ms 101.088op/s
scenario:load:petclinic:profiling:high_load better
[-2.495ms; -1.544ms] or [-5.130%; -3.176%]
unstable
[-1.259op/s; +12.025op/s] or [-1.307%; +12.492%]
46.613ms 101.646op/s 48.632ms 96.263op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.375 ms) : 4319, 4430
.   : milestone, 4375,
iast (9.744 ms) : 9583, 9904
.   : milestone, 9744,
iast_FULL (13.7 ms) : 13424, 13977
.   : milestone, 13700,
iast_GLOBAL (11.08 ms) : 10867, 11292
.   : milestone, 11080,
profiling (8.889 ms) : 8740, 9038
.   : milestone, 8889,
tracing (7.754 ms) : 7635, 7873
.   : milestone, 7754,
section candidate
no_agent (4.41 ms) : 4357, 4462
.   : milestone, 4410,
iast (9.587 ms) : 9429, 9746
.   : milestone, 9587,
iast_FULL (14.732 ms) : 14436, 15028
.   : milestone, 14732,
iast_GLOBAL (10.517 ms) : 10321, 10713
.   : milestone, 10517,
profiling (8.971 ms) : 8828, 9114
.   : milestone, 8971,
tracing (7.611 ms) : 7495, 7728
.   : milestone, 7611,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.375 ms [4.319 ms, 4.43 ms] -
iast 9.744 ms [9.583 ms, 9.904 ms] 5.369 ms (122.7%)
iast_FULL 13.7 ms [13.424 ms, 13.977 ms] 9.326 ms (213.2%)
iast_GLOBAL 11.08 ms [10.867 ms, 11.292 ms] 6.705 ms (153.3%)
profiling 8.889 ms [8.74 ms, 9.038 ms] 4.514 ms (103.2%)
tracing 7.754 ms [7.635 ms, 7.873 ms] 3.379 ms (77.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.41 ms [4.357 ms, 4.462 ms] -
iast 9.587 ms [9.429 ms, 9.746 ms] 5.178 ms (117.4%)
iast_FULL 14.732 ms [14.436 ms, 15.028 ms] 10.322 ms (234.1%)
iast_GLOBAL 10.517 ms [10.321 ms, 10.713 ms] 6.108 ms (138.5%)
profiling 8.971 ms [8.828 ms, 9.114 ms] 4.561 ms (103.4%)
tracing 7.611 ms [7.495 ms, 7.728 ms] 3.202 ms (72.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.944 ms) : 37641, 38246
.   : milestone, 37944,
appsec (49.497 ms) : 49074, 49920
.   : milestone, 49497,
code_origins (43.574 ms) : 43186, 43962
.   : milestone, 43574,
iast (46.28 ms) : 45867, 46692
.   : milestone, 46280,
profiling (48.632 ms) : 48167, 49098
.   : milestone, 48632,
tracing (45.162 ms) : 44785, 45538
.   : milestone, 45162,
section candidate
no_agent (37.402 ms) : 37097, 37707
.   : milestone, 37402,
appsec (48.995 ms) : 48544, 49446
.   : milestone, 48995,
code_origins (43.61 ms) : 43240, 43981
.   : milestone, 43610,
iast (44.11 ms) : 43737, 44483
.   : milestone, 44110,
profiling (46.613 ms) : 46196, 47030
.   : milestone, 46613,
tracing (45.121 ms) : 44749, 45493
.   : milestone, 45121,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.944 ms [37.641 ms, 38.246 ms] -
appsec 49.497 ms [49.074 ms, 49.92 ms] 11.553 ms (30.4%)
code_origins 43.574 ms [43.186 ms, 43.962 ms] 5.631 ms (14.8%)
iast 46.28 ms [45.867 ms, 46.692 ms] 8.336 ms (22.0%)
profiling 48.632 ms [48.167 ms, 49.098 ms] 10.689 ms (28.2%)
tracing 45.162 ms [44.785 ms, 45.538 ms] 7.218 ms (19.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.402 ms [37.097 ms, 37.707 ms] -
appsec 48.995 ms [48.544 ms, 49.446 ms] 11.593 ms (31.0%)
code_origins 43.61 ms [43.24 ms, 43.981 ms] 6.208 ms (16.6%)
iast 44.11 ms [43.737 ms, 44.483 ms] 6.708 ms (17.9%)
profiling 46.613 ms [46.196 ms, 47.03 ms] 9.211 ms (24.6%)
tracing 45.121 ms [44.749 ms, 45.493 ms] 7.719 ms (20.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/test
git_commit_date 1760029598 1758568684
git_commit_sha dc8540a 348f975
release_version 1.55.0-SNAPSHOT~dc8540ab92 1.54.0-SNAPSHOT~348f9751b8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1760033700 1760033700
ci_job_id 1172450269 1172450269
ci_pipeline_id 78884531 78884531
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-q4zu7deq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-q4zu7deq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.491 ms) : 1479, 1502
.   : milestone, 1491,
appsec (3.749 ms) : 3530, 3968
.   : milestone, 3749,
iast (2.234 ms) : 2170, 2297
.   : milestone, 2234,
iast_GLOBAL (2.266 ms) : 2202, 2329
.   : milestone, 2266,
profiling (2.078 ms) : 2026, 2130
.   : milestone, 2078,
tracing (2.051 ms) : 2001, 2101
.   : milestone, 2051,
section candidate
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (3.728 ms) : 3511, 3946
.   : milestone, 3728,
iast (2.228 ms) : 2165, 2290
.   : milestone, 2228,
iast_GLOBAL (2.26 ms) : 2197, 2323
.   : milestone, 2260,
profiling (2.083 ms) : 2031, 2135
.   : milestone, 2083,
tracing (2.05 ms) : 2002, 2099
.   : milestone, 2050,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.491 ms [1.479 ms, 1.502 ms] -
appsec 3.749 ms [3.53 ms, 3.968 ms] 2.258 ms (151.5%)
iast 2.234 ms [2.17 ms, 2.297 ms] 742.799 µs (49.8%)
iast_GLOBAL 2.266 ms [2.202 ms, 2.329 ms] 774.829 µs (52.0%)
profiling 2.078 ms [2.026 ms, 2.13 ms] 587.405 µs (39.4%)
tracing 2.051 ms [2.001 ms, 2.101 ms] 560.029 µs (37.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.496 ms] -
appsec 3.728 ms [3.511 ms, 3.946 ms] 2.243 ms (151.1%)
iast 2.228 ms [2.165 ms, 2.29 ms] 742.929 µs (50.0%)
iast_GLOBAL 2.26 ms [2.197 ms, 2.323 ms] 775.205 µs (52.2%)
profiling 2.083 ms [2.031 ms, 2.135 ms] 598.036 µs (40.3%)
tracing 2.05 ms [2.002 ms, 2.099 ms] 565.638 µs (38.1%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~348f9751b8, baseline=1.55.0-SNAPSHOT~dc8540ab92
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.586 s) : 15586000, 15586000
.   : milestone, 15586000,
appsec (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
iast (18.5 s) : 18500000, 18500000
.   : milestone, 18500000,
iast_GLOBAL (18.01 s) : 18010000, 18010000
.   : milestone, 18010000,
profiling (15.575 s) : 15575000, 15575000
.   : milestone, 15575000,
tracing (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
section candidate
no_agent (15.328 s) : 15328000, 15328000
.   : milestone, 15328000,
appsec (15.076 s) : 15076000, 15076000
.   : milestone, 15076000,
iast (18.608 s) : 18608000, 18608000
.   : milestone, 18608000,
iast_GLOBAL (17.879 s) : 17879000, 17879000
.   : milestone, 17879000,
profiling (15.819 s) : 15819000, 15819000
.   : milestone, 15819000,
tracing (15.399 s) : 15399000, 15399000
.   : milestone, 15399000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.586 s [15.586 s, 15.586 s] -
appsec 15.059 s [15.059 s, 15.059 s] -527.0 ms (-3.4%)
iast 18.5 s [18.5 s, 18.5 s] 2.914 s (18.7%)
iast_GLOBAL 18.01 s [18.01 s, 18.01 s] 2.424 s (15.6%)
profiling 15.575 s [15.575 s, 15.575 s] -11.0 ms (-0.1%)
tracing 15.001 s [15.001 s, 15.001 s] -585.0 ms (-3.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.328 s [15.328 s, 15.328 s] -
appsec 15.076 s [15.076 s, 15.076 s] -252.0 ms (-1.6%)
iast 18.608 s [18.608 s, 18.608 s] 3.28 s (21.4%)
iast_GLOBAL 17.879 s [17.879 s, 17.879 s] 2.551 s (16.6%)
profiling 15.819 s [15.819 s, 15.819 s] 491.0 ms (3.2%)
tracing 15.399 s [15.399 s, 15.399 s] 71.0 ms (0.5%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants