Skip to content

Update Gradle dependencies #8986

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 55 commits into from
Jun 23, 2025
Merged

Conversation

github-actions[bot]
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot requested review from evanchooly, Mariovido, smola and bric3 and removed request for a team June 15, 2025 04:32
@pr-commenter
Copy link

pr-commenter bot commented Jun 15, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250615
git_commit_date 1750453785 1750662297
git_commit_sha aa9dd27 13d2824
release_version 1.51.0-SNAPSHOT~aa9dd27535 1.51.0-SNAPSHOT~13d2824f08
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750664125 1750664125
ci_job_id 992802753 992802753
ci_pipeline_id 68423041 68423041
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-pw1nxbd--project-304-concurrent-0-pgxyeh5s 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-pw1nxbd--project-304-concurrent-0-pgxyeh5s 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank
Loading
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1025502
Total [baseline] (8.604 s) : 0, 8603816
Agent [candidate] (1.035 s) : 0, 1034589
Total [candidate] (8.516 s) : 0, 8516165
section iast
Agent [baseline] (1.152 s) : 0, 1151855
Total [baseline] (9.216 s) : 0, 9215553
Agent [candidate] (1.153 s) : 0, 1153418
Total [candidate] (9.25 s) : 0, 9249757
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.152 s 126.353 ms (12.3%)
Total tracing 8.604 s -
Total iast 9.216 s 611.737 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent iast 1.153 s 118.829 ms (11.5%)
Total tracing 8.516 s -
Total iast 9.25 s 733.592 ms (8.6%)
Loading
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.252 ms) : 0, 686252
BytebuddyAgent [candidate] (692.083 ms) : 0, 692083
GlobalTracer [baseline] (241.814 ms) : 0, 241814
GlobalTracer [candidate] (244.218 ms) : 0, 244218
AppSec [baseline] (60.75 ms) : 0, 60750
AppSec [candidate] (58.907 ms) : 0, 58907
Debugger [baseline] (6.164 ms) : 0, 6164
Debugger [candidate] (6.237 ms) : 0, 6237
Remote Config [baseline] (662.788 µs) : 0, 663
Remote Config [candidate] (736.558 µs) : 0, 737
Telemetry [baseline] (8.853 ms) : 0, 8853
Telemetry [candidate] (11.37 ms) : 0, 11370
section iast
BytebuddyAgent [baseline] (806.093 ms) : 0, 806093
BytebuddyAgent [candidate] (806.716 ms) : 0, 806716
GlobalTracer [baseline] (231.225 ms) : 0, 231225
GlobalTracer [candidate] (232.093 ms) : 0, 232093
AppSec [baseline] (52.499 ms) : 0, 52499
AppSec [candidate] (50.781 ms) : 0, 50781
Debugger [baseline] (5.96 ms) : 0, 5960
Debugger [candidate] (5.983 ms) : 0, 5983
Remote Config [baseline] (603.03 µs) : 0, 603
Remote Config [candidate] (622.287 µs) : 0, 622
Telemetry [baseline] (8.007 ms) : 0, 8007
Telemetry [candidate] (8.059 ms) : 0, 8059
IAST [baseline] (26.718 ms) : 0, 26718
IAST [candidate] (28.247 ms) : 0, 28247
Startup time reports for petclinic
Loading
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.035 s) : 0, 1034566
Total [baseline] (10.643 s) : 0, 10643098
Agent [candidate] (1.027 s) : 0, 1027395
Total [candidate] (10.613 s) : 0, 10613383
section appsec
Agent [baseline] (1.181 s) : 0, 1181220
Total [baseline] (10.695 s) : 0, 10695057
Agent [candidate] (1.189 s) : 0, 1188973
Total [candidate] (10.862 s) : 0, 10862318
section iast
Agent [baseline] (1.152 s) : 0, 1152328
Total [baseline] (10.924 s) : 0, 10924416
Agent [candidate] (1.168 s) : 0, 1168426
Total [candidate] (10.952 s) : 0, 10952481
section profiling
Agent [baseline] (1.267 s) : 0, 1267312
Total [baseline] (10.92 s) : 0, 10920181
Agent [candidate] (1.272 s) : 0, 1272098
Total [candidate] (10.918 s) : 0, 10918024
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent appsec 1.181 s 146.654 ms (14.2%)
Agent iast 1.152 s 117.761 ms (11.4%)
Agent profiling 1.267 s 232.746 ms (22.5%)
Total tracing 10.643 s -
Total appsec 10.695 s 51.959 ms (0.5%)
Total iast 10.924 s 281.318 ms (2.6%)
Total profiling 10.92 s 277.083 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent appsec 1.189 s 161.578 ms (15.7%)
Agent iast 1.168 s 141.031 ms (13.7%)
Agent profiling 1.272 s 244.702 ms (23.8%)
Total tracing 10.613 s -
Total appsec 10.862 s 248.935 ms (2.3%)
Total iast 10.952 s 339.099 ms (3.2%)
Total profiling 10.918 s 304.642 ms (2.9%)
Loading
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.608 ms) : 0, 691608
BytebuddyAgent [candidate] (687.301 ms) : 0, 687301
GlobalTracer [baseline] (244.112 ms) : 0, 244112
GlobalTracer [candidate] (242.514 ms) : 0, 242514
AppSec [baseline] (58.108 ms) : 0, 58108
AppSec [candidate] (58.539 ms) : 0, 58539
Debugger [baseline] (7.792 ms) : 0, 7792
Debugger [candidate] (6.977 ms) : 0, 6977
Remote Config [baseline] (665.196 µs) : 0, 665
Remote Config [candidate] (665.104 µs) : 0, 665
Telemetry [baseline] (11.198 ms) : 0, 11198
Telemetry [candidate] (10.411 ms) : 0, 10411
section appsec
BytebuddyAgent [baseline] (709.545 ms) : 0, 709545
BytebuddyAgent [candidate] (713.877 ms) : 0, 713877
GlobalTracer [baseline] (235.216 ms) : 0, 235216
GlobalTracer [candidate] (237.773 ms) : 0, 237773
IAST [baseline] (21.886 ms) : 0, 21886
IAST [candidate] (22.174 ms) : 0, 22174
AppSec [baseline] (180.103 ms) : 0, 180103
AppSec [candidate] (180.479 ms) : 0, 180479
Debugger [baseline] (5.812 ms) : 0, 5812
Debugger [candidate] (5.859 ms) : 0, 5859
Remote Config [baseline] (599.785 µs) : 0, 600
Remote Config [candidate] (620.545 µs) : 0, 621
Telemetry [baseline] (7.265 ms) : 0, 7265
Telemetry [candidate] (7.349 ms) : 0, 7349
section iast
BytebuddyAgent [baseline] (805.762 ms) : 0, 805762
BytebuddyAgent [candidate] (817.387 ms) : 0, 817387
GlobalTracer [baseline] (231.907 ms) : 0, 231907
GlobalTracer [candidate] (234.929 ms) : 0, 234929
IAST [baseline] (29.269 ms) : 0, 29269
IAST [candidate] (26.248 ms) : 0, 26248
AppSec [baseline] (50.02 ms) : 0, 50020
AppSec [candidate] (53.83 ms) : 0, 53830
Debugger [baseline] (5.977 ms) : 0, 5977
Debugger [candidate] (6.08 ms) : 0, 6080
Remote Config [baseline] (605.922 µs) : 0, 606
Remote Config [candidate] (625.806 µs) : 0, 626
Telemetry [baseline] (7.959 ms) : 0, 7959
Telemetry [candidate] (8.192 ms) : 0, 8192
section profiling
BytebuddyAgent [baseline] (675.768 ms) : 0, 675768
BytebuddyAgent [candidate] (678.149 ms) : 0, 678149
GlobalTracer [baseline] (360.346 ms) : 0, 360346
GlobalTracer [candidate] (361.075 ms) : 0, 361075
AppSec [baseline] (62.22 ms) : 0, 62220
AppSec [candidate] (61.97 ms) : 0, 61970
Debugger [baseline] (6.138 ms) : 0, 6138
Debugger [candidate] (6.103 ms) : 0, 6103
Remote Config [baseline] (698.429 µs) : 0, 698
Remote Config [candidate] (696.835 µs) : 0, 697
Telemetry [baseline] (8.117 ms) : 0, 8117
Telemetry [candidate] (8.097 ms) : 0, 8097
ProfilingAgent [baseline] (105.493 ms) : 0, 105493
ProfilingAgent [candidate] (107.04 ms) : 0, 107040
Profiling [baseline] (105.518 ms) : 0, 105518
Profiling [candidate] (107.065 ms) : 0, 107065

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250615
git_commit_date 1750453785 1750662297
git_commit_sha aa9dd27 13d2824
release_version 1.51.0-SNAPSHOT~aa9dd27535 1.51.0-SNAPSHOT~13d2824f08
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750663801 1750663801
ci_job_id 992802754 992802754
ci_pipeline_id 68423041 68423041
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-psdwjdjn-project-304-concurrent-0-7t2tcaf9 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-psdwjdjn-project-304-concurrent-0-7t2tcaf9 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-520.588µs; -198.749µs] or [-5.608%; -2.141%]
unstable
[-40.445op/s; +80.195op/s] or [-8.086%; +16.034%]
8.923ms 520.031op/s 9.282ms 500.156op/s
scenario:load:petclinic:no_agent:high_load better
[-1.830ms; -1.165ms] or [-4.773%; -3.041%]
unstable
[-2.242op/s; +15.379op/s] or [-1.838%; +12.612%]
36.834ms 128.506op/s 38.332ms 121.938op/s
scenario:load:petclinic:code_origins:high_load better
[-2.214ms; -1.412ms] or [-4.831%; -3.081%]
unstable
[-1.768op/s; +12.857op/s] or [-1.732%; +12.599%]
44.025ms 107.595op/s 45.839ms 102.050op/s
scenario:load:petclinic:profiling:high_load better
[-3.415ms; -2.447ms] or [-6.853%; -4.910%]
unstable
[-1.643op/s; +13.243op/s] or [-1.748%; +14.092%]
46.910ms 99.775op/s 49.841ms 93.975op/s
Request duration reports for insecure-bank
Loading
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.226 ms) : 4178, 4274
.   : milestone, 4226,
iast (9.282 ms) : 9128, 9436
.   : milestone, 9282,
iast_FULL (14.278 ms) : 14000, 14555
.   : milestone, 14278,
iast_GLOBAL (9.841 ms) : 9671, 10010
.   : milestone, 9841,
profiling (8.455 ms) : 8328, 8582
.   : milestone, 8455,
tracing (7.673 ms) : 7562, 7784
.   : milestone, 7673,
section candidate
no_agent (4.273 ms) : 4222, 4324
.   : milestone, 4273,
iast (8.923 ms) : 8778, 9067
.   : milestone, 8923,
iast_FULL (13.946 ms) : 13668, 14224
.   : milestone, 13946,
iast_GLOBAL (9.868 ms) : 9697, 10039
.   : milestone, 9868,
profiling (8.685 ms) : 8534, 8836
.   : milestone, 8685,
tracing (7.917 ms) : 7803, 8031
.   : milestone, 7917,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.226 ms [4.178 ms, 4.274 ms] -
iast 9.282 ms [9.128 ms, 9.436 ms] 5.056 ms (119.6%)
iast_FULL 14.278 ms [14.0 ms, 14.555 ms] 10.051 ms (237.8%)
iast_GLOBAL 9.841 ms [9.671 ms, 10.01 ms] 5.614 ms (132.8%)
profiling 8.455 ms [8.328 ms, 8.582 ms] 4.229 ms (100.1%)
tracing 7.673 ms [7.562 ms, 7.784 ms] 3.447 ms (81.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.273 ms [4.222 ms, 4.324 ms] -
iast 8.923 ms [8.778 ms, 9.067 ms] 4.649 ms (108.8%)
iast_FULL 13.946 ms [13.668 ms, 14.224 ms] 9.673 ms (226.4%)
iast_GLOBAL 9.868 ms [9.697 ms, 10.039 ms] 5.595 ms (130.9%)
profiling 8.685 ms [8.534 ms, 8.836 ms] 4.411 ms (103.2%)
tracing 7.917 ms [7.803 ms, 8.031 ms] 3.644 ms (85.3%)
Request duration reports for petclinic
Loading
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.332 ms) : 38014, 38650
.   : milestone, 38332,
appsec (46.534 ms) : 46125, 46943
.   : milestone, 46534,
code_origins (45.839 ms) : 45455, 46223
.   : milestone, 45839,
iast (43.819 ms) : 43429, 44209
.   : milestone, 43819,
profiling (49.841 ms) : 49372, 50310
.   : milestone, 49841,
tracing (42.305 ms) : 41949, 42662
.   : milestone, 42305,
section candidate
no_agent (36.834 ms) : 36535, 37133
.   : milestone, 36834,
appsec (46.869 ms) : 46447, 47292
.   : milestone, 46869,
code_origins (44.025 ms) : 43665, 44386
.   : milestone, 44025,
iast (44.598 ms) : 44208, 44988
.   : milestone, 44598,
profiling (46.91 ms) : 46480, 47339
.   : milestone, 46910,
tracing (41.424 ms) : 41097, 41751
.   : milestone, 41424,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.332 ms [38.014 ms, 38.65 ms] -
appsec 46.534 ms [46.125 ms, 46.943 ms] 8.202 ms (21.4%)
code_origins 45.839 ms [45.455 ms, 46.223 ms] 7.507 ms (19.6%)
iast 43.819 ms [43.429 ms, 44.209 ms] 5.487 ms (14.3%)
profiling 49.841 ms [49.372 ms, 50.31 ms] 11.509 ms (30.0%)
tracing 42.305 ms [41.949 ms, 42.662 ms] 3.974 ms (10.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.834 ms [36.535 ms, 37.133 ms] -
appsec 46.869 ms [46.447 ms, 47.292 ms] 10.035 ms (27.2%)
code_origins 44.025 ms [43.665 ms, 44.386 ms] 7.191 ms (19.5%)
iast 44.598 ms [44.208 ms, 44.988 ms] 7.764 ms (21.1%)
profiling 46.91 ms [46.48 ms, 47.339 ms] 10.075 ms (27.4%)
tracing 41.424 ms [41.097 ms, 41.751 ms] 4.59 ms (12.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250615
git_commit_date 1750453785 1750662297
git_commit_sha aa9dd27 13d2824
release_version 1.51.0-SNAPSHOT~aa9dd27535 1.51.0-SNAPSHOT~13d2824f08
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1750664277 1750664277
ci_job_id 992802755 992802755
ci_pipeline_id 68423041 68423041
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-clrnfvyp-project-304-concurrent-0-kt0c129h 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-clrnfvyp-project-304-concurrent-0-kt0c129h 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
Loading
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.954 s) : 14954000, 14954000
.   : milestone, 14954000,
appsec (14.7 s) : 14700000, 14700000
.   : milestone, 14700000,
iast (18.498 s) : 18498000, 18498000
.   : milestone, 18498000,
iast_GLOBAL (17.923 s) : 17923000, 17923000
.   : milestone, 17923000,
profiling (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
tracing (14.811 s) : 14811000, 14811000
.   : milestone, 14811000,
section candidate
no_agent (15.371 s) : 15371000, 15371000
.   : milestone, 15371000,
appsec (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
iast (19.119 s) : 19119000, 19119000
.   : milestone, 19119000,
iast_GLOBAL (17.643 s) : 17643000, 17643000
.   : milestone, 17643000,
profiling (15.296 s) : 15296000, 15296000
.   : milestone, 15296000,
tracing (14.593 s) : 14593000, 14593000
.   : milestone, 14593000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.954 s [14.954 s, 14.954 s] -
appsec 14.7 s [14.7 s, 14.7 s] -254.0 ms (-1.7%)
iast 18.498 s [18.498 s, 18.498 s] 3.544 s (23.7%)
iast_GLOBAL 17.923 s [17.923 s, 17.923 s] 2.969 s (19.9%)
profiling 14.975 s [14.975 s, 14.975 s] 21.0 ms (0.1%)
tracing 14.811 s [14.811 s, 14.811 s] -143.0 ms (-1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.371 s [15.371 s, 15.371 s] -
appsec 14.948 s [14.948 s, 14.948 s] -423.0 ms (-2.8%)
iast 19.119 s [19.119 s, 19.119 s] 3.748 s (24.4%)
iast_GLOBAL 17.643 s [17.643 s, 17.643 s] 2.272 s (14.8%)
profiling 15.296 s [15.296 s, 15.296 s] -75.0 ms (-0.5%)
tracing 14.593 s [14.593 s, 14.593 s] -778.0 ms (-5.1%)
Execution time for tomcat
Loading
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~13d2824f08, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.399 ms) : 2351, 2447
.   : milestone, 2399,
iast (2.178 ms) : 2117, 2238
.   : milestone, 2178,
iast_GLOBAL (2.243 ms) : 2182, 2304
.   : milestone, 2243,
profiling (2.025 ms) : 1977, 2074
.   : milestone, 2025,
tracing (2.007 ms) : 1960, 2054
.   : milestone, 2007,
section candidate
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (2.414 ms) : 2365, 2462
.   : milestone, 2414,
iast (2.182 ms) : 2122, 2243
.   : milestone, 2182,
iast_GLOBAL (2.233 ms) : 2172, 2294
.   : milestone, 2233,
profiling (2.036 ms) : 1987, 2085
.   : milestone, 2036,
tracing (1.998 ms) : 1951, 2045
.   : milestone, 1998,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.399 ms [2.351 ms, 2.447 ms] 920.35 µs (62.3%)
iast 2.178 ms [2.117 ms, 2.238 ms] 699.357 µs (47.3%)
iast_GLOBAL 2.243 ms [2.182 ms, 2.304 ms] 764.752 µs (51.7%)
profiling 2.025 ms [1.977 ms, 2.074 ms] 546.972 µs (37.0%)
tracing 2.007 ms [1.96 ms, 2.054 ms] 528.424 µs (35.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 2.414 ms [2.365 ms, 2.462 ms] 931.792 µs (62.9%)
iast 2.182 ms [2.122 ms, 2.243 ms] 700.588 µs (47.3%)
iast_GLOBAL 2.233 ms [2.172 ms, 2.294 ms] 751.363 µs (50.7%)
profiling 2.036 ms [1.987 ms, 2.085 ms] 554.078 µs (37.4%)
tracing 1.998 ms [1.951 ms, 2.045 ms] 516.377 µs (34.8%)

@pr-commenter
Copy link

pr-commenter bot commented Jun 15, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1750662892 1750663271
end_time 2025-06-23T07:16:12 2025-06-23T07:22:31
git_branch master ci/update-gradle-dependencies-20250615
git_commit_sha aa9dd27 13d2824
start_time 2025-06-23T07:14:53 2025-06-23T07:21:12
See matching parameters
Baseline Candidate
ci_job_id 992802759 992802759
ci_pipeline_id 68423041 68423041
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1750662297 1750662297

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 7 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop better
[-523.648µs; -432.714µs] or [-5.005%; -4.135%]
better
[-548.816µs; -436.151µs] or [-5.160%; -4.101%]
better
[-521.909µs; -391.189µs] or [-4.875%; -3.654%]
better
[-696.475µs; -347.313µs] or [-6.316%; -3.150%]
better
[+2.740op/s; +5.389op/s] or [+2.945%; +5.793%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-42.125µs; +37.011µs] or [-14.782%; +12.988%]
unstable
[-60.015µs; +47.997µs] or [-18.328%; +14.658%]
unstable
[-70.939µs; +59.643µs] or [-20.702%; +17.405%]
unstable
[-119.779µs; +147.881µs] or [-12.762%; +15.756%]
unstable
[-125.821op/s; +125.821op/s] or [-5.033%; +5.033%]
scenario:basic unsure
[-9.177µs; -0.609µs] or [-3.266%; -0.217%]
same same unstable
[-162.403µs; +19.029µs] or [-18.979%; +2.224%]
unstable
[-179.587op/s; +179.587op/s] or [-7.363%; +7.363%]
Request duration reports for reports
Loading
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (327.455 µs) : 275, 380
.   : milestone, 327,
basic (314.625 µs) : 306, 323
.   : milestone, 315,
loop (10.635 ms) : 10574, 10696
.   : milestone, 10635,
section candidate
noprobe (321.446 µs) : 272, 371
.   : milestone, 321,
basic (306.153 µs) : 297, 316
.   : milestone, 306,
loop (10.143 ms) : 10100, 10185
.   : milestone, 10143,
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 327.455 µs [274.553 µs, 380.357 µs]
basic 314.625 µs [306.289 µs, 322.961 µs]
loop 10.635 ms [10.574 ms, 10.696 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 321.446 µs [271.535 µs, 371.357 µs]
basic 306.153 µs [296.602 µs, 315.704 µs]
loop 10.143 ms [10.1 ms, 10.185 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jun 15, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250615
git_commit_date 1750453785 1750662297
git_commit_sha aa9dd27 13d2824
See matching parameters
Baseline Candidate
ci_job_date 1750663371 1750663371
ci_job_id 992802757 992802757
ci_pipeline_id 68423041 68423041
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jun 15, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250615
git_commit_date 1750453785 1750662297
git_commit_sha aa9dd27 13d2824
See matching parameters
Baseline Candidate
ci_job_date 1750663424 1750663424
ci_job_id 992802758 992802758
ci_pipeline_id 68423041 68423041
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 2 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume better
[+1865.229op/s; +6571.544op/s] or [+1.047%; +3.690%]
See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@vandonr vandonr mentioned this pull request Jun 16, 2025
1 task
Copy link
Contributor

@amarziali amarziali left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Waiting 1.50.0 before merging

@amarziali amarziali added the tag: do not merge Do not merge changes label Jun 16, 2025
@amarziali amarziali enabled auto-merge (squash) June 20, 2025 15:17
@amarziali amarziali disabled auto-merge June 20, 2025 15:49
@smola
Copy link
Member

smola commented Jun 23, 2025

@amarziali Perhaps we should put these commits into the new PR? #9021

@amarziali amarziali removed the tag: do not merge Do not merge changes label Jun 23, 2025
@amarziali amarziali enabled auto-merge (squash) June 23, 2025 07:05
@amarziali amarziali merged commit 83532cf into master Jun 23, 2025
494 checks passed
@amarziali amarziali deleted the ci/update-gradle-dependencies-20250615 branch June 23, 2025 08:09
@github-actions github-actions bot added this to the 1.51.0 milestone Jun 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants