Skip to content

Conversation

@piochelepiotr
Copy link
Contributor

What Does This Do

Backport: #10100

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@piochelepiotr piochelepiotr requested a review from a team as a code owner December 8, 2025 19:39
@github-actions
Copy link
Contributor

github-actions bot commented Dec 8, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@piochelepiotr piochelepiotr added the comp: data streams Data Streams Monitoring label Dec 8, 2025
@piochelepiotr piochelepiotr added the inst: kafka Kafka instrumentation label Dec 8, 2025
@piochelepiotr piochelepiotr enabled auto-merge (squash) December 8, 2025 19:41
@piochelepiotr piochelepiotr added the type: bug Bug report and fix label Dec 8, 2025
@piochelepiotr piochelepiotr added this to the 1.56.2 milestone Dec 8, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 73.41% (+13.78%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: b35f5ef | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Dec 8, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.56.x piotr.wolski/patch-release-1.56
git_commit_date 1764076160 1765222715
git_commit_sha b8849a9 b35f5ef
See matching parameters
Baseline Candidate
ci_job_date 1765223838 1765223838
ci_job_id 1277115337 1277115337
ci_pipeline_id 85388294 85388294
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Dec 8, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.56.x piotr.wolski/patch-release-1.56
git_commit_date 1764076160 1765222715
git_commit_sha b8849a9 b35f5ef
See matching parameters
Baseline Candidate
ci_job_date 1765223888 1765223888
ci_job_id 1277115338 1277115338
ci_pipeline_id 85388294 85388294
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@pr-commenter
Copy link

pr-commenter bot commented Dec 8, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr.wolski/patch-release-1.56
git_commit_date 1763637994 1765222715
git_commit_sha c05874d b35f5ef
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~b35f5efcf4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765224651 1765224651
ci_job_id 1277115332 1277115332
ci_pipeline_id 85388294 85388294
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3g61y0ox 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3g61y0ox 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 12 performance improvements and 10 performance regressions! Performance is the same for 33 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start better
[-51.976ms; -42.627ms] or [-4.196%; -3.441%]
1.191s 1.239s
scenario:startup:insecure-bank:iast:Debugger better
[-54.556ms; -53.343ms] or [-90.881%; -88.862%]
6.080ms 60.029ms
scenario:startup:insecure-bank:iast:Remote Config worse
[+59.325µs; +92.721µs] or [+11.071%; +17.303%]
611.891µs 535.868µs
scenario:startup:insecure-bank:iast:Telemetry worse
[+160.633µs; +514.613µs] or [+2.111%; +6.761%]
7.949ms 7.611ms
scenario:startup:insecure-bank:iast:Flare Poller worse
[+7.151ms; +7.428ms] or [+206.948%; +214.948%]
10.745ms 3.456ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-53.131ms; -26.416ms] or [-4.832%; -2.403%]
1.060s 1.099s
scenario:startup:insecure-bank:tracing:Debugger better
[-56.965ms; -56.293ms] or [-90.386%; -89.319%]
6.395ms 63.024ms
scenario:startup:insecure-bank:tracing:Remote Config worse
[+13.749µs; +64.488µs] or [+2.134%; +10.008%]
683.473µs 644.355µs
scenario:startup:petclinic:appsec:Agent.start better
[-69.499ms; -46.000ms] or [-5.394%; -3.570%]
1.231s 1.288s
scenario:startup:petclinic:appsec:Debugger better
[-56.227ms; -54.183ms] or [-91.320%; -88.001%]
6.366ms 61.571ms
scenario:startup:petclinic:iast:Agent.start better
[-57.089ms; -48.881ms] or [-4.597%; -3.936%]
1.189s 1.242s
scenario:startup:petclinic:iast:Debugger better
[-55.372ms; -54.328ms] or [-90.923%; -89.209%]
6.050ms 60.900ms
scenario:startup:petclinic:iast:Remote Config worse
[+44.279µs; +87.416µs] or [+8.132%; +16.055%]
610.326µs 544.478µs
scenario:startup:petclinic:iast:Telemetry worse
[+231.892µs; +512.208µs] or [+3.054%; +6.746%]
7.965ms 7.592ms
scenario:startup:petclinic:profiling:Agent.start better
[-40.012ms; -32.743ms] or [-3.240%; -2.652%]
1.198s 1.235s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+11.010ms; +13.674ms] or [+11.249%; +13.972%]
110.210ms 97.869ms
scenario:startup:petclinic:profiling:Debugger better
[-58.124ms; -56.072ms] or [-90.958%; -87.747%]
6.804ms 63.902ms
scenario:startup:petclinic:profiling:Telemetry worse
[+8.432ms; +8.859ms] or [+105.838%; +111.191%]
16.613ms 7.967ms
scenario:startup:petclinic:profiling:Flare Poller worse
[+272.250µs; +456.570µs] or [+7.214%; +12.098%]
4.138ms 3.774ms
scenario:startup:petclinic:profiling:Profiling worse
[+11.036ms; +13.725ms] or [+11.208%; +13.938%]
110.852ms 98.472ms
scenario:startup:petclinic:tracing:Agent.start better
[-84.186ms; -47.361ms] or [-7.523%; -4.232%]
1.053s 1.119s
scenario:startup:petclinic:tracing:Debugger better
[-60.067ms; -58.237ms] or [-91.661%; -88.868%]
6.380ms 65.531ms
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.099 s) : 0, 1099490
Total [baseline] (8.837 s) : 0, 8837159
Agent [candidate] (1.06 s) : 0, 1059716
Total [candidate] (8.711 s) : 0, 8711480
section iast
Agent [baseline] (1.239 s) : 0, 1238787
Total [baseline] (9.579 s) : 0, 9579014
Agent [candidate] (1.191 s) : 0, 1191486
Total [candidate] (9.354 s) : 0, 9354437
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent iast 1.239 s 139.297 ms (12.7%)
Total tracing 8.837 s -
Total iast 9.579 s 741.854 ms (8.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.191 s 131.769 ms (12.4%)
Total tracing 8.711 s -
Total iast 9.354 s 642.957 ms (7.4%)
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (707.088 ms) : 0, 707088
BytebuddyAgent [candidate] (713.665 ms) : 0, 713665
GlobalTracer [baseline] (248.654 ms) : 0, 248654
GlobalTracer [candidate] (250.301 ms) : 0, 250301
AppSec [baseline] (32.021 ms) : 0, 32021
AppSec [candidate] (31.981 ms) : 0, 31981
Debugger [baseline] (63.024 ms) : 0, 63024
Debugger [candidate] (6.395 ms) : 0, 6395
Remote Config [baseline] (644.355 µs) : 0, 644
Remote Config [candidate] (683.473 µs) : 0, 683
Telemetry [baseline] (8.138 ms) : 0, 8138
Telemetry [candidate] (14.661 ms) : 0, 14661
Flare Poller [baseline] (3.623 ms) : 0, 3623
Flare Poller [candidate] (5.519 ms) : 0, 5519
section iast
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (831.428 ms) : 0, 831428
BytebuddyAgent [candidate] (831.113 ms) : 0, 831113
GlobalTracer [baseline] (237.783 ms) : 0, 237783
GlobalTracer [candidate] (237.356 ms) : 0, 237356
IAST [baseline] (27.481 ms) : 0, 27481
IAST [candidate] (31.459 ms) : 0, 31459
AppSec [baseline] (33.961 ms) : 0, 33961
AppSec [candidate] (29.784 ms) : 0, 29784
Debugger [baseline] (60.029 ms) : 0, 60029
Debugger [candidate] (6.08 ms) : 0, 6080
Remote Config [baseline] (535.868 µs) : 0, 536
Remote Config [candidate] (611.891 µs) : 0, 612
Telemetry [baseline] (7.611 ms) : 0, 7611
Telemetry [candidate] (7.949 ms) : 0, 7949
Flare Poller [baseline] (3.456 ms) : 0, 3456
Flare Poller [candidate] (10.745 ms) : 0, 10745
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.119 s) : 0, 1119053
Total [baseline] (10.811 s) : 0, 10810687
Agent [candidate] (1.053 s) : 0, 1053280
Total [candidate] (10.853 s) : 0, 10852817
section appsec
Agent [baseline] (1.288 s) : 0, 1288416
Total [baseline] (11.136 s) : 0, 11135985
Agent [candidate] (1.231 s) : 0, 1230667
Total [candidate] (10.884 s) : 0, 10883534
section iast
Agent [baseline] (1.242 s) : 0, 1241969
Total [baseline] (11.284 s) : 0, 11284265
Agent [candidate] (1.189 s) : 0, 1188984
Total [candidate] (11.196 s) : 0, 11196485
section profiling
Agent [baseline] (1.235 s) : 0, 1234808
Total [baseline] (11.174 s) : 0, 11174143
Agent [candidate] (1.198 s) : 0, 1198430
Total [candidate] (10.876 s) : 0, 10876353
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.119 s -
Agent appsec 1.288 s 169.363 ms (15.1%)
Agent iast 1.242 s 122.916 ms (11.0%)
Agent profiling 1.235 s 115.755 ms (10.3%)
Total tracing 10.811 s -
Total appsec 11.136 s 325.298 ms (3.0%)
Total iast 11.284 s 473.577 ms (4.4%)
Total profiling 11.174 s 363.456 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.231 s 177.387 ms (16.8%)
Agent iast 1.189 s 135.705 ms (12.9%)
Agent profiling 1.198 s 145.151 ms (13.8%)
Total tracing 10.853 s -
Total appsec 10.884 s 30.717 ms (0.3%)
Total iast 11.196 s 343.669 ms (3.2%)
Total profiling 10.876 s 23.536 ms (0.2%)
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (718.723 ms) : 0, 718723
BytebuddyAgent [candidate] (707.717 ms) : 0, 707717
GlobalTracer [baseline] (252.618 ms) : 0, 252618
GlobalTracer [candidate] (250.113 ms) : 0, 250113
AppSec [baseline] (32.734 ms) : 0, 32734
AppSec [candidate] (31.882 ms) : 0, 31882
Debugger [baseline] (65.531 ms) : 0, 65531
Debugger [candidate] (6.38 ms) : 0, 6380
Remote Config [baseline] (642.987 µs) : 0, 643
Remote Config [candidate] (666.316 µs) : 0, 666
Telemetry [baseline] (8.365 ms) : 0, 8365
Telemetry [candidate] (14.62 ms) : 0, 14620
Flare Poller [baseline] (3.695 ms) : 0, 3695
Flare Poller [candidate] (5.569 ms) : 0, 5569
section appsec
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (734.855 ms) : 0, 734855
BytebuddyAgent [candidate] (732.835 ms) : 0, 732835
GlobalTracer [baseline] (243.01 ms) : 0, 243010
GlobalTracer [candidate] (241.456 ms) : 0, 241456
IAST [baseline] (25.061 ms) : 0, 25061
IAST [candidate] (24.82 ms) : 0, 24820
AppSec [baseline] (174.579 ms) : 0, 174579
AppSec [candidate] (175.563 ms) : 0, 175563
Debugger [baseline] (61.571 ms) : 0, 61571
Debugger [candidate] (6.366 ms) : 0, 6366
Remote Config [baseline] (682.752 µs) : 0, 683
Remote Config [candidate] (680.254 µs) : 0, 680
Telemetry [baseline] (8.201 ms) : 0, 8201
Telemetry [candidate] (8.206 ms) : 0, 8206
Flare Poller [baseline] (3.905 ms) : 0, 3905
Flare Poller [candidate] (4.087 ms) : 0, 4087
section iast
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (832.823 ms) : 0, 832823
BytebuddyAgent [candidate] (829.165 ms) : 0, 829165
GlobalTracer [baseline] (238.321 ms) : 0, 238321
GlobalTracer [candidate] (236.865 ms) : 0, 236865
IAST [baseline] (27.707 ms) : 0, 27707
IAST [candidate] (28.868 ms) : 0, 28868
AppSec [baseline] (34.012 ms) : 0, 34012
AppSec [candidate] (32.179 ms) : 0, 32179
Debugger [baseline] (60.9 ms) : 0, 60900
Debugger [candidate] (6.05 ms) : 0, 6050
Remote Config [baseline] (544.478 µs) : 0, 544
Remote Config [candidate] (610.326 µs) : 0, 610
Telemetry [baseline] (7.592 ms) : 0, 7592
Telemetry [candidate] (7.965 ms) : 0, 7965
Flare Poller [baseline] (3.549 ms) : 0, 3549
Flare Poller [candidate] (10.89 ms) : 0, 10890
section profiling
crashtracking [baseline] (1.442 ms) : 0, 1442
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (734.52 ms) : 0, 734520
BytebuddyAgent [candidate] (734.086 ms) : 0, 734086
GlobalTracer [baseline] (222.887 ms) : 0, 222887
GlobalTracer [candidate] (222.681 ms) : 0, 222681
AppSec [baseline] (32.005 ms) : 0, 32005
AppSec [candidate] (32.017 ms) : 0, 32017
Debugger [baseline] (63.902 ms) : 0, 63902
Debugger [candidate] (6.804 ms) : 0, 6804
Remote Config [baseline] (654.599 µs) : 0, 655
Remote Config [candidate] (673.339 µs) : 0, 673
Telemetry [baseline] (7.967 ms) : 0, 7967
Telemetry [candidate] (16.613 ms) : 0, 16613
Flare Poller [baseline] (3.774 ms) : 0, 3774
Flare Poller [candidate] (4.138 ms) : 0, 4138
ProfilingAgent [baseline] (97.869 ms) : 0, 97869
ProfilingAgent [candidate] (110.21 ms) : 0, 110210
Profiling [baseline] (98.472 ms) : 0, 98472
Profiling [candidate] (110.852 ms) : 0, 110852
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr.wolski/patch-release-1.56
git_commit_date 1763637994 1765222715
git_commit_sha c05874d b35f5ef
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~b35f5efcf4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765225139 1765225139
ci_job_id 1277115333 1277115333
ci_pipeline_id 85388294 85388294
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ae3splic 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ae3splic 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:tracing:high_load worse
[+1.873ms; +2.296ms] or [+10.972%; +13.451%]
worse
[+2.126ms; +3.184ms] or [+7.559%; +11.323%]
unstable
[-52.866op/s; -2.322op/s] or [-19.749%; -0.867%]
19.154ms 30.774ms 240.094op/s 17.070ms 28.119ms 267.688op/s
scenario:load:petclinic:iast:high_load worse
[+1.107ms; +2.122ms] or [+6.453%; +12.371%]
worse
[+1.021ms; +2.515ms] or [+3.603%; +8.874%]
unstable
[-47.669op/s; +4.481op/s] or [-17.887%; +1.681%]
18.766ms 30.105ms 244.906op/s 17.152ms 28.337ms 266.500op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.045 ms) : 18855, 19236
.   : milestone, 19045,
appsec (18.771 ms) : 18577, 18964
.   : milestone, 18771,
code_origins (17.942 ms) : 17758, 18127
.   : milestone, 17942,
iast (17.504 ms) : 17330, 17678
.   : milestone, 17504,
profiling (18.938 ms) : 18747, 19130
.   : milestone, 18938,
tracing (17.428 ms) : 17258, 17599
.   : milestone, 17428,
section candidate
no_agent (18.001 ms) : 17816, 18185
.   : milestone, 18001,
appsec (18.472 ms) : 18288, 18656
.   : milestone, 18472,
code_origins (17.88 ms) : 17704, 18055
.   : milestone, 17880,
iast (19.055 ms) : 18863, 19248
.   : milestone, 19055,
profiling (19.36 ms) : 19165, 19555
.   : milestone, 19360,
tracing (19.443 ms) : 19248, 19639
.   : milestone, 19443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.045 ms [18.855 ms, 19.236 ms] -
appsec 18.771 ms [18.577 ms, 18.964 ms] -274.753 µs (-1.4%)
code_origins 17.942 ms [17.758 ms, 18.127 ms] -1.103 ms (-5.8%)
iast 17.504 ms [17.33 ms, 17.678 ms] -1.541 ms (-8.1%)
profiling 18.938 ms [18.747 ms, 19.13 ms] -107.257 µs (-0.6%)
tracing 17.428 ms [17.258 ms, 17.599 ms] -1.617 ms (-8.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.001 ms [17.816 ms, 18.185 ms] -
appsec 18.472 ms [18.288 ms, 18.656 ms] 471.467 µs (2.6%)
code_origins 17.88 ms [17.704 ms, 18.055 ms] -121.017 µs (-0.7%)
iast 19.055 ms [18.863 ms, 19.248 ms] 1.055 ms (5.9%)
profiling 19.36 ms [19.165 ms, 19.555 ms] 1.36 ms (7.6%)
tracing 19.443 ms [19.248 ms, 19.639 ms] 1.443 ms (8.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.219 ms) : 1207, 1230
.   : milestone, 1219,
iast (3.197 ms) : 3150, 3243
.   : milestone, 3197,
iast_FULL (5.948 ms) : 5888, 6008
.   : milestone, 5948,
iast_GLOBAL (3.701 ms) : 3637, 3764
.   : milestone, 3701,
profiling (2.12 ms) : 2100, 2140
.   : milestone, 2120,
tracing (1.832 ms) : 1816, 1848
.   : milestone, 1832,
section candidate
no_agent (1.205 ms) : 1192, 1218
.   : milestone, 1205,
iast (3.235 ms) : 3191, 3280
.   : milestone, 3235,
iast_FULL (6.04 ms) : 5978, 6101
.   : milestone, 6040,
iast_GLOBAL (3.546 ms) : 3495, 3598
.   : milestone, 3546,
profiling (2.143 ms) : 2124, 2162
.   : milestone, 2143,
tracing (1.834 ms) : 1819, 1849
.   : milestone, 1834,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.219 ms [1.207 ms, 1.23 ms] -
iast 3.197 ms [3.15 ms, 3.243 ms] 1.978 ms (162.3%)
iast_FULL 5.948 ms [5.888 ms, 6.008 ms] 4.729 ms (388.0%)
iast_GLOBAL 3.701 ms [3.637 ms, 3.764 ms] 2.482 ms (203.7%)
profiling 2.12 ms [2.1 ms, 2.14 ms] 901.147 µs (73.9%)
tracing 1.832 ms [1.816 ms, 1.848 ms] 612.79 µs (50.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.205 ms [1.192 ms, 1.218 ms] -
iast 3.235 ms [3.191 ms, 3.28 ms] 2.03 ms (168.5%)
iast_FULL 6.04 ms [5.978 ms, 6.101 ms] 4.835 ms (401.3%)
iast_GLOBAL 3.546 ms [3.495 ms, 3.598 ms] 2.342 ms (194.4%)
profiling 2.143 ms [2.124 ms, 2.162 ms] 938.597 µs (77.9%)
tracing 1.834 ms [1.819 ms, 1.849 ms] 629.553 µs (52.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr.wolski/patch-release-1.56
git_commit_date 1763637994 1765222715
git_commit_sha c05874d b35f5ef
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~b35f5efcf4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765224841 1765224841
ci_job_id 1277115334 1277115334
ci_pipeline_id 85388294 85388294
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-xle0ly3p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-xle0ly3p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.527 s) : 15527000, 15527000
.   : milestone, 15527000,
appsec (14.765 s) : 14765000, 14765000
.   : milestone, 14765000,
iast (18.589 s) : 18589000, 18589000
.   : milestone, 18589000,
iast_GLOBAL (17.93 s) : 17930000, 17930000
.   : milestone, 17930000,
profiling (14.537 s) : 14537000, 14537000
.   : milestone, 14537000,
tracing (14.996 s) : 14996000, 14996000
.   : milestone, 14996000,
section candidate
no_agent (15.111 s) : 15111000, 15111000
.   : milestone, 15111000,
appsec (14.692 s) : 14692000, 14692000
.   : milestone, 14692000,
iast (18.488 s) : 18488000, 18488000
.   : milestone, 18488000,
iast_GLOBAL (18.215 s) : 18215000, 18215000
.   : milestone, 18215000,
profiling (15.093 s) : 15093000, 15093000
.   : milestone, 15093000,
tracing (14.86 s) : 14860000, 14860000
.   : milestone, 14860000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.527 s [15.527 s, 15.527 s] -
appsec 14.765 s [14.765 s, 14.765 s] -762.0 ms (-4.9%)
iast 18.589 s [18.589 s, 18.589 s] 3.062 s (19.7%)
iast_GLOBAL 17.93 s [17.93 s, 17.93 s] 2.403 s (15.5%)
profiling 14.537 s [14.537 s, 14.537 s] -990.0 ms (-6.4%)
tracing 14.996 s [14.996 s, 14.996 s] -531.0 ms (-3.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.111 s [15.111 s, 15.111 s] -
appsec 14.692 s [14.692 s, 14.692 s] -419.0 ms (-2.8%)
iast 18.488 s [18.488 s, 18.488 s] 3.377 s (22.3%)
iast_GLOBAL 18.215 s [18.215 s, 18.215 s] 3.104 s (20.5%)
profiling 15.093 s [15.093 s, 15.093 s] -18.0 ms (-0.1%)
tracing 14.86 s [14.86 s, 14.86 s] -251.0 ms (-1.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~b35f5efcf4, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.656 ms) : 3439, 3873
.   : milestone, 3656,
iast (2.216 ms) : 2151, 2280
.   : milestone, 2216,
iast_GLOBAL (2.258 ms) : 2193, 2323
.   : milestone, 2258,
profiling (2.081 ms) : 2027, 2136
.   : milestone, 2081,
tracing (2.048 ms) : 1997, 2099
.   : milestone, 2048,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.699 ms) : 3482, 3916
.   : milestone, 3699,
iast (2.212 ms) : 2147, 2276
.   : milestone, 2212,
iast_GLOBAL (2.258 ms) : 2193, 2322
.   : milestone, 2258,
profiling (2.079 ms) : 2026, 2133
.   : milestone, 2079,
tracing (2.041 ms) : 1990, 2091
.   : milestone, 2041,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 3.656 ms [3.439 ms, 3.873 ms] 2.175 ms (147.0%)
iast 2.216 ms [2.151 ms, 2.28 ms] 735.3 µs (49.7%)
iast_GLOBAL 2.258 ms [2.193 ms, 2.323 ms] 777.476 µs (52.5%)
profiling 2.081 ms [2.027 ms, 2.136 ms] 601.151 µs (40.6%)
tracing 2.048 ms [1.997 ms, 2.099 ms] 567.408 µs (38.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.699 ms [3.482 ms, 3.916 ms] 2.225 ms (150.9%)
iast 2.212 ms [2.147 ms, 2.276 ms] 737.422 µs (50.0%)
iast_GLOBAL 2.258 ms [2.193 ms, 2.322 ms] 783.447 µs (53.1%)
profiling 2.079 ms [2.026 ms, 2.133 ms] 605.31 µs (41.1%)
tracing 2.041 ms [1.99 ms, 2.091 ms] 566.571 µs (38.4%)

@mhlidd mhlidd disabled auto-merge December 8, 2025 20:45
@mhlidd
Copy link
Contributor

mhlidd commented Dec 8, 2025

Bypassing a flaky test for to unblock a patch release to resolve an incident.

@mhlidd mhlidd merged commit cf52dcd into release/v1.56.x Dec 8, 2025
544 of 549 checks passed
@mhlidd mhlidd deleted the piotr.wolski/patch-release-1.56 branch December 8, 2025 21:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: data streams Data Streams Monitoring inst: kafka Kafka instrumentation type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants