Skip to content

Add Kafka cluster ID and offset tags to producer/consumer spans#11107

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits intomasterfrom
pwolski/kafka-span-link-tags
Apr 16, 2026
Merged

Add Kafka cluster ID and offset tags to producer/consumer spans#11107
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits intomasterfrom
pwolski/kafka-span-link-tags

Conversation

@piochelepiotr
Copy link
Copy Markdown
Contributor

@piochelepiotr piochelepiotr commented Apr 13, 2026

Summary

  • Add messaging.kafka.cluster.id tag to both producer and consumer Kafka spans, always (not gated on Data Streams)
  • Add broker-assigned partition and offset tags to producer spans via the async callback (using RecordMetadata)
  • Consumer spans already had partition and offset; no change there
  • Remove isDataStreamsEnabled() guard from extractClusterId() in KafkaConsumerInstrumentationHelper (both 0.11 and 3.8 modules)
  • Always initialize MetadataState in ProducerConstructorAdvice so cluster ID is available at produce time regardless of DSM config

These tags enable linking a trace span directly to a specific Kafka message (cluster + topic + partition + offset).

Notes

  • Producer offset is only set when a callback is used (it's a broker-assigned value returned asynchronously); fire-and-forget usage via Future will not have the offset tag
  • Both kafka-clients-0.11 and kafka-clients-3.8 modules updated in parallel

Test plan

Used a test application to verify the tags were present on the spans.

tag: no release note
tag: ai generated

🤖 Generated with Claude Code

Tag producer spans with messaging.kafka.cluster.id, topic, and
broker-assigned partition/offset (via callback). Tag consumer spans with
messaging.kafka.cluster.id, topic, consumer group, and offset. These tags
enable linking from a span directly to a specific Kafka message.

Previously the cluster ID was only extracted when Data Streams was enabled;
MetadataState is now always initialized on the producer so cluster ID flows
through regardless of DSM configuration.

tag: ai generated

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 13, 2026

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master pwolski/kafka-span-link-tags
git_commit_date 1776110723 1776283711
git_commit_sha 9f89a0b 2e8c459
See matching parameters
Baseline Candidate
ci_job_date 1776284771 1776284771
ci_job_id 1599337927 1599337927
ci_pipeline_id 107894063 107894063
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 13, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master pwolski/kafka-span-link-tags
git_commit_date 1776284201 1776283711
git_commit_sha f89a0b26cc 2e8c459
release_version 1.62.0-SNAPSHOT~9f89a0b26cc 1.62.0-SNAPSHOT~2e8c45924b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776285382 1776285382
ci_job_id 1599337917 1599337917
ci_pipeline_id 107894063 107894063
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-yijb59ao 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-yijb59ao 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061323
Total [baseline] (8.846 s) : 0, 8846366
Agent [candidate] (1.057 s) : 0, 1056540
Total [candidate] (8.889 s) : 0, 8889361
section iast
Agent [baseline] (1.23 s) : 0, 1229806
Total [baseline] (9.562 s) : 0, 9562335
Agent [candidate] (1.22 s) : 0, 1219960
Total [candidate] (9.544 s) : 0, 9544269
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.23 s 168.482 ms (15.9%)
Total tracing 8.846 s -
Total iast 9.562 s 715.97 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.22 s 163.42 ms (15.5%)
Total tracing 8.889 s -
Total iast 9.544 s 654.909 ms (7.4%)
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (635.486 ms) : 0, 635486
BytebuddyAgent [candidate] (632.381 ms) : 0, 632381
AgentMeter [baseline] (29.644 ms) : 0, 29644
AgentMeter [candidate] (29.522 ms) : 0, 29522
GlobalTracer [baseline] (249.5 ms) : 0, 249500
GlobalTracer [candidate] (250.247 ms) : 0, 250247
AppSec [baseline] (32.135 ms) : 0, 32135
AppSec [candidate] (32.213 ms) : 0, 32213
Debugger [baseline] (59.417 ms) : 0, 59417
Debugger [candidate] (59.499 ms) : 0, 59499
Remote Config [baseline] (596.816 µs) : 0, 597
Remote Config [candidate] (599.968 µs) : 0, 600
Telemetry [baseline] (8.072 ms) : 0, 8072
Telemetry [candidate] (8.087 ms) : 0, 8087
Flare Poller [baseline] (8.877 ms) : 0, 8877
Flare Poller [candidate] (6.591 ms) : 0, 6591
section iast
crashtracking [baseline] (1.254 ms) : 0, 1254
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (805.879 ms) : 0, 805879
BytebuddyAgent [candidate] (798.612 ms) : 0, 798612
AgentMeter [baseline] (11.594 ms) : 0, 11594
AgentMeter [candidate] (11.342 ms) : 0, 11342
GlobalTracer [baseline] (239.926 ms) : 0, 239926
GlobalTracer [candidate] (238.267 ms) : 0, 238267
IAST [baseline] (26.018 ms) : 0, 26018
IAST [candidate] (26.633 ms) : 0, 26633
AppSec [baseline] (32.525 ms) : 0, 32525
AppSec [candidate] (31.145 ms) : 0, 31145
Debugger [baseline] (58.801 ms) : 0, 58801
Debugger [candidate] (58.525 ms) : 0, 58525
Remote Config [baseline] (543.211 µs) : 0, 543
Remote Config [candidate] (1.145 ms) : 0, 1145
Telemetry [baseline] (13.074 ms) : 0, 13074
Telemetry [candidate] (13.345 ms) : 0, 13345
Flare Poller [baseline] (3.472 ms) : 0, 3472
Flare Poller [candidate] (3.443 ms) : 0, 3443
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053785
Total [baseline] (11.048 s) : 0, 11048395
Agent [candidate] (1.056 s) : 0, 1056047
Total [candidate] (11.008 s) : 0, 11008450
section appsec
Agent [baseline] (1.246 s) : 0, 1245795
Total [baseline] (11.081 s) : 0, 11080665
Agent [candidate] (1.264 s) : 0, 1264014
Total [candidate] (11.15 s) : 0, 11149725
section iast
Agent [baseline] (1.23 s) : 0, 1230097
Total [baseline] (11.232 s) : 0, 11231710
Agent [candidate] (1.221 s) : 0, 1220636
Total [candidate] (4.518 s) : 0, 4517665
section profiling
Agent [baseline] (1.196 s) : 0, 1195912
Total [baseline] (11.161 s) : 0, 11161186
Agent [candidate] (1.183 s) : 0, 1182578
Total [candidate] (11.049 s) : 0, 11048816
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.246 s 192.01 ms (18.2%)
Agent iast 1.23 s 176.312 ms (16.7%)
Agent profiling 1.196 s 142.127 ms (13.5%)
Total tracing 11.048 s -
Total appsec 11.081 s 32.27 ms (0.3%)
Total iast 11.232 s 183.315 ms (1.7%)
Total profiling 11.161 s 112.79 ms (1.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.264 s 207.968 ms (19.7%)
Agent iast 1.221 s 164.59 ms (15.6%)
Agent profiling 1.183 s 126.532 ms (12.0%)
Total tracing 11.008 s -
Total appsec 11.15 s 141.275 ms (1.3%)
Total iast 4.518 s -6.491 s (-59.0%)
Total profiling 11.049 s 40.366 ms (0.4%)
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.231 ms) : 0, 1231
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (632.642 ms) : 0, 632642
BytebuddyAgent [candidate] (631.398 ms) : 0, 631398
AgentMeter [baseline] (29.322 ms) : 0, 29322
AgentMeter [candidate] (29.408 ms) : 0, 29408
GlobalTracer [baseline] (248.447 ms) : 0, 248447
GlobalTracer [candidate] (249.012 ms) : 0, 249012
AppSec [baseline] (32.064 ms) : 0, 32064
AppSec [candidate] (32.386 ms) : 0, 32386
Debugger [baseline] (60.107 ms) : 0, 60107
Debugger [candidate] (60.326 ms) : 0, 60326
Remote Config [baseline] (599.044 µs) : 0, 599
Remote Config [candidate] (595.267 µs) : 0, 595
Telemetry [baseline] (8.1 ms) : 0, 8100
Telemetry [candidate] (8.101 ms) : 0, 8101
Flare Poller [baseline] (5.133 ms) : 0, 5133
Flare Poller [candidate] (7.478 ms) : 0, 7478
section appsec
crashtracking [baseline] (1.234 ms) : 0, 1234
crashtracking [candidate] (1.255 ms) : 0, 1255
BytebuddyAgent [baseline] (659.575 ms) : 0, 659575
BytebuddyAgent [candidate] (674.207 ms) : 0, 674207
AgentMeter [baseline] (11.994 ms) : 0, 11994
AgentMeter [candidate] (12.247 ms) : 0, 12247
GlobalTracer [baseline] (247.954 ms) : 0, 247954
GlobalTracer [candidate] (250.271 ms) : 0, 250271
IAST [baseline] (24.639 ms) : 0, 24639
IAST [candidate] (24.665 ms) : 0, 24665
AppSec [baseline] (185.14 ms) : 0, 185140
AppSec [candidate] (185.34 ms) : 0, 185340
Debugger [baseline] (66.131 ms) : 0, 66131
Debugger [candidate] (66.26 ms) : 0, 66260
Remote Config [baseline] (608.232 µs) : 0, 608
Remote Config [candidate] (613.49 µs) : 0, 613
Telemetry [baseline] (8.589 ms) : 0, 8589
Telemetry [candidate] (8.749 ms) : 0, 8749
Flare Poller [baseline] (3.591 ms) : 0, 3591
Flare Poller [candidate] (3.636 ms) : 0, 3636
section iast
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (805.092 ms) : 0, 805092
BytebuddyAgent [candidate] (800.29 ms) : 0, 800290
AgentMeter [baseline] (11.61 ms) : 0, 11610
AgentMeter [candidate] (11.353 ms) : 0, 11353
GlobalTracer [baseline] (240.097 ms) : 0, 240097
GlobalTracer [candidate] (238.458 ms) : 0, 238458
IAST [baseline] (25.986 ms) : 0, 25986
IAST [candidate] (25.626 ms) : 0, 25626
AppSec [baseline] (31.074 ms) : 0, 31074
AppSec [candidate] (33.654 ms) : 0, 33654
Debugger [baseline] (61.748 ms) : 0, 61748
Debugger [candidate] (54.923 ms) : 0, 54923
Remote Config [baseline] (538.721 µs) : 0, 539
Remote Config [candidate] (504.535 µs) : 0, 505
Telemetry [baseline] (12.665 ms) : 0, 12665
Telemetry [candidate] (13.607 ms) : 0, 13607
Flare Poller [baseline] (3.447 ms) : 0, 3447
Flare Poller [candidate] (3.409 ms) : 0, 3409
section profiling
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (697.067 ms) : 0, 697067
BytebuddyAgent [candidate] (690.711 ms) : 0, 690711
AgentMeter [baseline] (9.19 ms) : 0, 9190
AgentMeter [candidate] (9.108 ms) : 0, 9108
GlobalTracer [baseline] (209.208 ms) : 0, 209208
GlobalTracer [candidate] (207.063 ms) : 0, 207063
AppSec [baseline] (32.954 ms) : 0, 32954
AppSec [candidate] (32.445 ms) : 0, 32445
Debugger [baseline] (66.518 ms) : 0, 66518
Debugger [candidate] (65.241 ms) : 0, 65241
Remote Config [baseline] (584.774 µs) : 0, 585
Remote Config [candidate] (566.908 µs) : 0, 567
Telemetry [baseline] (7.907 ms) : 0, 7907
Telemetry [candidate] (7.839 ms) : 0, 7839
Flare Poller [baseline] (3.604 ms) : 0, 3604
Flare Poller [candidate] (3.629 ms) : 0, 3629
ProfilingAgent [baseline] (95.926 ms) : 0, 95926
ProfilingAgent [candidate] (93.627 ms) : 0, 93627
Profiling [baseline] (96.53 ms) : 0, 96530
Profiling [candidate] (94.183 ms) : 0, 94183
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master pwolski/kafka-span-link-tags
git_commit_date 1776284305 1776283711
git_commit_sha f89a0b26cc 2e8c459
release_version 1.62.0-SNAPSHOT~9f89a0b26cc 1.62.0-SNAPSHOT~2e8c45924b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776286076 1776286076
ci_job_id 1599337921 1599337921
ci_pipeline_id 107894063 107894063
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-rewvc5ii 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-rewvc5ii 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 20 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:no_agent:high_load better
[-1.928ms; -0.474ms] or [-10.131%; -2.492%]
same
[-2.615ms; +0.293ms] or [-8.403%; +0.941%]
unstable
[-10.111op/s; +38.736op/s] or [-4.190%; +16.050%]
17.826ms 29.962ms 255.656op/s 19.027ms 31.123ms 241.344op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.341 ms) : 19148, 19533
.   : milestone, 19341,
appsec (18.752 ms) : 18561, 18944
.   : milestone, 18752,
code_origins (17.742 ms) : 17565, 17920
.   : milestone, 17742,
iast (17.839 ms) : 17667, 18012
.   : milestone, 17839,
profiling (18.341 ms) : 18160, 18522
.   : milestone, 18341,
tracing (17.951 ms) : 17772, 18130
.   : milestone, 17951,
section candidate
no_agent (18.255 ms) : 18067, 18442
.   : milestone, 18255,
appsec (18.742 ms) : 18550, 18934
.   : milestone, 18742,
code_origins (18.014 ms) : 17832, 18197
.   : milestone, 18014,
iast (17.938 ms) : 17758, 18118
.   : milestone, 17938,
profiling (18.429 ms) : 18248, 18611
.   : milestone, 18429,
tracing (17.747 ms) : 17572, 17921
.   : milestone, 17747,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.341 ms [19.148 ms, 19.533 ms] -
appsec 18.752 ms [18.561 ms, 18.944 ms] -588.108 µs (-3.0%)
code_origins 17.742 ms [17.565 ms, 17.92 ms] -1.598 ms (-8.3%)
iast 17.839 ms [17.667 ms, 18.012 ms] -1.501 ms (-7.8%)
profiling 18.341 ms [18.16 ms, 18.522 ms] -999.484 µs (-5.2%)
tracing 17.951 ms [17.772 ms, 18.13 ms] -1.389 ms (-7.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.255 ms [18.067 ms, 18.442 ms] -
appsec 18.742 ms [18.55 ms, 18.934 ms] 487.484 µs (2.7%)
code_origins 18.014 ms [17.832 ms, 18.197 ms] -240.524 µs (-1.3%)
iast 17.938 ms [17.758 ms, 18.118 ms] -316.861 µs (-1.7%)
profiling 18.429 ms [18.248 ms, 18.611 ms] 174.532 µs (1.0%)
tracing 17.747 ms [17.572 ms, 17.921 ms] -507.935 µs (-2.8%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.245 ms) : 1233, 1257
.   : milestone, 1245,
iast (3.314 ms) : 3271, 3358
.   : milestone, 3314,
iast_FULL (6.067 ms) : 6005, 6129
.   : milestone, 6067,
iast_GLOBAL (3.599 ms) : 3547, 3652
.   : milestone, 3599,
profiling (2.407 ms) : 2383, 2431
.   : milestone, 2407,
tracing (1.911 ms) : 1895, 1927
.   : milestone, 1911,
section candidate
no_agent (1.247 ms) : 1235, 1259
.   : milestone, 1247,
iast (3.365 ms) : 3314, 3416
.   : milestone, 3365,
iast_FULL (5.994 ms) : 5934, 6055
.   : milestone, 5994,
iast_GLOBAL (3.721 ms) : 3656, 3786
.   : milestone, 3721,
profiling (2.301 ms) : 2276, 2325
.   : milestone, 2301,
tracing (1.905 ms) : 1888, 1922
.   : milestone, 1905,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.245 ms [1.233 ms, 1.257 ms] -
iast 3.314 ms [3.271 ms, 3.358 ms] 2.069 ms (166.2%)
iast_FULL 6.067 ms [6.005 ms, 6.129 ms] 4.822 ms (387.3%)
iast_GLOBAL 3.599 ms [3.547 ms, 3.652 ms] 2.354 ms (189.1%)
profiling 2.407 ms [2.383 ms, 2.431 ms] 1.162 ms (93.3%)
tracing 1.911 ms [1.895 ms, 1.927 ms] 666.06 µs (53.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.247 ms [1.235 ms, 1.259 ms] -
iast 3.365 ms [3.314 ms, 3.416 ms] 2.119 ms (170.0%)
iast_FULL 5.994 ms [5.934 ms, 6.055 ms] 4.748 ms (380.9%)
iast_GLOBAL 3.721 ms [3.656 ms, 3.786 ms] 2.474 ms (198.5%)
profiling 2.301 ms [2.276 ms, 2.325 ms] 1.054 ms (84.6%)
tracing 1.905 ms [1.888 ms, 1.922 ms] 658.358 µs (52.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master pwolski/kafka-span-link-tags
git_commit_date 1776284201 1776283711
git_commit_sha f89a0b26cc 2e8c459
release_version 1.62.0-SNAPSHOT~9f89a0b26cc 1.62.0-SNAPSHOT~2e8c45924b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776285708 1776285708
ci_job_id 1599337923 1599337923
ci_pipeline_id 107894063 107894063
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gijr7ivk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gijr7ivk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.488ms; -1.140ms] or [-38.753%; -29.668%]
2.527ms 3.841ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (3.841 ms) : 3618, 4063
.   : milestone, 3841,
iast (2.287 ms) : 2216, 2358
.   : milestone, 2287,
iast_GLOBAL (2.323 ms) : 2253, 2394
.   : milestone, 2323,
profiling (2.516 ms) : 2357, 2675
.   : milestone, 2516,
tracing (2.079 ms) : 2025, 2133
.   : milestone, 2079,
section candidate
no_agent (1.488 ms) : 1476, 1500
.   : milestone, 1488,
appsec (2.527 ms) : 2472, 2582
.   : milestone, 2527,
iast (2.274 ms) : 2204, 2345
.   : milestone, 2274,
iast_GLOBAL (2.316 ms) : 2246, 2386
.   : milestone, 2316,
profiling (2.106 ms) : 2051, 2162
.   : milestone, 2106,
tracing (2.082 ms) : 2028, 2136
.   : milestone, 2082,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.496 ms] -
appsec 3.841 ms [3.618 ms, 4.063 ms] 2.356 ms (158.7%)
iast 2.287 ms [2.216 ms, 2.358 ms] 802.413 µs (54.1%)
iast_GLOBAL 2.323 ms [2.253 ms, 2.394 ms] 838.742 µs (56.5%)
profiling 2.516 ms [2.357 ms, 2.675 ms] 1.032 ms (69.5%)
tracing 2.079 ms [2.025 ms, 2.133 ms] 594.414 µs (40.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.488 ms [1.476 ms, 1.5 ms] -
appsec 2.527 ms [2.472 ms, 2.582 ms] 1.039 ms (69.8%)
iast 2.274 ms [2.204 ms, 2.345 ms] 786.574 µs (52.9%)
iast_GLOBAL 2.316 ms [2.246 ms, 2.386 ms] 828.194 µs (55.7%)
profiling 2.106 ms [2.051 ms, 2.162 ms] 618.496 µs (41.6%)
tracing 2.082 ms [2.028 ms, 2.136 ms] 594.057 µs (39.9%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~2e8c45924b, baseline=1.62.0-SNAPSHOT~9f89a0b26cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
appsec (14.609 s) : 14609000, 14609000
.   : milestone, 14609000,
iast (18.334 s) : 18334000, 18334000
.   : milestone, 18334000,
iast_GLOBAL (18.11 s) : 18110000, 18110000
.   : milestone, 18110000,
profiling (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
tracing (14.868 s) : 14868000, 14868000
.   : milestone, 14868000,
section candidate
no_agent (15.45 s) : 15450000, 15450000
.   : milestone, 15450000,
appsec (14.866 s) : 14866000, 14866000
.   : milestone, 14866000,
iast (18.435 s) : 18435000, 18435000
.   : milestone, 18435000,
iast_GLOBAL (18.146 s) : 18146000, 18146000
.   : milestone, 18146000,
profiling (15.146 s) : 15146000, 15146000
.   : milestone, 15146000,
tracing (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.872 s [14.872 s, 14.872 s] -
appsec 14.609 s [14.609 s, 14.609 s] -263.0 ms (-1.8%)
iast 18.334 s [18.334 s, 18.334 s] 3.462 s (23.3%)
iast_GLOBAL 18.11 s [18.11 s, 18.11 s] 3.238 s (21.8%)
profiling 14.979 s [14.979 s, 14.979 s] 107.0 ms (0.7%)
tracing 14.868 s [14.868 s, 14.868 s] -4.0 ms (-0.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.45 s [15.45 s, 15.45 s] -
appsec 14.866 s [14.866 s, 14.866 s] -584.0 ms (-3.8%)
iast 18.435 s [18.435 s, 18.435 s] 2.985 s (19.3%)
iast_GLOBAL 18.146 s [18.146 s, 18.146 s] 2.696 s (17.4%)
profiling 15.146 s [15.146 s, 15.146 s] -304.0 ms (-2.0%)
tracing 15.049 s [15.049 s, 15.049 s] -401.0 ms (-2.6%)

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 13, 2026

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master pwolski/kafka-span-link-tags
git_commit_date 1776110723 1776115731
git_commit_sha 9f89a0b f2a32a7
See matching parameters
Baseline Candidate
ci_job_date 1776116784 1776116784
ci_job_id 1591723033 1591723033
ci_pipeline_id 107484593 107484593
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

Add assertions for messaging.kafka.cluster.id, partition, and offset
tags that are now set on producer and consumer spans.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@piochelepiotr piochelepiotr marked this pull request as ready for review April 15, 2026 21:35
@piochelepiotr piochelepiotr requested review from a team as code owners April 15, 2026 21:35
@piochelepiotr piochelepiotr requested review from mtoffl01 and removed request for a team April 15, 2026 21:35
@github-actions github-actions bot added the tag: ai generated Largely based on code generated by an AI or LLM label Apr 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 15, 2026

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@piochelepiotr piochelepiotr added inst: kafka Kafka instrumentation type: enhancement Enhancements and improvements labels Apr 15, 2026
@piochelepiotr piochelepiotr added this pull request to the merge queue Apr 16, 2026
@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts bot commented Apr 16, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link
Copy Markdown

gh-worker-devflow-routing-ef8351 bot commented Apr 16, 2026

View all feedbacks in Devflow UI.

2026-04-16 15:17:47 UTC ℹ️ Start processing command /merge


2026-04-16 15:17:52 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).


2026-04-16 16:23:35 UTC ℹ️ MergeQueue: This merge request was merged

@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Apr 16, 2026
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit d36f7e7 into master Apr 16, 2026
579 of 584 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the pwolski/kafka-span-link-tags branch April 16, 2026 16:23
@github-actions github-actions bot added this to the 1.62.0 milestone Apr 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

inst: kafka Kafka instrumentation tag: ai generated Largely based on code generated by an AI or LLM type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants