Pin system tests to dd-trace-java-1.60.2-release branch by sarahchen6 · Pull Request #10898 · DataDog/dd-trace-java

sarahchen6 · 2026-03-18T18:33:06Z

What Does This Do

Pin system-tests to the dd-trace-java-1.60.2-release branch that updates actions/download-artifact@v4 (non-SHA pin, violates internal DataDog enterprise GitHub Actions policy) to actions/download-artifact@d3f86a106a0bac45b974a628896c90dbdf5c8093 (SHA pin, compliant with the policy)

To get Gitlab system-tests to pass, we also need to update some telemetry configs.

Motivation

Additional Notes

Despite pinning system tests in our Github action workflow to a branch (which is why github tests are passing), gitlab tests are still pinned to the main system-tests branch here: https://github.com/DataDog/libdatadog-build/blob/main/templates/one-pipeline.yml#L514, causing gitlab system tests to fail.

dd-trace-java-1.60.2-release branch updates are made in DataDog/system-tests#6535.

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-03-18T19:14:41Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/pin-system-tests-branch
git_commit_date	1772492986	1773869388
git_commit_sha	`0f5d84f`	`f4bb24d`
release_version	1.60.0~0f5d84f2c4	1.61.0-SNAPSHOT~f4bb24d0aa

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773871272	1773871272
ci_job_id	1519740133	1519740133
ci_pipeline_id	103393510	103393510
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-qwmxjfky 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-qwmxjfky 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071295
Total [baseline] (10.857 s) : 0, 10856679
Agent [candidate] (1.073 s) : 0, 1073158
Total [candidate] (10.876 s) : 0, 10876284
section appsec
Agent [baseline] (1.24 s) : 0, 1240217
Total [baseline] (10.971 s) : 0, 10971043
Agent [candidate] (1.237 s) : 0, 1236775
Total [candidate] (10.955 s) : 0, 10955155
section iast
Agent [baseline] (1.231 s) : 0, 1230676
Total [baseline] (11.168 s) : 0, 11167755
Agent [candidate] (1.231 s) : 0, 1230847
Total [candidate] (11.161 s) : 0, 11160506
section profiling
Agent [baseline] (1.2 s) : 0, 1199582
Total [baseline] (11.045 s) : 0, 11044559
Agent [candidate] (1.19 s) : 0, 1190180
Total [candidate] (10.861 s) : 0, 10861423

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.071 s	-
Agent	appsec	1.24 s	168.922 ms (15.8%)
Agent	iast	1.231 s	159.381 ms (14.9%)
Agent	profiling	1.2 s	128.287 ms (12.0%)
Total	tracing	10.857 s	-
Total	appsec	10.971 s	114.364 ms (1.1%)
Total	iast	11.168 s	311.076 ms (2.9%)
Total	profiling	11.045 s	187.88 ms (1.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.073 s	-
Agent	appsec	1.237 s	163.617 ms (15.2%)
Agent	iast	1.231 s	157.689 ms (14.7%)
Agent	profiling	1.19 s	117.022 ms (10.9%)
Total	tracing	10.876 s	-
Total	appsec	10.955 s	78.871 ms (0.7%)
Total	iast	11.161 s	284.222 ms (2.6%)
Total	profiling	10.861 s	-14.861 ms (-0.1%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (630.738 ms) : 0, 630738
BytebuddyAgent [candidate] (632.302 ms) : 0, 632302
AgentMeter [baseline] (29.418 ms) : 0, 29418
AgentMeter [candidate] (29.244 ms) : 0, 29244
GlobalTracer [baseline] (259.775 ms) : 0, 259775
GlobalTracer [candidate] (259.007 ms) : 0, 259007
AppSec [baseline] (33.501 ms) : 0, 33501
AppSec [candidate] (33.146 ms) : 0, 33146
Debugger [baseline] (65.156 ms) : 0, 65156
Debugger [candidate] (66.126 ms) : 0, 66126
Remote Config [baseline] (626.425 µs) : 0, 626
Remote Config [candidate] (620.905 µs) : 0, 621
Telemetry [baseline] (9.961 ms) : 0, 9961
Telemetry [candidate] (9.936 ms) : 0, 9936
Flare Poller [baseline] (4.605 ms) : 0, 4605
Flare Poller [candidate] (5.429 ms) : 0, 5429
section appsec
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (659.047 ms) : 0, 659047
BytebuddyAgent [candidate] (656.288 ms) : 0, 656288
AgentMeter [baseline] (11.993 ms) : 0, 11993
AgentMeter [candidate] (11.965 ms) : 0, 11965
GlobalTracer [baseline] (258.28 ms) : 0, 258280
GlobalTracer [candidate] (258.008 ms) : 0, 258008
IAST [baseline] (25.362 ms) : 0, 25362
IAST [candidate] (25.274 ms) : 0, 25274
AppSec [baseline] (167.682 ms) : 0, 167682
AppSec [candidate] (167.417 ms) : 0, 167417
Debugger [baseline] (66.931 ms) : 0, 66931
Debugger [candidate] (66.923 ms) : 0, 66923
Remote Config [baseline] (704.791 µs) : 0, 705
Remote Config [candidate] (675.068 µs) : 0, 675
Telemetry [baseline] (9.312 ms) : 0, 9312
Telemetry [candidate] (9.327 ms) : 0, 9327
Flare Poller [baseline] (3.684 ms) : 0, 3684
Flare Poller [candidate] (3.725 ms) : 0, 3725
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (795.053 ms) : 0, 795053
BytebuddyAgent [candidate] (794.952 ms) : 0, 794952
AgentMeter [baseline] (11.29 ms) : 0, 11290
AgentMeter [candidate] (11.322 ms) : 0, 11322
GlobalTracer [baseline] (247.389 ms) : 0, 247389
GlobalTracer [candidate] (247.125 ms) : 0, 247125
IAST [baseline] (26.8 ms) : 0, 26800
IAST [candidate] (27.031 ms) : 0, 27031
AppSec [baseline] (33.927 ms) : 0, 33927
AppSec [candidate] (33.217 ms) : 0, 33217
Debugger [baseline] (66.572 ms) : 0, 66572
Debugger [candidate] (67.505 ms) : 0, 67505
Remote Config [baseline] (534.961 µs) : 0, 535
Remote Config [candidate] (537.205 µs) : 0, 537
Telemetry [baseline] (8.553 ms) : 0, 8553
Telemetry [candidate] (8.611 ms) : 0, 8611
Flare Poller [baseline] (3.436 ms) : 0, 3436
Flare Poller [candidate] (3.414 ms) : 0, 3414
section profiling
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (687.429 ms) : 0, 687429
BytebuddyAgent [candidate] (681.709 ms) : 0, 681709
AgentMeter [baseline] (8.595 ms) : 0, 8595
AgentMeter [candidate] (8.535 ms) : 0, 8535
GlobalTracer [baseline] (217.193 ms) : 0, 217193
GlobalTracer [candidate] (216.048 ms) : 0, 216048
AppSec [baseline] (33.111 ms) : 0, 33111
AppSec [candidate] (32.659 ms) : 0, 32659
Debugger [baseline] (67.577 ms) : 0, 67577
Debugger [candidate] (67.013 ms) : 0, 67013
Remote Config [baseline] (627.57 µs) : 0, 628
Remote Config [candidate] (633.12 µs) : 0, 633
Telemetry [baseline] (8.963 ms) : 0, 8963
Telemetry [candidate] (8.962 ms) : 0, 8962
Flare Poller [baseline] (3.764 ms) : 0, 3764
Flare Poller [candidate] (3.784 ms) : 0, 3784
ProfilingAgent [baseline] (99.91 ms) : 0, 99910
ProfilingAgent [candidate] (98.949 ms) : 0, 98949
Profiling [baseline] (100.505 ms) : 0, 100505
Profiling [candidate] (99.512 ms) : 0, 99512

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1072244
Total [baseline] (8.749 s) : 0, 8748573
Agent [candidate] (1.065 s) : 0, 1064702
Total [candidate] (8.726 s) : 0, 8725604
section iast
Agent [baseline] (1.228 s) : 0, 1227576
Total [baseline] (9.353 s) : 0, 9352541
Agent [candidate] (1.239 s) : 0, 1239470
Total [candidate] (9.415 s) : 0, 9415081

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.072 s	-
Agent	iast	1.228 s	155.332 ms (14.5%)
Total	tracing	8.749 s	-
Total	iast	9.353 s	603.968 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.065 s	-
Agent	iast	1.239 s	174.768 ms (16.4%)
Total	tracing	8.726 s	-
Total	iast	9.415 s	689.477 ms (7.9%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (632.172 ms) : 0, 632172
BytebuddyAgent [candidate] (627.649 ms) : 0, 627649
AgentMeter [baseline] (29.247 ms) : 0, 29247
AgentMeter [candidate] (29.065 ms) : 0, 29065
GlobalTracer [baseline] (258.887 ms) : 0, 258887
GlobalTracer [candidate] (257.663 ms) : 0, 257663
AppSec [baseline] (33.303 ms) : 0, 33303
AppSec [candidate] (32.834 ms) : 0, 32834
Debugger [baseline] (62.791 ms) : 0, 62791
Debugger [candidate] (62.897 ms) : 0, 62897
Remote Config [baseline] (633.12 µs) : 0, 633
Remote Config [candidate] (619.556 µs) : 0, 620
Telemetry [baseline] (12.321 ms) : 0, 12321
Telemetry [candidate] (9.787 ms) : 0, 9787
Flare Poller [baseline] (5.499 ms) : 0, 5499
Flare Poller [candidate] (6.928 ms) : 0, 6928
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (793.361 ms) : 0, 793361
BytebuddyAgent [candidate] (801.865 ms) : 0, 801865
AgentMeter [baseline] (11.314 ms) : 0, 11314
AgentMeter [candidate] (11.549 ms) : 0, 11549
GlobalTracer [baseline] (246.449 ms) : 0, 246449
GlobalTracer [candidate] (248.451 ms) : 0, 248451
IAST [baseline] (27.042 ms) : 0, 27042
IAST [candidate] (27.27 ms) : 0, 27270
AppSec [baseline] (34.855 ms) : 0, 34855
AppSec [candidate] (32.618 ms) : 0, 32618
Debugger [baseline] (64.682 ms) : 0, 64682
Debugger [candidate] (67.771 ms) : 0, 67771
Remote Config [baseline] (543.909 µs) : 0, 544
Remote Config [candidate] (540.302 µs) : 0, 540
Telemetry [baseline] (8.641 ms) : 0, 8641
Telemetry [candidate] (8.662 ms) : 0, 8662
Flare Poller [baseline] (3.501 ms) : 0, 3501
Flare Poller [candidate] (3.499 ms) : 0, 3499

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/pin-system-tests-branch
git_commit_date	1772492986	1773869388
git_commit_sha	`0f5d84f`	`f4bb24d`
release_version	1.60.0~0f5d84f2c4	1.61.0-SNAPSHOT~f4bb24d0aa

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773871766	1773871766
ci_job_id	1519740134	1519740134
ci_pipeline_id	103393510	103393510
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-1okwmihf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-1okwmihf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	better [-106.988µs; -34.757µs] or [-10.270%; -3.336%]	unstable [-972.062µs; -154.135µs] or [-30.205%; -4.789%]	unstable [-74.838op/s; +749.838op/s] or [-2.208%; +22.128%]	0.971ms	2.655ms	3726.188op/s	1.042ms	3.218ms	3388.688op/s
scenario:load:insecure-bank:profiling:high_load	worse [+91.469µs; +201.512µs] or [+5.608%; +12.354%]	unstable [+211.576µs; +1194.455µs] or [+4.485%; +25.321%]	unstable [-507.365op/s; -6.385op/s] or [-22.565%; -0.284%]	1.778ms	5.420ms	1991.625op/s	1.631ms	4.717ms	2248.500op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.719ms; +2.304ms] or [+4.089%; +13.110%]	unstable [+0.938ms; +4.031ms] or [+3.213%; +13.807%]	unstable [-48.028op/s; +5.966op/s] or [-18.495%; +2.297%]	19.085ms	31.678ms	238.656op/s	17.574ms	29.193ms	259.688op/s
scenario:load:petclinic:appsec:high_load	better [-2.126ms; -1.139ms] or [-10.711%; -5.737%]	better [-2.724ms; -1.211ms] or [-8.527%; -3.790%]	unstable [-5.232op/s; +42.607op/s] or [-2.257%; +18.375%]	18.220ms	29.976ms	250.562op/s	19.853ms	31.943ms	231.875op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.971 ms) : 17790, 18153
.   : milestone, 17971,
appsec (20.138 ms) : 19930, 20346
.   : milestone, 20138,
code_origins (17.804 ms) : 17627, 17982
.   : milestone, 17804,
iast (17.686 ms) : 17506, 17866
.   : milestone, 17686,
profiling (18.559 ms) : 18370, 18748
.   : milestone, 18559,
tracing (17.501 ms) : 17330, 17672
.   : milestone, 17501,
section candidate
no_agent (19.561 ms) : 19357, 19765
.   : milestone, 19561,
appsec (18.626 ms) : 18437, 18814
.   : milestone, 18626,
code_origins (17.646 ms) : 17471, 17821
.   : milestone, 17646,
iast (17.486 ms) : 17315, 17658
.   : milestone, 17486,
profiling (18.616 ms) : 18429, 18802
.   : milestone, 18616,
tracing (17.567 ms) : 17392, 17741
.   : milestone, 17567,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.971 ms [17.79 ms, 18.153 ms]	-
appsec	20.138 ms [19.93 ms, 20.346 ms]	2.167 ms (12.1%)
code_origins	17.804 ms [17.627 ms, 17.982 ms]	-167.006 µs (-0.9%)
iast	17.686 ms [17.506 ms, 17.866 ms]	-285.678 µs (-1.6%)
profiling	18.559 ms [18.37 ms, 18.748 ms]	587.553 µs (3.3%)
tracing	17.501 ms [17.33 ms, 17.672 ms]	-470.191 µs (-2.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.561 ms [19.357 ms, 19.765 ms]	-
appsec	18.626 ms [18.437 ms, 18.814 ms]	-935.167 µs (-4.8%)
code_origins	17.646 ms [17.471 ms, 17.821 ms]	-1.915 ms (-9.8%)
iast	17.486 ms [17.315 ms, 17.658 ms]	-2.074 ms (-10.6%)
profiling	18.616 ms [18.429 ms, 18.802 ms]	-945.104 µs (-4.8%)
tracing	17.567 ms [17.392 ms, 17.741 ms]	-1.994 ms (-10.2%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.307 ms) : 1294, 1321
.   : milestone, 1307,
iast (3.173 ms) : 3128, 3218
.   : milestone, 3173,
iast_FULL (5.938 ms) : 5877, 5999
.   : milestone, 5938,
iast_GLOBAL (3.537 ms) : 3488, 3585
.   : milestone, 3537,
profiling (2.008 ms) : 1989, 2027
.   : milestone, 2008,
tracing (1.78 ms) : 1765, 1795
.   : milestone, 1780,
section candidate
no_agent (1.182 ms) : 1171, 1194
.   : milestone, 1182,
iast (3.288 ms) : 3238, 3338
.   : milestone, 3288,
iast_FULL (5.776 ms) : 5718, 5833
.   : milestone, 5776,
iast_GLOBAL (3.472 ms) : 3414, 3529
.   : milestone, 3472,
profiling (2.276 ms) : 2252, 2299
.   : milestone, 2276,
tracing (1.801 ms) : 1786, 1815
.   : milestone, 1801,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.307 ms [1.294 ms, 1.321 ms]	-
iast	3.173 ms [3.128 ms, 3.218 ms]	1.866 ms (142.7%)
iast_FULL	5.938 ms [5.877 ms, 5.999 ms]	4.631 ms (354.2%)
iast_GLOBAL	3.537 ms [3.488 ms, 3.585 ms]	2.229 ms (170.5%)
profiling	2.008 ms [1.989 ms, 2.027 ms]	700.405 µs (53.6%)
tracing	1.78 ms [1.765 ms, 1.795 ms]	472.75 µs (36.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.182 ms [1.171 ms, 1.194 ms]	-
iast	3.288 ms [3.238 ms, 3.338 ms]	2.106 ms (178.1%)
iast_FULL	5.776 ms [5.718 ms, 5.833 ms]	4.593 ms (388.5%)
iast_GLOBAL	3.472 ms [3.414 ms, 3.529 ms]	2.289 ms (193.6%)
profiling	2.276 ms [2.252 ms, 2.299 ms]	1.093 ms (92.5%)
tracing	1.801 ms [1.786 ms, 1.815 ms]	618.481 µs (52.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/pin-system-tests-branch
git_commit_date	1772492986	1773869388
git_commit_sha	`0f5d84f`	`f4bb24d`
release_version	1.60.0~0f5d84f2c4	1.61.0-SNAPSHOT~f4bb24d0aa

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1773871473	1773871473
ci_job_id	1519740135	1519740135
ci_pipeline_id	103393510	103393510
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-p7d64pe5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-p7d64pe5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.361 s) : 15361000, 15361000
.   : milestone, 15361000,
appsec (15.248 s) : 15248000, 15248000
.   : milestone, 15248000,
iast (18.177 s) : 18177000, 18177000
.   : milestone, 18177000,
iast_GLOBAL (17.63 s) : 17630000, 17630000
.   : milestone, 17630000,
profiling (15.448 s) : 15448000, 15448000
.   : milestone, 15448000,
tracing (14.749 s) : 14749000, 14749000
.   : milestone, 14749000,
section candidate
no_agent (15.634 s) : 15634000, 15634000
.   : milestone, 15634000,
appsec (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
iast (17.978 s) : 17978000, 17978000
.   : milestone, 17978000,
iast_GLOBAL (17.986 s) : 17986000, 17986000
.   : milestone, 17986000,
profiling (15.046 s) : 15046000, 15046000
.   : milestone, 15046000,
tracing (15.122 s) : 15122000, 15122000
.   : milestone, 15122000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.361 s [15.361 s, 15.361 s]	-
appsec	15.248 s [15.248 s, 15.248 s]	-113.0 ms (-0.7%)
iast	18.177 s [18.177 s, 18.177 s]	2.816 s (18.3%)
iast_GLOBAL	17.63 s [17.63 s, 17.63 s]	2.269 s (14.8%)
profiling	15.448 s [15.448 s, 15.448 s]	87.0 ms (0.6%)
tracing	14.749 s [14.749 s, 14.749 s]	-612.0 ms (-4.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.634 s [15.634 s, 15.634 s]	-
appsec	15.04 s [15.04 s, 15.04 s]	-594.0 ms (-3.8%)
iast	17.978 s [17.978 s, 17.978 s]	2.344 s (15.0%)
iast_GLOBAL	17.986 s [17.986 s, 17.986 s]	2.352 s (15.0%)
profiling	15.046 s [15.046 s, 15.046 s]	-588.0 ms (-3.8%)
tracing	15.122 s [15.122 s, 15.122 s]	-512.0 ms (-3.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~f4bb24d0aa, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.807 ms) : 3586, 4029
.   : milestone, 3807,
iast (2.277 ms) : 2207, 2347
.   : milestone, 2277,
iast_GLOBAL (2.303 ms) : 2233, 2372
.   : milestone, 2303,
profiling (2.094 ms) : 2038, 2150
.   : milestone, 2094,
tracing (2.071 ms) : 2017, 2124
.   : milestone, 2071,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.803 ms) : 3580, 4025
.   : milestone, 3803,
iast (2.261 ms) : 2192, 2331
.   : milestone, 2261,
iast_GLOBAL (2.297 ms) : 2228, 2367
.   : milestone, 2297,
profiling (2.116 ms) : 2059, 2172
.   : milestone, 2116,
tracing (2.073 ms) : 2019, 2127
.   : milestone, 2073,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.463 ms, 1.486 ms]	-
appsec	3.807 ms [3.586 ms, 4.029 ms]	2.332 ms (158.1%)
iast	2.277 ms [2.207 ms, 2.347 ms]	802.234 µs (54.4%)
iast_GLOBAL	2.303 ms [2.233 ms, 2.372 ms]	827.685 µs (56.1%)
profiling	2.094 ms [2.038 ms, 2.15 ms]	619.17 µs (42.0%)
tracing	2.071 ms [2.017 ms, 2.124 ms]	595.845 µs (40.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.468 ms, 1.491 ms]	-
appsec	3.803 ms [3.58 ms, 4.025 ms]	2.323 ms (157.0%)
iast	2.261 ms [2.192 ms, 2.331 ms]	781.76 µs (52.8%)
iast_GLOBAL	2.297 ms [2.228 ms, 2.367 ms]	817.715 µs (55.3%)
profiling	2.116 ms [2.059 ms, 2.172 ms]	636.213 µs (43.0%)
tracing	2.073 ms [2.019 ms, 2.127 ms]	593.405 µs (40.1%)

pr-commenter · 2026-03-18T19:54:24Z

Kafka / producer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	release/v1.60.x	sarahchen6/pin-system-tests-branch
git_commit_date	1773846743	1773869388
git_commit_sha	`c1e6a13`	`f4bb24d`

See matching parameters

	Baseline	Candidate
ci_job_date	1773870633	1773870633
ci_job_id	1519740138	1519740138
ci_pipeline_id	103393510	103393510
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce	same

pr-commenter · 2026-03-18T20:09:26Z

Kafka / consumer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	release/v1.60.x	sarahchen6/pin-system-tests-branch
git_commit_date	1773846743	1773869388
git_commit_sha	`c1e6a13`	`f4bb24d`

See matching parameters

	Baseline	Candidate
ci_job_date	1773870532	1773870532
ci_job_id	1519740139	1519740139
ci_pipeline_id	103393510	103393510
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume	unsure [-12347.249op/s; -1515.192op/s] or [-3.981%; -0.489%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same

init Merge branch 'master' into mhlidd/update_telemetry_key_normalization Merge branch 'master' into mhlidd/update_telemetry_key_normalization Merge branch 'master' into mhlidd/update_telemetry_key_normalization Co-authored-by: devflow.devflow-routing-intake <devflow.devflow-routing-intake@kubernetes.us1.ddbuild.io>

github-actions · 2026-03-18T22:20:56Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

Pin system tests to dd-trace-java-1.60.2-release branch

ec01b34

sarahchen6 force-pushed the sarahchen6/pin-system-tests-branch branch from cb652de to ec01b34 Compare March 18, 2026 19:16

sarahchen6 mentioned this pull request Mar 18, 2026

System tests branch for dd-trace-java 1.60.2 DataDog/system-tests#6535

Draft

5 tasks

sarahchen6 marked this pull request as ready for review March 18, 2026 22:20

sarahchen6 requested review from a team as code owners March 18, 2026 22:20

sarahchen6 requested review from PerfectSlayer and bric3 and removed request for a team March 18, 2026 22:20

sarahchen6 added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Mar 18, 2026

sarahchen6 requested review from AlexeyKuznetsov-DD and ygree March 18, 2026 22:21

AlexeyKuznetsov-DD approved these changes Mar 18, 2026

View reviewed changes

sarahchen6 merged commit 571a19e into release/v1.60.x Mar 18, 2026
573 of 577 checks passed

sarahchen6 deleted the sarahchen6/pin-system-tests-branch branch March 18, 2026 22:53

github-actions bot added this to the 1.60.2 milestone Mar 18, 2026

sarahchen6 mentioned this pull request Mar 18, 2026

Pin system-tests to SHA with pinned download-artifact action #10889

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Pin system tests to dd-trace-java-1.60.2-release branch#10898

Pin system tests to dd-trace-java-1.60.2-release branch#10898
sarahchen6 merged 2 commits intorelease/v1.60.xfrom
sarahchen6/pin-system-tests-branch

sarahchen6 commented Mar 18, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Mar 18, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Mar 18, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Mar 18, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Mar 18, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

sarahchen6 commented Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

pr-commenter bot commented Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / producer-benchmark

Parameters

Summary

Uh oh!

pr-commenter bot commented Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / consumer-benchmark

Parameters

Summary

Uh oh!

github-actions bot commented Mar 18, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

sarahchen6 commented Mar 18, 2026 •

edited

Loading

pr-commenter bot commented Mar 18, 2026 •

edited

Loading

pr-commenter bot commented Mar 18, 2026 •

edited

Loading

pr-commenter bot commented Mar 18, 2026 •

edited

Loading