Skip to content

Add gradle debug plugin#8879

Merged
smola merged 2 commits intomasterfrom
smola/gradle-2-debug-plugin
May 27, 2025
Merged

Add gradle debug plugin#8879
smola merged 2 commits intomasterfrom
smola/gradle-2-debug-plugin

Conversation

@smola
Copy link
Copy Markdown
Member

@smola smola commented May 26, 2025

What Does This Do

Add gradle plugin to log metadata of configured projects when -PddGradleDebug is set.

This will generate build/datadog.gradle-debug.log with content as follows:

[...]
{"task":":dd-smoke-tests:springboot-java-17:compileGroovy", "jdk":"8", "java_home":"17"}
{"task":":dd-smoke-tests:springboot-java-17:compileJava", "jdk":"17"}
{"task":":dd-smoke-tests:springboot-java-17:compileMain_java17Groovy", "jdk":"8", "java_home":"17"}
{"task":":dd-smoke-tests:springboot-java-17:compileMain_java17Java", "jdk":"17"}
{"task":":dd-smoke-tests:springboot-java-17:compileTestFixturesGroovy", "jdk":"8", "java_home":"17"}
{"task":":dd-smoke-tests:springboot-java-17:compileTestFixturesJava", "jdk":"17"}
{"task":":dd-smoke-tests:springboot-java-17:compileTestGroovy", "jdk":"8", "java_home":"17"}
{"task":":dd-smoke-tests:springboot-java-17:compileTestJava", "jdk":"17"}
[...]

Motivation

Verify impact to selected JDKs whenever we refactor configuration.

Additional Notes

Contributor Checklist

Jira ticket: APMJAVA-1342

@smola smola added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 26, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented May 26, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-2-debug-plugin
git_commit_date 1746789389 1748280401
git_commit_sha ad6d5fe ce1c1eb
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~ce1c1ebcdd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748282889 1748282889
ci_job_id 954575461 954575461
ci_pipeline_id 66136772 66136772
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8t2n4jps-project-304-concurrent-0-lg5yegt4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8t2n4jps-project-304-concurrent-0-lg5yegt4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 56 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:ProfilingAgent better
[-8.520ms; -5.417ms] or [-7.757%; -4.932%]
102.867ms 109.836ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-21.120ms; -17.430ms] or [-5.572%; -4.598%]
359.772ms 379.047ms
scenario:startup:petclinic:profiling:AppSec worse
[+5.396ms; +8.426ms] or [+9.845%; +15.373%]
61.720ms 54.809ms
scenario:startup:petclinic:profiling:Profiling better
[-8.522ms; -5.418ms] or [-7.757%; -4.932%]
102.890ms 109.861ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.029 s) : 0, 1029268
Total [baseline] (10.601 s) : 0, 10600750
Agent [candidate] (1.023 s) : 0, 1022910
Total [candidate] (10.475 s) : 0, 10474851
section appsec
Agent [baseline] (1.163 s) : 0, 1162625
Total [baseline] (10.767 s) : 0, 10766726
Agent [candidate] (1.17 s) : 0, 1170105
Total [candidate] (10.715 s) : 0, 10715457
section iast
Agent [baseline] (1.151 s) : 0, 1151467
Total [baseline] (10.878 s) : 0, 10878215
Agent [candidate] (1.15 s) : 0, 1150143
Total [candidate] (10.921 s) : 0, 10920896
section profiling
Agent [baseline] (1.283 s) : 0, 1282878
Total [baseline] (10.957 s) : 0, 10957274
Agent [candidate] (1.264 s) : 0, 1264428
Total [candidate] (10.91 s) : 0, 10910068
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.029 s -
Agent appsec 1.163 s 133.357 ms (13.0%)
Agent iast 1.151 s 122.199 ms (11.9%)
Agent profiling 1.283 s 253.609 ms (24.6%)
Total tracing 10.601 s -
Total appsec 10.767 s 165.976 ms (1.6%)
Total iast 10.878 s 277.465 ms (2.6%)
Total profiling 10.957 s 356.524 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent appsec 1.17 s 147.194 ms (14.4%)
Agent iast 1.15 s 127.233 ms (12.4%)
Agent profiling 1.264 s 241.518 ms (23.6%)
Total tracing 10.475 s -
Total appsec 10.715 s 240.606 ms (2.3%)
Total iast 10.921 s 446.045 ms (4.3%)
Total profiling 10.91 s 435.216 ms (4.2%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.42 ms) : 0, 689420
BytebuddyAgent [candidate] (684.602 ms) : 0, 684602
GlobalTracer [baseline] (243.534 ms) : 0, 243534
GlobalTracer [candidate] (241.138 ms) : 0, 241138
AppSec [baseline] (55.115 ms) : 0, 55115
AppSec [candidate] (56.944 ms) : 0, 56944
Debugger [baseline] (8.363 ms) : 0, 8363
Debugger [candidate] (7.564 ms) : 0, 7564
Remote Config [baseline] (705.3 µs) : 0, 705
Remote Config [candidate] (712.659 µs) : 0, 713
Telemetry [baseline] (8.397 ms) : 0, 8397
Telemetry [candidate] (8.329 ms) : 0, 8329
section appsec
BytebuddyAgent [baseline] (700.692 ms) : 0, 700692
BytebuddyAgent [candidate] (706.084 ms) : 0, 706084
GlobalTracer [baseline] (237.409 ms) : 0, 237409
GlobalTracer [candidate] (238.707 ms) : 0, 238707
AppSec [baseline] (175.648 ms) : 0, 175648
AppSec [candidate] (175.793 ms) : 0, 175793
Debugger [baseline] (5.971 ms) : 0, 5971
Debugger [candidate] (5.993 ms) : 0, 5993
Remote Config [baseline] (626.831 µs) : 0, 627
Remote Config [candidate] (626.922 µs) : 0, 627
Telemetry [baseline] (7.825 ms) : 0, 7825
Telemetry [candidate] (8.172 ms) : 0, 8172
IAST [baseline] (21.774 ms) : 0, 21774
IAST [candidate] (22.151 ms) : 0, 22151
section iast
BytebuddyAgent [baseline] (803.12 ms) : 0, 803120
BytebuddyAgent [candidate] (802.82 ms) : 0, 802820
GlobalTracer [baseline] (231.35 ms) : 0, 231350
GlobalTracer [candidate] (230.858 ms) : 0, 230858
AppSec [baseline] (48.891 ms) : 0, 48891
AppSec [candidate] (49.449 ms) : 0, 49449
Debugger [baseline] (5.943 ms) : 0, 5943
Debugger [candidate] (5.9 ms) : 0, 5900
Remote Config [baseline] (596.05 µs) : 0, 596
Remote Config [candidate] (591.651 µs) : 0, 592
Telemetry [baseline] (7.948 ms) : 0, 7948
Telemetry [candidate] (7.939 ms) : 0, 7939
IAST [baseline] (27.678 ms) : 0, 27678
IAST [candidate] (29.084 ms) : 0, 29084
section profiling
BytebuddyAgent [baseline] (673.749 ms) : 0, 673749
BytebuddyAgent [candidate] (674.034 ms) : 0, 674034
GlobalTracer [baseline] (379.047 ms) : 0, 379047
GlobalTracer [candidate] (359.772 ms) : 0, 359772
AppSec [baseline] (54.809 ms) : 0, 54809
AppSec [candidate] (61.72 ms) : 0, 61720
Debugger [baseline] (6.133 ms) : 0, 6133
Debugger [candidate] (6.292 ms) : 0, 6292
Remote Config [baseline] (662.391 µs) : 0, 662
Remote Config [candidate] (649.977 µs) : 0, 650
Telemetry [baseline] (8.049 ms) : 0, 8049
Telemetry [candidate] (8.169 ms) : 0, 8169
ProfilingAgent [baseline] (109.836 ms) : 0, 109836
ProfilingAgent [candidate] (102.867 ms) : 0, 102867
Profiling [baseline] (109.861 ms) : 0, 109861
Profiling [candidate] (102.89 ms) : 0, 102890
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020685
Total [baseline] (8.698 s) : 0, 8697973
Agent [candidate] (1.022 s) : 0, 1021554
Total [candidate] (8.659 s) : 0, 8658920
section iast
Agent [baseline] (1.15 s) : 0, 1149588
Total [baseline] (9.281 s) : 0, 9280840
Agent [candidate] (1.151 s) : 0, 1151425
Total [candidate] (9.232 s) : 0, 9232470
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.158 s) : 0, 1158106
Total [baseline] (9.226 s) : 0, 9225649
Agent [candidate] (1.158 s) : 0, 1157942
Total [candidate] (9.253 s) : 0, 9253431
section iast_TELEMETRY_OFF
Agent [baseline] (1.153 s) : 0, 1152783
Total [baseline] (9.313 s) : 0, 9313276
Agent [candidate] (1.147 s) : 0, 1147255
Total [candidate] (9.232 s) : 0, 9232091
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent iast 1.15 s 128.903 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.158 s 137.421 ms (13.5%)
Agent iast_TELEMETRY_OFF 1.153 s 132.098 ms (12.9%)
Total tracing 8.698 s -
Total iast 9.281 s 582.866 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.226 s 527.675 ms (6.1%)
Total iast_TELEMETRY_OFF 9.313 s 615.302 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent iast 1.151 s 129.871 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.158 s 136.388 ms (13.4%)
Agent iast_TELEMETRY_OFF 1.147 s 125.701 ms (12.3%)
Total tracing 8.659 s -
Total iast 9.232 s 573.549 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.253 s 594.511 ms (6.9%)
Total iast_TELEMETRY_OFF 9.232 s 573.17 ms (6.6%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.095 ms) : 0, 683095
BytebuddyAgent [candidate] (683.164 ms) : 0, 683164
GlobalTracer [baseline] (240.676 ms) : 0, 240676
GlobalTracer [candidate] (240.783 ms) : 0, 240783
AppSec [baseline] (54.626 ms) : 0, 54626
AppSec [candidate] (55.276 ms) : 0, 55276
Debugger [baseline] (9.8 ms) : 0, 9800
Debugger [candidate] (9.079 ms) : 0, 9079
Remote Config [baseline] (694.333 µs) : 0, 694
Remote Config [candidate] (704.914 µs) : 0, 705
Telemetry [baseline] (8.284 ms) : 0, 8284
Telemetry [candidate] (9.07 ms) : 0, 9070
section iast
BytebuddyAgent [baseline] (802.905 ms) : 0, 802905
BytebuddyAgent [candidate] (803.938 ms) : 0, 803938
GlobalTracer [baseline] (230.521 ms) : 0, 230521
GlobalTracer [candidate] (231.376 ms) : 0, 231376
AppSec [baseline] (50.191 ms) : 0, 50191
AppSec [candidate] (50.219 ms) : 0, 50219
Debugger [baseline] (5.906 ms) : 0, 5906
Debugger [candidate] (5.911 ms) : 0, 5911
Remote Config [baseline] (599.919 µs) : 0, 600
Remote Config [candidate] (598.852 µs) : 0, 599
Telemetry [baseline] (7.889 ms) : 0, 7889
Telemetry [candidate] (7.837 ms) : 0, 7837
IAST [baseline] (28.087 ms) : 0, 28087
IAST [candidate] (28.08 ms) : 0, 28080
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (808.349 ms) : 0, 808349
BytebuddyAgent [candidate] (808.25 ms) : 0, 808250
GlobalTracer [baseline] (232.302 ms) : 0, 232302
GlobalTracer [candidate] (232.507 ms) : 0, 232507
AppSec [baseline] (49.122 ms) : 0, 49122
AppSec [candidate] (48.854 ms) : 0, 48854
Debugger [baseline] (5.935 ms) : 0, 5935
Debugger [candidate] (5.963 ms) : 0, 5963
Remote Config [baseline] (604.167 µs) : 0, 604
Remote Config [candidate] (592.158 µs) : 0, 592
Telemetry [baseline] (7.919 ms) : 0, 7919
Telemetry [candidate] (7.978 ms) : 0, 7978
IAST [baseline] (30.234 ms) : 0, 30234
IAST [candidate] (30.154 ms) : 0, 30154
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (804.317 ms) : 0, 804317
BytebuddyAgent [candidate] (799.646 ms) : 0, 799646
GlobalTracer [baseline] (231.965 ms) : 0, 231965
GlobalTracer [candidate] (231.376 ms) : 0, 231376
AppSec [baseline] (55.937 ms) : 0, 55937
AppSec [candidate] (54.323 ms) : 0, 54323
Debugger [baseline] (5.96 ms) : 0, 5960
Debugger [candidate] (6.038 ms) : 0, 6038
Remote Config [baseline] (606.667 µs) : 0, 607
Remote Config [candidate] (626.539 µs) : 0, 627
Telemetry [baseline] (7.799 ms) : 0, 7799
Telemetry [candidate] (7.831 ms) : 0, 7831
IAST [baseline] (22.531 ms) : 0, 22531
IAST [candidate] (23.842 ms) : 0, 23842
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-26T17:38:25 2025-05-26T17:46:13
git_branch master smola/gradle-2-debug-plugin
git_commit_date 1746789389 1748280401
git_commit_sha ad6d5fe ce1c1eb
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~ce1c1ebcdd
start_time 2025-05-26T17:38:11 2025-05-26T17:45:58
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748281974 1748281974
ci_job_id 954575462 954575462
ci_pipeline_id 66136772 66136772
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qshkhgbg-project-304-concurrent-0-61qpsf33 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qshkhgbg-project-304-concurrent-0-61qpsf33 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.386 ms) : 1367, 1405
.   : milestone, 1386,
appsec (1.752 ms) : 1728, 1777
.   : milestone, 1752,
appsec_no_iast (1.752 ms) : 1729, 1775
.   : milestone, 1752,
code_origins (1.671 ms) : 1645, 1698
.   : milestone, 1671,
iast (1.538 ms) : 1513, 1563
.   : milestone, 1538,
profiling (1.516 ms) : 1493, 1539
.   : milestone, 1516,
tracing (1.508 ms) : 1482, 1533
.   : milestone, 1508,
section candidate
no_agent (1.372 ms) : 1351, 1392
.   : milestone, 1372,
appsec (1.755 ms) : 1731, 1779
.   : milestone, 1755,
appsec_no_iast (1.747 ms) : 1723, 1770
.   : milestone, 1747,
code_origins (1.665 ms) : 1638, 1692
.   : milestone, 1665,
iast (1.536 ms) : 1511, 1560
.   : milestone, 1536,
profiling (1.517 ms) : 1494, 1540
.   : milestone, 1517,
tracing (1.497 ms) : 1473, 1522
.   : milestone, 1497,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.386 ms [1.367 ms, 1.405 ms] -
appsec 1.752 ms [1.728 ms, 1.777 ms] 366.162 µs (26.4%)
appsec_no_iast 1.752 ms [1.729 ms, 1.775 ms] 365.522 µs (26.4%)
code_origins 1.671 ms [1.645 ms, 1.698 ms] 284.903 µs (20.6%)
iast 1.538 ms [1.513 ms, 1.563 ms] 151.889 µs (11.0%)
profiling 1.516 ms [1.493 ms, 1.539 ms] 129.72 µs (9.4%)
tracing 1.508 ms [1.482 ms, 1.533 ms] 121.448 µs (8.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.372 ms [1.351 ms, 1.392 ms] -
appsec 1.755 ms [1.731 ms, 1.779 ms] 383.683 µs (28.0%)
appsec_no_iast 1.747 ms [1.723 ms, 1.77 ms] 375.255 µs (27.4%)
code_origins 1.665 ms [1.638 ms, 1.692 ms] 293.48 µs (21.4%)
iast 1.536 ms [1.511 ms, 1.56 ms] 164.392 µs (12.0%)
profiling 1.517 ms [1.494 ms, 1.54 ms] 145.863 µs (10.6%)
tracing 1.497 ms [1.473 ms, 1.522 ms] 125.921 µs (9.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.68 µs) : 365, 404
.   : milestone, 385,
iast (529.872 µs) : 507, 553
.   : milestone, 530,
iast_FULL (742.019 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (575.521 µs) : 553, 598
.   : milestone, 576,
iast_HARDCODED_SECRET_DISABLED (524.085 µs) : 502, 546
.   : milestone, 524,
iast_INACTIVE (476.809 µs) : 454, 500
.   : milestone, 477,
iast_TELEMETRY_OFF (511.808 µs) : 489, 535
.   : milestone, 512,
tracing (462.304 µs) : 440, 484
.   : milestone, 462,
section candidate
no_agent (389.343 µs) : 369, 409
.   : milestone, 389,
iast (526.175 µs) : 504, 549
.   : milestone, 526,
iast_FULL (748.597 µs) : 727, 770
.   : milestone, 749,
iast_GLOBAL (569.651 µs) : 547, 592
.   : milestone, 570,
iast_HARDCODED_SECRET_DISABLED (518.383 µs) : 497, 540
.   : milestone, 518,
iast_INACTIVE (472.388 µs) : 450, 495
.   : milestone, 472,
iast_TELEMETRY_OFF (519.149 µs) : 496, 542
.   : milestone, 519,
tracing (467.517 µs) : 445, 490
.   : milestone, 468,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.68 µs [365.048 µs, 404.311 µs] -
iast 529.872 µs [506.633 µs, 553.112 µs] 145.192 µs (37.7%)
iast_FULL 742.019 µs [719.846 µs, 764.192 µs] 357.339 µs (92.9%)
iast_GLOBAL 575.521 µs [552.872 µs, 598.17 µs] 190.841 µs (49.6%)
iast_HARDCODED_SECRET_DISABLED 524.085 µs [502.188 µs, 545.981 µs] 139.405 µs (36.2%)
iast_INACTIVE 476.809 µs [453.937 µs, 499.68 µs] 92.129 µs (23.9%)
iast_TELEMETRY_OFF 511.808 µs [488.84 µs, 534.777 µs] 127.129 µs (33.0%)
tracing 462.304 µs [440.15 µs, 484.458 µs] 77.624 µs (20.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 389.343 µs [369.289 µs, 409.397 µs] -
iast 526.175 µs [503.847 µs, 548.504 µs] 136.832 µs (35.1%)
iast_FULL 748.597 µs [726.756 µs, 770.438 µs] 359.254 µs (92.3%)
iast_GLOBAL 569.651 µs [547.239 µs, 592.062 µs] 180.308 µs (46.3%)
iast_HARDCODED_SECRET_DISABLED 518.383 µs [496.947 µs, 539.818 µs] 129.04 µs (33.1%)
iast_INACTIVE 472.388 µs [449.515 µs, 495.261 µs] 83.045 µs (21.3%)
iast_TELEMETRY_OFF 519.149 µs [496.122 µs, 542.177 µs] 129.806 µs (33.3%)
tracing 467.517 µs [445.33 µs, 489.704 µs] 78.174 µs (20.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-2-debug-plugin
git_commit_date 1746789389 1748280401
git_commit_sha ad6d5fe ce1c1eb
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~ce1c1ebcdd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1748282454 1748282454
ci_job_id 954575463 954575463
ci_pipeline_id 66136772 66136772
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dtsgutkg-project-304-concurrent-0-lavacvjw 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dtsgutkg-project-304-concurrent-0-lavacvjw 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.487 s) : 15487000, 15487000
.   : milestone, 15487000,
appsec (15.17 s) : 15170000, 15170000
.   : milestone, 15170000,
iast (18.884 s) : 18884000, 18884000
.   : milestone, 18884000,
iast_GLOBAL (18.344 s) : 18344000, 18344000
.   : milestone, 18344000,
profiling (15.823 s) : 15823000, 15823000
.   : milestone, 15823000,
tracing (15.126 s) : 15126000, 15126000
.   : milestone, 15126000,
section candidate
no_agent (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
appsec (15.027 s) : 15027000, 15027000
.   : milestone, 15027000,
iast (18.56 s) : 18560000, 18560000
.   : milestone, 18560000,
iast_GLOBAL (18.279 s) : 18279000, 18279000
.   : milestone, 18279000,
profiling (14.845 s) : 14845000, 14845000
.   : milestone, 14845000,
tracing (15.037 s) : 15037000, 15037000
.   : milestone, 15037000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.487 s [15.487 s, 15.487 s] -
appsec 15.17 s [15.17 s, 15.17 s] -317.0 ms (-2.0%)
iast 18.884 s [18.884 s, 18.884 s] 3.397 s (21.9%)
iast_GLOBAL 18.344 s [18.344 s, 18.344 s] 2.857 s (18.4%)
profiling 15.823 s [15.823 s, 15.823 s] 336.0 ms (2.2%)
tracing 15.126 s [15.126 s, 15.126 s] -361.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.805 s [14.805 s, 14.805 s] -
appsec 15.027 s [15.027 s, 15.027 s] 222.0 ms (1.5%)
iast 18.56 s [18.56 s, 18.56 s] 3.755 s (25.4%)
iast_GLOBAL 18.279 s [18.279 s, 18.279 s] 3.474 s (23.5%)
profiling 14.845 s [14.845 s, 14.845 s] 40.0 ms (0.3%)
tracing 15.037 s [15.037 s, 15.037 s] 232.0 ms (1.6%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ce1c1ebcdd, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (2.406 ms) : 2358, 2455
.   : milestone, 2406,
iast (2.184 ms) : 2123, 2245
.   : milestone, 2184,
iast_GLOBAL (2.228 ms) : 2167, 2290
.   : milestone, 2228,
profiling (2.053 ms) : 2003, 2103
.   : milestone, 2053,
tracing (2.011 ms) : 1963, 2058
.   : milestone, 2011,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.422 ms) : 2372, 2472
.   : milestone, 2422,
iast (2.191 ms) : 2130, 2252
.   : milestone, 2191,
iast_GLOBAL (2.232 ms) : 2170, 2294
.   : milestone, 2232,
profiling (2.036 ms) : 1987, 2085
.   : milestone, 2036,
tracing (2.028 ms) : 1980, 2077
.   : milestone, 2028,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 2.406 ms [2.358 ms, 2.455 ms] 923.971 µs (62.3%)
iast 2.184 ms [2.123 ms, 2.245 ms] 701.488 µs (47.3%)
iast_GLOBAL 2.228 ms [2.167 ms, 2.29 ms] 745.956 µs (50.3%)
profiling 2.053 ms [2.003 ms, 2.103 ms] 570.39 µs (38.5%)
tracing 2.011 ms [1.963 ms, 2.058 ms] 528.383 µs (35.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.422 ms [2.372 ms, 2.472 ms] 943.614 µs (63.8%)
iast 2.191 ms [2.13 ms, 2.252 ms] 712.667 µs (48.2%)
iast_GLOBAL 2.232 ms [2.17 ms, 2.294 ms] 753.619 µs (51.0%)
profiling 2.036 ms [1.987 ms, 2.085 ms] 557.581 µs (37.7%)
tracing 2.028 ms [1.98 ms, 2.077 ms] 550.008 µs (37.2%)

@smola smola marked this pull request as ready for review May 26, 2025 10:18
@smola smola requested a review from a team as a code owner May 26, 2025 10:18
@smola smola requested a review from ygree May 26, 2025 10:18
Comment thread buildSrc/src/main/kotlin/datadog.gradle-debug.gradle.kts Outdated
Comment thread buildSrc/src/main/kotlin/datadog.gradle-debug.gradle.kts Outdated
Comment thread buildSrc/src/main/kotlin/datadog.gradle-debug.gradle.kts Outdated
Comment thread buildSrc/src/main/kotlin/datadog.gradle-debug.gradle.kts Outdated
Comment thread buildSrc/src/main/kotlin/datadog.gradle-debug.gradle.kts Outdated
Comment thread buildSrc/src/main/kotlin/datadog.gradle-debug.gradle.kts Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thought: Maybe org.jetbrains.kotlin.gradle.dsl.KotlinCompile can be available by declaring the kotlin plugin (without applying it). E.g. something like

import org.jetbrains.kotlin.gradle.dsl.KotlinCompile

plugins {
  id ("org.jetbrains.kotlin.jvm") apply false
}

// ...

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

* Where:
Build file '/home/smola/go/src/github.com/DataDog/dd-trace-java/dd-smoke-tests/iast-propagation/build.gradle' line: 4

* What went wrong:
Error resolving plugin [id: 'org.jetbrains.kotlin.jvm', version: '1.9.24']
> The request for this plugin could not be satisfied because the plugin is already on the classpath with an unknown version, so compatibility cannot be checked.

At some point I gave up at trying to depend on the kotlin plugin classes from buildSrc.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, that's annoying, I need to take a look at this at some point to make it work.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the end I just removed kotlin support altogether, since it was just not working.

@smola smola force-pushed the smola/gradle-2-debug-plugin branch from 5681d91 to ce1c1eb Compare May 26, 2025 17:26
@smola smola requested a review from bric3 May 26, 2025 17:28
@smola smola enabled auto-merge (squash) May 27, 2025 06:43
@smola smola merged commit aea5035 into master May 27, 2025
523 of 525 checks passed
@smola smola deleted the smola/gradle-2-debug-plugin branch May 27, 2025 08:40
@github-actions github-actions Bot added this to the 1.50.0 milestone May 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants