Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade to ddprof 1.5.0 #6978

Merged
merged 1 commit into from
May 1, 2024
Merged

Upgrade to ddprof 1.5.0 #6978

merged 1 commit into from
May 1, 2024

Conversation

richardstartin
Copy link
Member

What Does This Do

Motivation

Additional Notes

Jira ticket: [PROJ-IDENT]

@richardstartin richardstartin added the comp: profiling Profiling label May 1, 2024
@richardstartin richardstartin requested a review from a team May 1, 2024 13:38
@pr-commenter
Copy link

pr-commenter bot commented May 1, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master rgs/upgrade-ddprof-1.5.0
git_commit_date 1714566266 1714570655
git_commit_sha 860baa9 49898aa
release_version 1.34.0-SNAPSHOT~860baa900b 1.34.0-SNAPSHOT~49898aa62c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1714573308 1714573308
ci_job_id 501633322 501633322
ci_pipeline_id 33334963 33334963
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076088
Total [baseline] (8.563 s) : 0, 8563462
Agent [candidate] (1.078 s) : 0, 1077619
Total [candidate] (8.532 s) : 0, 8532030
section iast
Agent [baseline] (1.206 s) : 0, 1206049
Total [baseline] (9.016 s) : 0, 9015782
Agent [candidate] (1.206 s) : 0, 1205994
Total [candidate] (8.99 s) : 0, 8989607
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.201 s) : 0, 1201167
Total [baseline] (8.955 s) : 0, 8954919
Agent [candidate] (1.21 s) : 0, 1210277
Total [candidate] (8.992 s) : 0, 8991582
section iast_TELEMETRY_OFF
Agent [baseline] (1.195 s) : 0, 1195170
Total [baseline] (9.023 s) : 0, 9022898
Agent [candidate] (1.203 s) : 0, 1202898
Total [candidate] (9.1 s) : 0, 9100131
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent iast 1.206 s 129.961 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.201 s 125.079 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.195 s 119.082 ms (11.1%)
Total tracing 8.563 s -
Total iast 9.016 s 452.319 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.955 s 391.457 ms (4.6%)
Total iast_TELEMETRY_OFF 9.023 s 459.436 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent iast 1.206 s 128.375 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.21 s 132.659 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.203 s 125.28 ms (11.6%)
Total tracing 8.532 s -
Total iast 8.99 s 457.577 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 8.992 s 459.552 ms (5.4%)
Total iast_TELEMETRY_OFF 9.1 s 568.101 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (674.122 ms) : 0, 674122
BytebuddyAgent [candidate] (674.799 ms) : 0, 674799
GlobalTracer [baseline] (309.808 ms) : 0, 309808
GlobalTracer [candidate] (310.585 ms) : 0, 310585
AppSec [baseline] (49.405 ms) : 0, 49405
AppSec [candidate] (49.45 ms) : 0, 49450
Remote Config [baseline] (659.652 µs) : 0, 660
Remote Config [candidate] (661.322 µs) : 0, 661
Telemetry [baseline] (7.596 ms) : 0, 7596
Telemetry [candidate] (7.575 ms) : 0, 7575
section iast
BytebuddyAgent [baseline] (800.239 ms) : 0, 800239
BytebuddyAgent [candidate] (799.854 ms) : 0, 799854
GlobalTracer [baseline] (289.747 ms) : 0, 289747
GlobalTracer [candidate] (289.885 ms) : 0, 289885
AppSec [baseline] (52.938 ms) : 0, 52938
AppSec [candidate] (50.652 ms) : 0, 50652
Remote Config [baseline] (559.153 µs) : 0, 559
Remote Config [candidate] (582.916 µs) : 0, 583
Telemetry [baseline] (6.565 ms) : 0, 6565
Telemetry [candidate] (6.707 ms) : 0, 6707
IAST [baseline] (21.44 ms) : 0, 21440
IAST [candidate] (23.678 ms) : 0, 23678
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (795.809 ms) : 0, 795809
BytebuddyAgent [candidate] (801.455 ms) : 0, 801455
GlobalTracer [baseline] (288.601 ms) : 0, 288601
GlobalTracer [candidate] (290.752 ms) : 0, 290752
AppSec [baseline] (51.231 ms) : 0, 51231
AppSec [candidate] (50.853 ms) : 0, 50853
Remote Config [baseline] (1.295 ms) : 0, 1295
Remote Config [candidate] (2.046 ms) : 0, 2046
Telemetry [baseline] (6.6 ms) : 0, 6600
Telemetry [candidate] (6.768 ms) : 0, 6768
IAST [baseline] (23.129 ms) : 0, 23129
IAST [candidate] (23.716 ms) : 0, 23716
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (791.121 ms) : 0, 791121
BytebuddyAgent [candidate] (796.107 ms) : 0, 796107
GlobalTracer [baseline] (287.899 ms) : 0, 287899
GlobalTracer [candidate] (288.995 ms) : 0, 288995
AppSec [baseline] (51.225 ms) : 0, 51225
AppSec [candidate] (50.186 ms) : 0, 50186
Remote Config [baseline] (574.609 µs) : 0, 575
Remote Config [candidate] (591.276 µs) : 0, 591
Telemetry [baseline] (8.049 ms) : 0, 8049
Telemetry [candidate] (7.395 ms) : 0, 7395
IAST [baseline] (22.02 ms) : 0, 22020
IAST [candidate] (25.066 ms) : 0, 25066
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1074652
Total [baseline] (10.409 s) : 0, 10408593
Agent [candidate] (1.078 s) : 0, 1077870
Total [candidate] (10.462 s) : 0, 10461917
section appsec
Agent [baseline] (1.191 s) : 0, 1191250
Total [baseline] (10.481 s) : 0, 10481053
Agent [candidate] (1.19 s) : 0, 1189712
Total [candidate] (10.439 s) : 0, 10439315
section iast
Agent [baseline] (1.203 s) : 0, 1202620
Total [baseline] (10.831 s) : 0, 10830639
Agent [candidate] (1.22 s) : 0, 1219593
Total [candidate] (10.917 s) : 0, 10916834
section profiling
Agent [baseline] (1.277 s) : 0, 1276612
Total [baseline] (10.601 s) : 0, 10600787
Agent [candidate] (1.277 s) : 0, 1277448
Total [candidate] (10.653 s) : 0, 10652914
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent appsec 1.191 s 116.598 ms (10.8%)
Agent iast 1.203 s 127.968 ms (11.9%)
Agent profiling 1.277 s 201.959 ms (18.8%)
Total tracing 10.409 s -
Total appsec 10.481 s 72.46 ms (0.7%)
Total iast 10.831 s 422.046 ms (4.1%)
Total profiling 10.601 s 192.194 ms (1.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent appsec 1.19 s 111.842 ms (10.4%)
Agent iast 1.22 s 141.723 ms (13.1%)
Agent profiling 1.277 s 199.578 ms (18.5%)
Total tracing 10.462 s -
Total appsec 10.439 s -22.603 ms (-0.2%)
Total iast 10.917 s 454.917 ms (4.3%)
Total profiling 10.653 s 190.997 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (673.286 ms) : 0, 673286
BytebuddyAgent [candidate] (675.035 ms) : 0, 675035
GlobalTracer [baseline] (309.426 ms) : 0, 309426
GlobalTracer [candidate] (310.767 ms) : 0, 310767
AppSec [baseline] (49.29 ms) : 0, 49290
AppSec [candidate] (49.397 ms) : 0, 49397
Remote Config [baseline] (659.425 µs) : 0, 659
Remote Config [candidate] (657.535 µs) : 0, 658
Telemetry [baseline] (7.627 ms) : 0, 7627
Telemetry [candidate] (7.59 ms) : 0, 7590
section appsec
BytebuddyAgent [baseline] (696.76 ms) : 0, 696760
BytebuddyAgent [candidate] (695.507 ms) : 0, 695507
GlobalTracer [baseline] (291.961 ms) : 0, 291961
GlobalTracer [candidate] (291.907 ms) : 0, 291907
AppSec [baseline] (149.064 ms) : 0, 149064
AppSec [candidate] (148.913 ms) : 0, 148913
Remote Config [baseline] (621.736 µs) : 0, 622
Remote Config [candidate] (623.078 µs) : 0, 623
Telemetry [baseline] (8.782 ms) : 0, 8782
Telemetry [candidate] (8.765 ms) : 0, 8765
IAST [baseline] (19.235 ms) : 0, 19235
IAST [candidate] (19.231 ms) : 0, 19231
section iast
BytebuddyAgent [baseline] (796.65 ms) : 0, 796650
BytebuddyAgent [candidate] (807.444 ms) : 0, 807444
GlobalTracer [baseline] (288.858 ms) : 0, 288858
GlobalTracer [candidate] (293.751 ms) : 0, 293751
AppSec [baseline] (50.43 ms) : 0, 50430
AppSec [candidate] (50.989 ms) : 0, 50989
Remote Config [baseline] (578.723 µs) : 0, 579
Remote Config [candidate] (580.228 µs) : 0, 580
Telemetry [baseline] (7.365 ms) : 0, 7365
Telemetry [candidate] (6.702 ms) : 0, 6702
IAST [baseline] (24.261 ms) : 0, 24261
IAST [candidate] (25.277 ms) : 0, 25277
section profiling
BytebuddyAgent [baseline] (682.433 ms) : 0, 682433
BytebuddyAgent [candidate] (682.392 ms) : 0, 682392
GlobalTracer [baseline] (382.598 ms) : 0, 382598
GlobalTracer [candidate] (382.862 ms) : 0, 382862
AppSec [baseline] (50.812 ms) : 0, 50812
AppSec [candidate] (50.682 ms) : 0, 50682
Remote Config [baseline] (717.996 µs) : 0, 718
Remote Config [candidate] (709.714 µs) : 0, 710
Telemetry [baseline] (7.424 ms) : 0, 7424
Telemetry [candidate] (7.56 ms) : 0, 7560
ProfilingAgent [baseline] (95.779 ms) : 0, 95779
ProfilingAgent [candidate] (96.735 ms) : 0, 96735
Profiling [baseline] (95.802 ms) : 0, 95802
Profiling [candidate] (96.759 ms) : 0, 96759

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-05-01T13:52:38 2024-05-01T13:59:27
git_branch master rgs/upgrade-ddprof-1.5.0
git_commit_date 1714566266 1714570655
git_commit_sha 860baa9 49898aa
release_version 1.34.0-SNAPSHOT~860baa900b 1.34.0-SNAPSHOT~49898aa62c
start_time 2024-05-01T13:52:24 2024-05-01T13:59:14
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1714572312 1714572312
ci_job_id 501633323 501633323
ci_pipeline_id 33334963 33334963
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+42.978µs; +96.283µs] or [+2.872%; +6.434%]		 unstable
[-670.744op/s; +442.824op/s] or [-21.799%; +14.392%]		 1.566ms 2962.963op/s 1.496ms 3076.923op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.243 µs) : 352, 391
.   : milestone, 371,
iast (481.305 µs) : 459, 503
.   : milestone, 481,
iast_FULL (539.298 µs) : 518, 560
.   : milestone, 539,
iast_GLOBAL (503.921 µs) : 483, 525
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (473.324 µs) : 452, 495
.   : milestone, 473,
iast_INACTIVE (449.966 µs) : 429, 471
.   : milestone, 450,
iast_TELEMETRY_OFF (477.815 µs) : 456, 500
.   : milestone, 478,
tracing (442.123 µs) : 421, 463
.   : milestone, 442,
section candidate
no_agent (367.714 µs) : 347, 388
.   : milestone, 368,
iast (474.021 µs) : 453, 495
.   : milestone, 474,
iast_FULL (541.172 µs) : 521, 562
.   : milestone, 541,
iast_GLOBAL (491.365 µs) : 471, 512
.   : milestone, 491,
iast_HARDCODED_SECRET_DISABLED (474.103 µs) : 452, 496
.   : milestone, 474,
iast_INACTIVE (454.492 µs) : 433, 476
.   : milestone, 454,
iast_TELEMETRY_OFF (469.919 µs) : 449, 491
.   : milestone, 470,
tracing (445.555 µs) : 425, 466
.   : milestone, 446,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.243 µs [351.777 µs, 390.709 µs] -
iast 481.305 µs [459.216 µs, 503.394 µs] 110.062 µs (29.6%)
iast_FULL 539.298 µs [518.396 µs, 560.2 µs] 168.055 µs (45.3%)
iast_GLOBAL 503.921 µs [483.088 µs, 524.754 µs] 132.678 µs (35.7%)
iast_HARDCODED_SECRET_DISABLED 473.324 µs [451.818 µs, 494.831 µs] 102.081 µs (27.5%)
iast_INACTIVE 449.966 µs [429.099 µs, 470.833 µs] 78.723 µs (21.2%)
iast_TELEMETRY_OFF 477.815 µs [455.829 µs, 499.801 µs] 106.572 µs (28.7%)
tracing 442.123 µs [421.351 µs, 462.896 µs] 70.88 µs (19.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 367.714 µs [347.211 µs, 388.217 µs] -
iast 474.021 µs [453.182 µs, 494.86 µs] 106.307 µs (28.9%)
iast_FULL 541.172 µs [520.554 µs, 561.79 µs] 173.458 µs (47.2%)
iast_GLOBAL 491.365 µs [471.134 µs, 511.596 µs] 123.651 µs (33.6%)
iast_HARDCODED_SECRET_DISABLED 474.103 µs [452.497 µs, 495.71 µs] 106.389 µs (28.9%)
iast_INACTIVE 454.492 µs [433.228 µs, 475.756 µs] 86.778 µs (23.6%)
iast_TELEMETRY_OFF 469.919 µs [448.519 µs, 491.318 µs] 102.205 µs (27.8%)
tracing 445.555 µs [425.199 µs, 465.91 µs] 77.841 µs (21.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.36 ms) : 1340, 1380
.   : milestone, 1360,
appsec (1.71 ms) : 1685, 1735
.   : milestone, 1710,
appsec_no_iast (1.724 ms) : 1701, 1748
.   : milestone, 1724,
iast (1.484 ms) : 1461, 1507
.   : milestone, 1484,
profiling (1.496 ms) : 1472, 1521
.   : milestone, 1496,
tracing (1.487 ms) : 1461, 1512
.   : milestone, 1487,
section candidate
no_agent (1.326 ms) : 1307, 1345
.   : milestone, 1326,
appsec (1.719 ms) : 1695, 1743
.   : milestone, 1719,
appsec_no_iast (1.731 ms) : 1707, 1754
.   : milestone, 1731,
iast (1.487 ms) : 1464, 1511
.   : milestone, 1487,
profiling (1.566 ms) : 1541, 1591
.   : milestone, 1566,
tracing (1.47 ms) : 1447, 1493
.   : milestone, 1470,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.36 ms [1.34 ms, 1.38 ms] -
appsec 1.71 ms [1.685 ms, 1.735 ms] 350.241 µs (25.8%)
appsec_no_iast 1.724 ms [1.701 ms, 1.748 ms] 364.564 µs (26.8%)
iast 1.484 ms [1.461 ms, 1.507 ms] 124.414 µs (9.1%)
profiling 1.496 ms [1.472 ms, 1.521 ms] 136.742 µs (10.1%)
tracing 1.487 ms [1.461 ms, 1.512 ms] 126.925 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.326 ms [1.307 ms, 1.345 ms] -
appsec 1.719 ms [1.695 ms, 1.743 ms] 393.673 µs (29.7%)
appsec_no_iast 1.731 ms [1.707 ms, 1.754 ms] 405.167 µs (30.6%)
iast 1.487 ms [1.464 ms, 1.511 ms] 161.78 µs (12.2%)
profiling 1.566 ms [1.541 ms, 1.591 ms] 240.552 µs (18.1%)
tracing 1.47 ms [1.447 ms, 1.493 ms] 144.253 µs (10.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master rgs/upgrade-ddprof-1.5.0
git_commit_date 1714566266 1714570655
git_commit_sha 860baa9 49898aa
release_version 1.34.0-SNAPSHOT~860baa900b 1.34.0-SNAPSHOT~49898aa62c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1714572827 1714572827
ci_job_id 501633324 501633324
ci_pipeline_id 33334963 33334963
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.218 ms) : 2184, 2252
.   : milestone, 2218,
iast (1.899 ms) : 1864, 1935
.   : milestone, 1899,
iast_GLOBAL (1.939 ms) : 1902, 1975
.   : milestone, 1939,
profiling (1.859 ms) : 1825, 1892
.   : milestone, 1859,
tracing (1.844 ms) : 1812, 1876
.   : milestone, 1844,
section candidate
no_agent (1.463 ms) : 1452, 1474
.   : milestone, 1463,
appsec (2.197 ms) : 2164, 2231
.   : milestone, 2197,
iast (1.896 ms) : 1861, 1931
.   : milestone, 1896,
iast_GLOBAL (1.941 ms) : 1905, 1976
.   : milestone, 1941,
profiling (1.857 ms) : 1824, 1891
.   : milestone, 1857,
tracing (1.844 ms) : 1812, 1876
.   : milestone, 1844,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.218 ms [2.184 ms, 2.252 ms] 746.231 µs (50.7%)
iast 1.899 ms [1.864 ms, 1.935 ms] 427.175 µs (29.0%)
iast_GLOBAL 1.939 ms [1.902 ms, 1.975 ms] 466.67 µs (31.7%)
profiling 1.859 ms [1.825 ms, 1.892 ms] 386.43 µs (26.2%)
tracing 1.844 ms [1.812 ms, 1.876 ms] 371.897 µs (25.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.452 ms, 1.474 ms] -
appsec 2.197 ms [2.164 ms, 2.231 ms] 734.591 µs (50.2%)
iast 1.896 ms [1.861 ms, 1.931 ms] 433.02 µs (29.6%)
iast_GLOBAL 1.941 ms [1.905 ms, 1.976 ms] 477.802 µs (32.7%)
profiling 1.857 ms [1.824 ms, 1.891 ms] 394.587 µs (27.0%)
tracing 1.844 ms [1.812 ms, 1.876 ms] 381.005 µs (26.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~49898aa62c, baseline=1.34.0-SNAPSHOT~860baa900b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.019 s) : 15019000, 15019000
.   : milestone, 15019000,
appsec (15.045 s) : 15045000, 15045000
.   : milestone, 15045000,
iast (19.031 s) : 19031000, 19031000
.   : milestone, 19031000,
iast_GLOBAL (17.916 s) : 17916000, 17916000
.   : milestone, 17916000,
profiling (15.062 s) : 15062000, 15062000
.   : milestone, 15062000,
tracing (15.115 s) : 15115000, 15115000
.   : milestone, 15115000,
section candidate
no_agent (14.891 s) : 14891000, 14891000
.   : milestone, 14891000,
appsec (14.953 s) : 14953000, 14953000
.   : milestone, 14953000,
iast (18.912 s) : 18912000, 18912000
.   : milestone, 18912000,
iast_GLOBAL (17.958 s) : 17958000, 17958000
.   : milestone, 17958000,
profiling (15.933 s) : 15933000, 15933000
.   : milestone, 15933000,
tracing (15.403 s) : 15403000, 15403000
.   : milestone, 15403000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.019 s [15.019 s, 15.019 s] -
appsec 15.045 s [15.045 s, 15.045 s] 26.0 ms (0.2%)
iast 19.031 s [19.031 s, 19.031 s] 4.012 s (26.7%)
iast_GLOBAL 17.916 s [17.916 s, 17.916 s] 2.897 s (19.3%)
profiling 15.062 s [15.062 s, 15.062 s] 43.0 ms (0.3%)
tracing 15.115 s [15.115 s, 15.115 s] 96.0 ms (0.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.891 s [14.891 s, 14.891 s] -
appsec 14.953 s [14.953 s, 14.953 s] 62.0 ms (0.4%)
iast 18.912 s [18.912 s, 18.912 s] 4.021 s (27.0%)
iast_GLOBAL 17.958 s [17.958 s, 17.958 s] 3.067 s (20.6%)
profiling 15.933 s [15.933 s, 15.933 s] 1.042 s (7.0%)
tracing 15.403 s [15.403 s, 15.403 s] 512.0 ms (3.4%)

@richardstartin richardstartin marked this pull request as ready for review May 1, 2024 15:30
@richardstartin richardstartin requested a review from a team as a code owner May 1, 2024 15:30
@richardstartin richardstartin merged commit 16ea849 into master May 1, 2024
82 checks passed
@richardstartin richardstartin deleted the rgs/upgrade-ddprof-1.5.0 branch May 1, 2024 16:46
@github-actions github-actions bot added this to the 1.34.0 milestone May 1, 2024
@PerfectSlayer PerfectSlayer added the tag: dependencies Dependencies related changes label May 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jbachorik jbachorik jbachorik approved these changes

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer PerfectSlayer is a code owner automatically assigned from DataDog/apm-java

@nayeem-kamal nayeem-kamal Awaiting requested review from nayeem-kamal nayeem-kamal is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: profiling Profiling tag: dependencies Dependencies related changes
Projects
None yet
Milestone
1.34.0
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@richardstartin @jbachorik @PerfectSlayer