Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

This feature was migrated to the modules under dd-java-agent/agent-otel #7292

Merged
merged 1 commit into from
Jul 9, 2024
Merged

This feature was migrated to the modules under dd-java-agent/agent-otel #7292

merged 1 commit into from
Jul 9, 2024

Conversation

mcculls
Copy link
Contributor

@mcculls mcculls commented Jul 8, 2024

No description provided.

@mcculls mcculls added tag: no release notes Changes to exclude from release notes type: refactoring labels Jul 8, 2024
@pr-commenter
Copy link

pr-commenter bot commented Jul 8, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/remove-old-poc
git_commit_date 1720432219 1720466223
git_commit_sha 5809b1d a753d4a
release_version 1.38.0-SNAPSHOT~5809b1ddc7 1.38.0-SNAPSHOT~a753d4aec3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1720468971 1720468971
ci_job_id 565715777 565715777
ci_pipeline_id 38626331 38626331
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1073603
Total [baseline] (10.372 s) : 0, 10372029
Agent [candidate] (1.065 s) : 0, 1064799
Total [candidate] (10.394 s) : 0, 10394209
section appsec
Agent [baseline] (1.182 s) : 0, 1181637
Total [baseline] (10.474 s) : 0, 10474352
Agent [candidate] (1.19 s) : 0, 1189999
Total [candidate] (10.543 s) : 0, 10543112
section iast
Agent [baseline] (1.174 s) : 0, 1173655
Total [baseline] (10.739 s) : 0, 10738962
Agent [candidate] (1.183 s) : 0, 1182752
Total [candidate] (10.712 s) : 0, 10711817
section profiling
Agent [baseline] (1.265 s) : 0, 1264661
Total [baseline] (10.59 s) : 0, 10589889
Agent [candidate] (1.265 s) : 0, 1265343
Total [candidate] (10.701 s) : 0, 10701425
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.182 s 108.035 ms (10.1%)
Agent iast 1.174 s 100.052 ms (9.3%)
Agent profiling 1.265 s 191.058 ms (17.8%)
Total tracing 10.372 s -
Total appsec 10.474 s 102.323 ms (1.0%)
Total iast 10.739 s 366.933 ms (3.5%)
Total profiling 10.59 s 217.86 ms (2.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.19 s 125.2 ms (11.8%)
Agent iast 1.183 s 117.953 ms (11.1%)
Agent profiling 1.265 s 200.544 ms (18.8%)
Total tracing 10.394 s -
Total appsec 10.543 s 148.903 ms (1.4%)
Total iast 10.712 s 317.608 ms (3.1%)
Total profiling 10.701 s 307.216 ms (3.0%) 
gantt
    title petclinic - break down per module: candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (671.959 ms) : 0, 671959
BytebuddyAgent [candidate] (666.268 ms) : 0, 666268
GlobalTracer [baseline] (307.812 ms) : 0, 307812
GlobalTracer [candidate] (305.471 ms) : 0, 305471
AppSec [baseline] (50.505 ms) : 0, 50505
AppSec [candidate] (50.056 ms) : 0, 50056
Remote Config [baseline] (680.151 µs) : 0, 680
Remote Config [candidate] (668.297 µs) : 0, 668
Telemetry [baseline] (7.686 ms) : 0, 7686
Telemetry [candidate] (7.654 ms) : 0, 7654
section appsec
BytebuddyAgent [baseline] (675.936 ms) : 0, 675936
BytebuddyAgent [candidate] (680.631 ms) : 0, 680631
GlobalTracer [baseline] (298.556 ms) : 0, 298556
GlobalTracer [candidate] (300.908 ms) : 0, 300908
AppSec [baseline] (153.811 ms) : 0, 153811
AppSec [candidate] (154.172 ms) : 0, 154172
Remote Config [baseline] (621.13 µs) : 0, 621
Remote Config [candidate] (623.934 µs) : 0, 624
Telemetry [baseline] (7.364 ms) : 0, 7364
Telemetry [candidate] (8.013 ms) : 0, 8013
IAST [baseline] (21.486 ms) : 0, 21486
IAST [candidate] (21.598 ms) : 0, 21598
section iast
BytebuddyAgent [baseline] (781.289 ms) : 0, 781289
BytebuddyAgent [candidate] (787.413 ms) : 0, 787413
GlobalTracer [baseline] (295.918 ms) : 0, 295918
GlobalTracer [candidate] (298.124 ms) : 0, 298124
AppSec [baseline] (47.412 ms) : 0, 47412
AppSec [candidate] (47.925 ms) : 0, 47925
Remote Config [baseline] (574.11 µs) : 0, 574
Remote Config [candidate] (570.968 µs) : 0, 571
Telemetry [baseline] (6.975 ms) : 0, 6975
Telemetry [candidate] (6.986 ms) : 0, 6986
IAST [baseline] (27.899 ms) : 0, 27899
IAST [candidate] (28.093 ms) : 0, 28093
section profiling
ProfilingAgent [baseline] (96.091 ms) : 0, 96091
ProfilingAgent [candidate] (96.542 ms) : 0, 96542
BytebuddyAgent [baseline] (662.863 ms) : 0, 662863
BytebuddyAgent [candidate] (662.692 ms) : 0, 662692
GlobalTracer [baseline] (388.815 ms) : 0, 388815
GlobalTracer [candidate] (389.113 ms) : 0, 389113
AppSec [baseline] (51.586 ms) : 0, 51586
AppSec [candidate] (51.868 ms) : 0, 51868
Remote Config [baseline] (660.433 µs) : 0, 660
Remote Config [candidate] (649.817 µs) : 0, 650
Telemetry [baseline] (7.384 ms) : 0, 7384
Telemetry [candidate] (7.374 ms) : 0, 7374
Profiling [baseline] (96.115 ms) : 0, 96115
Profiling [candidate] (96.567 ms) : 0, 96567
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062885
Total [baseline] (8.505 s) : 0, 8505396
Agent [candidate] (1.063 s) : 0, 1063014
Total [candidate] (8.511 s) : 0, 8511233
section iast
Agent [baseline] (1.17 s) : 0, 1170428
Total [baseline] (8.957 s) : 0, 8957278
Agent [candidate] (1.175 s) : 0, 1174864
Total [candidate] (8.948 s) : 0, 8947579
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1179712
Total [baseline] (8.96 s) : 0, 8960199
Agent [candidate] (1.178 s) : 0, 1177758
Total [candidate] (8.97 s) : 0, 8969791
section iast_TELEMETRY_OFF
Agent [baseline] (1.168 s) : 0, 1168288
Total [baseline] (8.988 s) : 0, 8987833
Agent [candidate] (1.166 s) : 0, 1165944
Total [candidate] (8.951 s) : 0, 8950695
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.17 s 107.544 ms (10.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 116.828 ms (11.0%)
Agent iast_TELEMETRY_OFF 1.168 s 105.403 ms (9.9%)
Total tracing 8.505 s -
Total iast 8.957 s 451.882 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.96 s 454.803 ms (5.3%)
Total iast_TELEMETRY_OFF 8.988 s 482.437 ms (5.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.175 s 111.85 ms (10.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 114.743 ms (10.8%)
Agent iast_TELEMETRY_OFF 1.166 s 102.93 ms (9.7%)
Total tracing 8.511 s -
Total iast 8.948 s 436.346 ms (5.1%)
Total iast_HARDCODED_SECRET_DISABLED 8.97 s 458.557 ms (5.4%)
Total iast_TELEMETRY_OFF 8.951 s 439.462 ms (5.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.837 ms) : 0, 664837
BytebuddyAgent [candidate] (665.282 ms) : 0, 665282
GlobalTracer [baseline] (305.124 ms) : 0, 305124
GlobalTracer [candidate] (304.877 ms) : 0, 304877
AppSec [baseline] (49.916 ms) : 0, 49916
AppSec [candidate] (50.019 ms) : 0, 50019
Remote Config [baseline] (669.008 µs) : 0, 669
Remote Config [candidate] (673.056 µs) : 0, 673
Telemetry [baseline] (7.618 ms) : 0, 7618
Telemetry [candidate] (7.617 ms) : 0, 7617
section iast
BytebuddyAgent [baseline] (780.324 ms) : 0, 780324
BytebuddyAgent [candidate] (781.945 ms) : 0, 781945
GlobalTracer [baseline] (295.176 ms) : 0, 295176
GlobalTracer [candidate] (296.104 ms) : 0, 296104
AppSec [baseline] (47.296 ms) : 0, 47296
AppSec [candidate] (47.325 ms) : 0, 47325
IAST [baseline] (26.526 ms) : 0, 26526
IAST [candidate] (28.474 ms) : 0, 28474
Remote Config [baseline] (578.324 µs) : 0, 578
Remote Config [candidate] (565.906 µs) : 0, 566
Telemetry [baseline] (7.011 ms) : 0, 7011
Telemetry [candidate] (6.937 ms) : 0, 6937
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (785.579 ms) : 0, 785579
BytebuddyAgent [candidate] (782.648 ms) : 0, 782648
GlobalTracer [baseline] (297.426 ms) : 0, 297426
GlobalTracer [candidate] (298.397 ms) : 0, 298397
AppSec [baseline] (47.943 ms) : 0, 47943
AppSec [candidate] (47.81 ms) : 0, 47810
IAST [baseline] (27.646 ms) : 0, 27646
IAST [candidate] (26.843 ms) : 0, 26843
Remote Config [baseline] (560.683 µs) : 0, 561
Remote Config [candidate] (591.414 µs) : 0, 591
Telemetry [baseline] (6.915 ms) : 0, 6915
Telemetry [candidate] (7.873 ms) : 0, 7873
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.474 ms) : 0, 777474
BytebuddyAgent [candidate] (776.298 ms) : 0, 776298
GlobalTracer [baseline] (295.701 ms) : 0, 295701
GlobalTracer [candidate] (295.196 ms) : 0, 295196
AppSec [baseline] (47.172 ms) : 0, 47172
AppSec [candidate] (46.941 ms) : 0, 46941
IAST [baseline] (26.957 ms) : 0, 26957
IAST [candidate] (26.636 ms) : 0, 26636
Remote Config [baseline] (604.175 µs) : 0, 604
Remote Config [candidate] (582.852 µs) : 0, 583
Telemetry [baseline] (6.857 ms) : 0, 6857
Telemetry [candidate] (6.799 ms) : 0, 6799
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-07-08T19:33:35 2024-07-08T19:40:23
git_branch master mcculls/remove-old-poc
git_commit_date 1720432219 1720466223
git_commit_sha 5809b1d a753d4a
release_version 1.38.0-SNAPSHOT~5809b1ddc7 1.38.0-SNAPSHOT~a753d4aec3
start_time 2024-07-08T19:33:22 2024-07-08T19:40:10
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1720467970 1720467970
ci_job_id 565715778 565715778
ci_pipeline_id 38626331 38626331
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+42.596µs; +96.520µs] or [+2.879%; +6.523%]		 unstable
[-815.246op/s; +341.172op/s] or [-25.476%; +10.662%]		 1.549ms 2962.963op/s 1.480ms 3200.000op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.33 ms) : 1311, 1350
.   : milestone, 1330,
appsec (1.732 ms) : 1708, 1756
.   : milestone, 1732,
appsec_no_iast (1.703 ms) : 1678, 1727
.   : milestone, 1703,
iast (1.487 ms) : 1464, 1510
.   : milestone, 1487,
profiling (1.48 ms) : 1455, 1504
.   : milestone, 1480,
tracing (1.48 ms) : 1455, 1505
.   : milestone, 1480,
section candidate
no_agent (1.341 ms) : 1321, 1362
.   : milestone, 1341,
appsec (1.729 ms) : 1705, 1753
.   : milestone, 1729,
appsec_no_iast (1.72 ms) : 1696, 1744
.   : milestone, 1720,
iast (1.471 ms) : 1448, 1494
.   : milestone, 1471,
profiling (1.549 ms) : 1524, 1575
.   : milestone, 1549,
tracing (1.498 ms) : 1472, 1524
.   : milestone, 1498,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.33 ms [1.311 ms, 1.35 ms] -
appsec 1.732 ms [1.708 ms, 1.756 ms] 401.606 µs (30.2%)
appsec_no_iast 1.703 ms [1.678 ms, 1.727 ms] 372.429 µs (28.0%)
iast 1.487 ms [1.464 ms, 1.51 ms] 156.838 µs (11.8%)
profiling 1.48 ms [1.455 ms, 1.504 ms] 149.352 µs (11.2%)
tracing 1.48 ms [1.455 ms, 1.505 ms] 149.719 µs (11.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.341 ms [1.321 ms, 1.362 ms] -
appsec 1.729 ms [1.705 ms, 1.753 ms] 387.563 µs (28.9%)
appsec_no_iast 1.72 ms [1.696 ms, 1.744 ms] 378.954 µs (28.3%)
iast 1.471 ms [1.448 ms, 1.494 ms] 129.403 µs (9.6%)
profiling 1.549 ms [1.524 ms, 1.575 ms] 207.84 µs (15.5%)
tracing 1.498 ms [1.472 ms, 1.524 ms] 156.28 µs (11.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.798 µs) : 351, 392
.   : milestone, 372,
iast (477.155 µs) : 456, 498
.   : milestone, 477,
iast_FULL (545.904 µs) : 525, 567
.   : milestone, 546,
iast_GLOBAL (507.252 µs) : 485, 530
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (474.335 µs) : 453, 495
.   : milestone, 474,
iast_INACTIVE (449.002 µs) : 428, 470
.   : milestone, 449,
iast_TELEMETRY_OFF (468.29 µs) : 447, 489
.   : milestone, 468,
tracing (439.907 µs) : 418, 462
.   : milestone, 440,
section candidate
no_agent (364.767 µs) : 345, 385
.   : milestone, 365,
iast (482.791 µs) : 462, 504
.   : milestone, 483,
iast_FULL (555.484 µs) : 534, 577
.   : milestone, 555,
iast_GLOBAL (513.499 µs) : 491, 536
.   : milestone, 513,
iast_HARDCODED_SECRET_DISABLED (473.075 µs) : 452, 494
.   : milestone, 473,
iast_INACTIVE (452.036 µs) : 431, 473
.   : milestone, 452,
iast_TELEMETRY_OFF (484.725 µs) : 463, 507
.   : milestone, 485,
tracing (437.463 µs) : 417, 458
.   : milestone, 437,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.798 µs [351.18 µs, 392.416 µs] -
iast 477.155 µs [456.206 µs, 498.104 µs] 105.357 µs (28.3%)
iast_FULL 545.904 µs [524.64 µs, 567.168 µs] 174.106 µs (46.8%)
iast_GLOBAL 507.252 µs [484.71 µs, 529.795 µs] 135.454 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 474.335 µs [453.433 µs, 495.238 µs] 102.537 µs (27.6%)
iast_INACTIVE 449.002 µs [427.544 µs, 470.46 µs] 77.204 µs (20.8%)
iast_TELEMETRY_OFF 468.29 µs [447.211 µs, 489.37 µs] 96.492 µs (26.0%)
tracing 439.907 µs [417.799 µs, 462.015 µs] 68.109 µs (18.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.767 µs [344.887 µs, 384.646 µs] -
iast 482.791 µs [461.513 µs, 504.069 µs] 118.024 µs (32.4%)
iast_FULL 555.484 µs [534.046 µs, 576.922 µs] 190.718 µs (52.3%)
iast_GLOBAL 513.499 µs [491.323 µs, 535.675 µs] 148.732 µs (40.8%)
iast_HARDCODED_SECRET_DISABLED 473.075 µs [452.218 µs, 493.932 µs] 108.309 µs (29.7%)
iast_INACTIVE 452.036 µs [430.596 µs, 473.476 µs] 87.269 µs (23.9%)
iast_TELEMETRY_OFF 484.725 µs [462.566 µs, 506.885 µs] 119.959 µs (32.9%)
tracing 437.463 µs [417.083 µs, 457.843 µs] 72.697 µs (19.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/remove-old-poc
git_commit_date 1720432219 1720466223
git_commit_sha 5809b1d a753d4a
release_version 1.38.0-SNAPSHOT~5809b1ddc7 1.38.0-SNAPSHOT~a753d4aec3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1720468489 1720468489
ci_job_id 565715779 565715779
ci_pipeline_id 38626331 38626331
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.451 ms) : 1439, 1462
.   : milestone, 1451,
appsec (2.209 ms) : 2175, 2244
.   : milestone, 2209,
iast (1.956 ms) : 1915, 1998
.   : milestone, 1956,
iast_GLOBAL (2.01 ms) : 1968, 2053
.   : milestone, 2010,
profiling (1.848 ms) : 1814, 1883
.   : milestone, 1848,
tracing (1.827 ms) : 1795, 1860
.   : milestone, 1827,
section candidate
no_agent (1.455 ms) : 1444, 1467
.   : milestone, 1455,
appsec (2.21 ms) : 2176, 2245
.   : milestone, 2210,
iast (1.964 ms) : 1922, 2006
.   : milestone, 1964,
iast_GLOBAL (2.014 ms) : 1972, 2056
.   : milestone, 2014,
profiling (1.86 ms) : 1825, 1896
.   : milestone, 1860,
tracing (1.827 ms) : 1794, 1860
.   : milestone, 1827,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.451 ms [1.439 ms, 1.462 ms] -
appsec 2.209 ms [2.175 ms, 2.244 ms] 758.37 µs (52.3%)
iast 1.956 ms [1.915 ms, 1.998 ms] 505.564 µs (34.8%)
iast_GLOBAL 2.01 ms [1.968 ms, 2.053 ms] 559.518 µs (38.6%)
profiling 1.848 ms [1.814 ms, 1.883 ms] 397.664 µs (27.4%)
tracing 1.827 ms [1.795 ms, 1.86 ms] 376.689 µs (26.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.455 ms [1.444 ms, 1.467 ms] -
appsec 2.21 ms [2.176 ms, 2.245 ms] 754.967 µs (51.9%)
iast 1.964 ms [1.922 ms, 2.006 ms] 508.759 µs (35.0%)
iast_GLOBAL 2.014 ms [1.972 ms, 2.056 ms] 558.621 µs (38.4%)
profiling 1.86 ms [1.825 ms, 1.896 ms] 404.881 µs (27.8%)
tracing 1.827 ms [1.794 ms, 1.86 ms] 371.504 µs (25.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~a753d4aec3, baseline=1.38.0-SNAPSHOT~5809b1ddc7
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.034 s) : 15034000, 15034000
.   : milestone, 15034000,
appsec (15.31 s) : 15310000, 15310000
.   : milestone, 15310000,
iast (18.832 s) : 18832000, 18832000
.   : milestone, 18832000,
iast_GLOBAL (17.984 s) : 17984000, 17984000
.   : milestone, 17984000,
profiling (15.303 s) : 15303000, 15303000
.   : milestone, 15303000,
tracing (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
section candidate
no_agent (15.533 s) : 15533000, 15533000
.   : milestone, 15533000,
appsec (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
iast (18.553 s) : 18553000, 18553000
.   : milestone, 18553000,
iast_GLOBAL (17.922 s) : 17922000, 17922000
.   : milestone, 17922000,
profiling (14.924 s) : 14924000, 14924000
.   : milestone, 14924000,
tracing (14.95 s) : 14950000, 14950000
.   : milestone, 14950000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.034 s [15.034 s, 15.034 s] -
appsec 15.31 s [15.31 s, 15.31 s] 276.0 ms (1.8%)
iast 18.832 s [18.832 s, 18.832 s] 3.798 s (25.3%)
iast_GLOBAL 17.984 s [17.984 s, 17.984 s] 2.95 s (19.6%)
profiling 15.303 s [15.303 s, 15.303 s] 269.0 ms (1.8%)
tracing 15.057 s [15.057 s, 15.057 s] 23.0 ms (0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.533 s [15.533 s, 15.533 s] -
appsec 15.054 s [15.054 s, 15.054 s] -479.0 ms (-3.1%)
iast 18.553 s [18.553 s, 18.553 s] 3.02 s (19.4%)
iast_GLOBAL 17.922 s [17.922 s, 17.922 s] 2.389 s (15.4%)
profiling 14.924 s [14.924 s, 14.924 s] -609.0 ms (-3.9%)
tracing 14.95 s [14.95 s, 14.95 s] -583.0 ms (-3.8%)

@mcculls mcculls marked this pull request as ready for review July 8, 2024 20:28
@mcculls mcculls requested review from a team as code owners July 8, 2024 20:28
@mcculls mcculls enabled auto-merge (squash) July 8, 2024 20:29
PerfectSlayer
PerfectSlayer approved these changes Jul 9, 2024
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Goodbye old friend POC 👋

@mcculls mcculls merged commit 294b617 into master Jul 9, 2024
84 checks passed
@mcculls mcculls deleted the mcculls/remove-old-poc branch July 9, 2024 09:44
@github-actions github-actions bot added this to the 1.38.0 milestone Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
tag: no release notes Changes to exclude from release notes type: refactoring
Projects
None yet
Milestone
1.38.0
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@mcculls @PerfectSlayer