Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix GitLab deployment to Sonatype #7212

Merged
merged 1 commit into from
Jun 18, 2024
Merged

Conversation

mcculls
Copy link
Contributor

@mcculls mcculls commented Jun 18, 2024

Backport of #7211 for v1.35.2

@mcculls mcculls added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jun 18, 2024
@mcculls mcculls added this to the 1.35.2 milestone Jun 18, 2024
@mcculls mcculls requested a review from a team as a code owner June 18, 2024 10:13
@pr-commenter
Copy link

pr-commenter bot commented Jun 18, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/ci-gitlab-v1.35.2
git_commit_date 1718631246 1718705504
git_commit_sha 5cf2f32 656475e
release_version 1.36.0-SNAPSHOT~5cf2f32aa9 1.36.0-SNAPSHOT~656475ea6b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718708505 1718708505
ci_job_id 546315907 546315907
ci_pipeline_id 36990375 36990375
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 48 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config worse
[+37.350µs; +85.890µs] or [+5.474%; +12.588%]
743.955µs 682.335µs
scenario:startup:petclinic:profiling:Remote Config worse
[+22.741µs; +71.280µs] or [+3.090%; +9.687%]
782.856µs 735.846µs
scenario:startup:petclinic:tracing:Remote Config worse
[+44.758µs; +89.401µs] or [+6.521%; +13.026%]
753.411µs 686.331µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061226
Total [baseline] (10.304 s) : 0, 10303622
Agent [candidate] (1.06 s) : 0, 1060452
Total [candidate] (10.373 s) : 0, 10373178
section appsec
Agent [baseline] (1.193 s) : 0, 1192967
Total [baseline] (10.45 s) : 0, 10449775
Agent [candidate] (1.181 s) : 0, 1180828
Total [candidate] (10.418 s) : 0, 10417811
section iast
Agent [baseline] (1.179 s) : 0, 1178841
Total [baseline] (10.705 s) : 0, 10705114
Agent [candidate] (1.179 s) : 0, 1179445
Total [candidate] (10.662 s) : 0, 10662468
section profiling
Agent [baseline] (1.26 s) : 0, 1260120
Total [baseline] (10.612 s) : 0, 10611848
Agent [candidate] (1.262 s) : 0, 1262340
Total [candidate] (10.611 s) : 0, 10610729
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.193 s 131.741 ms (12.4%)
Agent iast 1.179 s 117.615 ms (11.1%)
Agent profiling 1.26 s 198.895 ms (18.7%)
Total tracing 10.304 s -
Total appsec 10.45 s 146.153 ms (1.4%)
Total iast 10.705 s 401.493 ms (3.9%)
Total profiling 10.612 s 308.226 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.181 s 120.376 ms (11.4%)
Agent iast 1.179 s 118.993 ms (11.2%)
Agent profiling 1.262 s 201.889 ms (19.0%)
Total tracing 10.373 s -
Total appsec 10.418 s 44.633 ms (0.4%)
Total iast 10.662 s 289.29 ms (2.8%)
Total profiling 10.611 s 237.551 ms (2.3%)
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (665.009 ms) : 0, 665009
BytebuddyAgent [candidate] (664.251 ms) : 0, 664251
GlobalTracer [baseline] (303.33 ms) : 0, 303330
GlobalTracer [candidate] (303.376 ms) : 0, 303376
AppSec [baseline] (50.066 ms) : 0, 50066
AppSec [candidate] (50.255 ms) : 0, 50255
Remote Config [baseline] (686.331 µs) : 0, 686
Remote Config [candidate] (753.411 µs) : 0, 753
Telemetry [baseline] (7.668 ms) : 0, 7668
Telemetry [candidate] (7.492 ms) : 0, 7492
section appsec
BytebuddyAgent [baseline] (683.116 ms) : 0, 683116
BytebuddyAgent [candidate] (676.633 ms) : 0, 676633
GlobalTracer [baseline] (299.927 ms) : 0, 299927
GlobalTracer [candidate] (296.518 ms) : 0, 296518
AppSec [baseline] (154.689 ms) : 0, 154689
AppSec [candidate] (152.568 ms) : 0, 152568
Remote Config [baseline] (650.621 µs) : 0, 651
Remote Config [candidate] (677.21 µs) : 0, 677
Telemetry [baseline] (9.507 ms) : 0, 9507
Telemetry [candidate] (8.125 ms) : 0, 8125
IAST [baseline] (20.528 ms) : 0, 20528
IAST [candidate] (23.533 ms) : 0, 23533
section iast
BytebuddyAgent [baseline] (785.968 ms) : 0, 785968
BytebuddyAgent [candidate] (787.061 ms) : 0, 787061
GlobalTracer [baseline] (295.603 ms) : 0, 295603
GlobalTracer [candidate] (296.537 ms) : 0, 296537
AppSec [baseline] (47.478 ms) : 0, 47478
AppSec [candidate] (47.654 ms) : 0, 47654
Remote Config [baseline] (598.013 µs) : 0, 598
Remote Config [candidate] (598.114 µs) : 0, 598
Telemetry [baseline] (6.982 ms) : 0, 6982
Telemetry [candidate] (7.695 ms) : 0, 7695
IAST [baseline] (28.815 ms) : 0, 28815
IAST [candidate] (26.45 ms) : 0, 26450
section profiling
ProfilingAgent [baseline] (95.539 ms) : 0, 95539
ProfilingAgent [candidate] (96.224 ms) : 0, 96224
BytebuddyAgent [baseline] (663.007 ms) : 0, 663007
BytebuddyAgent [candidate] (663.581 ms) : 0, 663581
GlobalTracer [baseline] (385.304 ms) : 0, 385304
GlobalTracer [candidate] (386.084 ms) : 0, 386084
AppSec [baseline] (51.193 ms) : 0, 51193
AppSec [candidate] (51.235 ms) : 0, 51235
Remote Config [baseline] (735.846 µs) : 0, 736
Remote Config [candidate] (782.856 µs) : 0, 783
Telemetry [baseline] (7.345 ms) : 0, 7345
Telemetry [candidate] (7.344 ms) : 0, 7344
Profiling [baseline] (95.563 ms) : 0, 95563
Profiling [candidate] (96.249 ms) : 0, 96249
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059772
Total [baseline] (8.535 s) : 0, 8535113
Agent [candidate] (1.068 s) : 0, 1068385
Total [candidate] (8.544 s) : 0, 8543692
section iast
Agent [baseline] (1.166 s) : 0, 1165860
Total [baseline] (8.981 s) : 0, 8980730
Agent [candidate] (1.177 s) : 0, 1177404
Total [candidate] (8.995 s) : 0, 8994646
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.169 s) : 0, 1168709
Total [baseline] (8.97 s) : 0, 8969539
Agent [candidate] (1.167 s) : 0, 1166895
Total [candidate] (8.972 s) : 0, 8972201
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1166275
Total [baseline] (8.964 s) : 0, 8964408
Agent [candidate] (1.166 s) : 0, 1165926
Total [candidate] (9.003 s) : 0, 9003250
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.166 s 106.088 ms (10.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.169 s 108.937 ms (10.3%)
Agent iast_TELEMETRY_OFF 1.166 s 106.503 ms (10.0%)
Total tracing 8.535 s -
Total iast 8.981 s 445.618 ms (5.2%)
Total iast_HARDCODED_SECRET_DISABLED 8.97 s 434.426 ms (5.1%)
Total iast_TELEMETRY_OFF 8.964 s 429.296 ms (5.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.177 s 109.019 ms (10.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.167 s 98.51 ms (9.2%)
Agent iast_TELEMETRY_OFF 1.166 s 97.541 ms (9.1%)
Total tracing 8.544 s -
Total iast 8.995 s 450.953 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.972 s 428.509 ms (5.0%)
Total iast_TELEMETRY_OFF 9.003 s 459.558 ms (5.4%)
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.628 ms) : 0, 664628
BytebuddyAgent [candidate] (669.502 ms) : 0, 669502
GlobalTracer [baseline] (302.64 ms) : 0, 302640
GlobalTracer [candidate] (305.721 ms) : 0, 305721
AppSec [baseline] (49.985 ms) : 0, 49985
AppSec [candidate] (50.254 ms) : 0, 50254
Remote Config [baseline] (682.335 µs) : 0, 682
Remote Config [candidate] (743.955 µs) : 0, 744
Telemetry [baseline] (7.542 ms) : 0, 7542
Telemetry [candidate] (7.529 ms) : 0, 7529
section iast
BytebuddyAgent [baseline] (778.196 ms) : 0, 778196
BytebuddyAgent [candidate] (784.911 ms) : 0, 784911
GlobalTracer [baseline] (292.897 ms) : 0, 292897
GlobalTracer [candidate] (295.485 ms) : 0, 295485
AppSec [baseline] (46.742 ms) : 0, 46742
AppSec [candidate] (47.374 ms) : 0, 47374
IAST [baseline] (27.162 ms) : 0, 27162
IAST [candidate] (28.041 ms) : 0, 28041
Remote Config [baseline] (637.708 µs) : 0, 638
Remote Config [candidate] (574.657 µs) : 0, 575
Telemetry [baseline] (6.963 ms) : 0, 6963
Telemetry [candidate] (7.639 ms) : 0, 7639
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.062 ms) : 0, 780062
BytebuddyAgent [candidate] (778.63 ms) : 0, 778630
GlobalTracer [baseline] (293.26 ms) : 0, 293260
GlobalTracer [candidate] (293.523 ms) : 0, 293523
AppSec [baseline] (47.148 ms) : 0, 47148
AppSec [candidate] (46.67 ms) : 0, 46670
IAST [baseline] (27.268 ms) : 0, 27268
IAST [candidate] (26.412 ms) : 0, 26412
Remote Config [baseline] (641.148 µs) : 0, 641
Remote Config [candidate] (589.827 µs) : 0, 590
Telemetry [baseline] (6.984 ms) : 0, 6984
Telemetry [candidate] (7.719 ms) : 0, 7719
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (776.943 ms) : 0, 776943
BytebuddyAgent [candidate] (775.977 ms) : 0, 775977
GlobalTracer [baseline] (293.215 ms) : 0, 293215
GlobalTracer [candidate] (294.752 ms) : 0, 294752
AppSec [baseline] (46.982 ms) : 0, 46982
AppSec [candidate] (48.306 ms) : 0, 48306
IAST [baseline] (28.474 ms) : 0, 28474
IAST [candidate] (26.162 ms) : 0, 26162
Remote Config [baseline] (583.793 µs) : 0, 584
Remote Config [candidate] (594.299 µs) : 0, 594
Telemetry [baseline] (6.779 ms) : 0, 6779
Telemetry [candidate] (6.843 ms) : 0, 6843
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-18T10:32:38 2024-06-18T10:39:27
git_branch master mcculls/ci-gitlab-v1.35.2
git_commit_date 1718631246 1718705504
git_commit_sha 5cf2f32 656475e
release_version 1.36.0-SNAPSHOT~5cf2f32aa9 1.36.0-SNAPSHOT~656475ea6b
start_time 2024-06-18T10:32:25 2024-06-18T10:39:14
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718707513 1718707513
ci_job_id 546315908 546315908
ci_pipeline_id 36990375 36990375
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+33.282µs; +87.361µs] or [+2.253%; +5.913%]
unstable
[-594.780op/s; +594.780op/s] or [-19.330%; +19.330%]
1.538ms 3076.923op/s 1.477ms 3076.923op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.465 µs) : 349, 388
.   : milestone, 368,
iast (483.243 µs) : 462, 505
.   : milestone, 483,
iast_FULL (554.124 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (503.457 µs) : 482, 525
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (479.229 µs) : 458, 500
.   : milestone, 479,
iast_INACTIVE (451.403 µs) : 430, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (475.547 µs) : 454, 497
.   : milestone, 476,
tracing (444.458 µs) : 423, 466
.   : milestone, 444,
section candidate
no_agent (366.154 µs) : 346, 386
.   : milestone, 366,
iast (485.355 µs) : 464, 506
.   : milestone, 485,
iast_FULL (545.442 µs) : 524, 567
.   : milestone, 545,
iast_GLOBAL (511.635 µs) : 490, 533
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (481.091 µs) : 460, 502
.   : milestone, 481,
iast_INACTIVE (453.232 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (470.873 µs) : 449, 492
.   : milestone, 471,
tracing (445.928 µs) : 425, 467
.   : milestone, 446,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.465 µs [349.159 µs, 387.77 µs] -
iast 483.243 µs [461.764 µs, 504.722 µs] 114.778 µs (31.2%)
iast_FULL 554.124 µs [533.057 µs, 575.191 µs] 185.659 µs (50.4%)
iast_GLOBAL 503.457 µs [482.392 µs, 524.521 µs] 134.992 µs (36.6%)
iast_HARDCODED_SECRET_DISABLED 479.229 µs [458.384 µs, 500.075 µs] 110.765 µs (30.1%)
iast_INACTIVE 451.403 µs [430.493 µs, 472.312 µs] 82.938 µs (22.5%)
iast_TELEMETRY_OFF 475.547 µs [453.979 µs, 497.114 µs] 107.082 µs (29.1%)
tracing 444.458 µs [423.093 µs, 465.822 µs] 75.993 µs (20.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.154 µs [346.233 µs, 386.075 µs] -
iast 485.355 µs [464.212 µs, 506.499 µs] 119.202 µs (32.6%)
iast_FULL 545.442 µs [524.166 µs, 566.718 µs] 179.288 µs (49.0%)
iast_GLOBAL 511.635 µs [489.929 µs, 533.341 µs] 145.481 µs (39.7%)
iast_HARDCODED_SECRET_DISABLED 481.091 µs [459.83 µs, 502.351 µs] 114.937 µs (31.4%)
iast_INACTIVE 453.232 µs [432.042 µs, 474.422 µs] 87.078 µs (23.8%)
iast_TELEMETRY_OFF 470.873 µs [449.397 µs, 492.349 µs] 104.719 µs (28.6%)
tracing 445.928 µs [425.307 µs, 466.548 µs] 79.774 µs (21.8%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1375
.   : milestone, 1354,
appsec (1.724 ms) : 1699, 1748
.   : milestone, 1724,
appsec_no_iast (1.72 ms) : 1696, 1744
.   : milestone, 1720,
iast (1.485 ms) : 1462, 1508
.   : milestone, 1485,
profiling (1.477 ms) : 1453, 1502
.   : milestone, 1477,
tracing (1.473 ms) : 1449, 1497
.   : milestone, 1473,
section candidate
no_agent (1.356 ms) : 1337, 1376
.   : milestone, 1356,
appsec (1.72 ms) : 1696, 1745
.   : milestone, 1720,
appsec_no_iast (1.72 ms) : 1696, 1745
.   : milestone, 1720,
iast (1.466 ms) : 1442, 1491
.   : milestone, 1466,
profiling (1.538 ms) : 1512, 1563
.   : milestone, 1538,
tracing (1.478 ms) : 1454, 1502
.   : milestone, 1478,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.375 ms] -
appsec 1.724 ms [1.699 ms, 1.748 ms] 369.242 µs (27.3%)
appsec_no_iast 1.72 ms [1.696 ms, 1.744 ms] 365.578 µs (27.0%)
iast 1.485 ms [1.462 ms, 1.508 ms] 130.286 µs (9.6%)
profiling 1.477 ms [1.453 ms, 1.502 ms] 123.07 µs (9.1%)
tracing 1.473 ms [1.449 ms, 1.497 ms] 118.539 µs (8.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.337 ms, 1.376 ms] -
appsec 1.72 ms [1.696 ms, 1.745 ms] 364.135 µs (26.8%)
appsec_no_iast 1.72 ms [1.696 ms, 1.745 ms] 363.837 µs (26.8%)
iast 1.466 ms [1.442 ms, 1.491 ms] 110.128 µs (8.1%)
profiling 1.538 ms [1.512 ms, 1.563 ms] 181.371 µs (13.4%)
tracing 1.478 ms [1.454 ms, 1.502 ms] 121.613 µs (9.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/ci-gitlab-v1.35.2
git_commit_date 1718631246 1718705504
git_commit_sha 5cf2f32 656475e
release_version 1.36.0-SNAPSHOT~5cf2f32aa9 1.36.0-SNAPSHOT~656475ea6b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718708059 1718708059
ci_job_id 546315910 546315910
ci_pipeline_id 36990375 36990375
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1475
.   : milestone, 1464,
appsec (2.228 ms) : 2193, 2263
.   : milestone, 2228,
iast (1.983 ms) : 1941, 2025
.   : milestone, 1983,
iast_GLOBAL (2.012 ms) : 1971, 2053
.   : milestone, 2012,
profiling (1.85 ms) : 1816, 1884
.   : milestone, 1850,
tracing (1.845 ms) : 1813, 1878
.   : milestone, 1845,
section candidate
no_agent (1.462 ms) : 1451, 1474
.   : milestone, 1462,
appsec (2.221 ms) : 2187, 2255
.   : milestone, 2221,
iast (1.976 ms) : 1936, 2017
.   : milestone, 1976,
iast_GLOBAL (2.012 ms) : 1971, 2054
.   : milestone, 2012,
profiling (1.862 ms) : 1828, 1896
.   : milestone, 1862,
tracing (1.832 ms) : 1800, 1864
.   : milestone, 1832,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.475 ms] -
appsec 2.228 ms [2.193 ms, 2.263 ms] 763.733 µs (52.2%)
iast 1.983 ms [1.941 ms, 2.025 ms] 519.176 µs (35.5%)
iast_GLOBAL 2.012 ms [1.971 ms, 2.053 ms] 548.057 µs (37.4%)
profiling 1.85 ms [1.816 ms, 1.884 ms] 386.201 µs (26.4%)
tracing 1.845 ms [1.813 ms, 1.878 ms] 381.492 µs (26.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.474 ms] -
appsec 2.221 ms [2.187 ms, 2.255 ms] 758.642 µs (51.9%)
iast 1.976 ms [1.936 ms, 2.017 ms] 514.189 µs (35.2%)
iast_GLOBAL 2.012 ms [1.971 ms, 2.054 ms] 550.064 µs (37.6%)
profiling 1.862 ms [1.828 ms, 1.896 ms] 399.754 µs (27.3%)
tracing 1.832 ms [1.8 ms, 1.864 ms] 369.265 µs (25.3%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.293 s) : 15293000, 15293000
.   : milestone, 15293000,
appsec (15.096 s) : 15096000, 15096000
.   : milestone, 15096000,
iast (18.816 s) : 18816000, 18816000
.   : milestone, 18816000,
iast_GLOBAL (18.159 s) : 18159000, 18159000
.   : milestone, 18159000,
profiling (15.259 s) : 15259000, 15259000
.   : milestone, 15259000,
tracing (15.147 s) : 15147000, 15147000
.   : milestone, 15147000,
section candidate
no_agent (15.582 s) : 15582000, 15582000
.   : milestone, 15582000,
appsec (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,
iast (18.934 s) : 18934000, 18934000
.   : milestone, 18934000,
iast_GLOBAL (18.102 s) : 18102000, 18102000
.   : milestone, 18102000,
profiling (15.759 s) : 15759000, 15759000
.   : milestone, 15759000,
tracing (14.878 s) : 14878000, 14878000
.   : milestone, 14878000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.293 s [15.293 s, 15.293 s] -
appsec 15.096 s [15.096 s, 15.096 s] -197.0 ms (-1.3%)
iast 18.816 s [18.816 s, 18.816 s] 3.523 s (23.0%)
iast_GLOBAL 18.159 s [18.159 s, 18.159 s] 2.866 s (18.7%)
profiling 15.259 s [15.259 s, 15.259 s] -34.0 ms (-0.2%)
tracing 15.147 s [15.147 s, 15.147 s] -146.0 ms (-1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.582 s [15.582 s, 15.582 s] -
appsec 15.015 s [15.015 s, 15.015 s] -567.0 ms (-3.6%)
iast 18.934 s [18.934 s, 18.934 s] 3.352 s (21.5%)
iast_GLOBAL 18.102 s [18.102 s, 18.102 s] 2.52 s (16.2%)
profiling 15.759 s [15.759 s, 15.759 s] 177.0 ms (1.1%)
tracing 14.878 s [14.878 s, 14.878 s] -704.0 ms (-4.5%)

@mcculls mcculls merged commit 816e6b1 into release/v1.35.x Jun 18, 2024
78 of 80 checks passed
@mcculls mcculls deleted the mcculls/ci-gitlab-v1.35.2 branch June 18, 2024 11:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants