Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add more metrics and tags to CI Visibility telemetry #7223

Merged
merged 1 commit into from
Jun 20, 2024
Merged

Add more metrics and tags to CI Visibility telemetry #7223

merged 1 commit into from
Jun 20, 2024

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Jun 19, 2024 •
edited by jira bot
Loading

What Does This Do

Adds more metrics and tags to CI Visibility telemetry.

Motivation

Improve libraries telemetry RFC

Jira ticket: SDTEST-412

@nikita-tkachenko-datadog nikita-tkachenko-datadog added the comp: ci visibility Continuous Integration Visibility label Jun 19, 2024
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review June 19, 2024 15:17
@pr-commenter
Copy link

pr-commenter bot commented Jun 19, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/ci-vis-telemetry-improve
git_commit_date 1718798323 1718807134
git_commit_sha 7294eaf d5684e9
release_version 1.36.0-SNAPSHOT~7294eaf157 1.36.0-SNAPSHOT~d5684e9254
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718810118 1718810118
ci_job_id 548139196 548139196
ci_pipeline_id 37115836 37115836
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1069797
Total [baseline] (10.337 s) : 0, 10336516
Agent [candidate] (1.063 s) : 0, 1062771
Total [candidate] (10.308 s) : 0, 10307846
section appsec
Agent [baseline] (1.188 s) : 0, 1187931
Total [baseline] (10.487 s) : 0, 10487479
Agent [candidate] (1.187 s) : 0, 1186875
Total [candidate] (10.491 s) : 0, 10491131
section iast
Agent [baseline] (1.169 s) : 0, 1169053
Total [baseline] (10.695 s) : 0, 10695417
Agent [candidate] (1.17 s) : 0, 1169800
Total [candidate] (10.711 s) : 0, 10711137
section profiling
Agent [baseline] (1.262 s) : 0, 1262311
Total [baseline] (10.606 s) : 0, 10606067
Agent [candidate] (1.27 s) : 0, 1269671
Total [candidate] (10.631 s) : 0, 10631396
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.188 s 118.133 ms (11.0%)
Agent iast 1.169 s 99.255 ms (9.3%)
Agent profiling 1.262 s 192.514 ms (18.0%)
Total tracing 10.337 s -
Total appsec 10.487 s 150.962 ms (1.5%)
Total iast 10.695 s 358.9 ms (3.5%)
Total profiling 10.606 s 269.55 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.187 s 124.103 ms (11.7%)
Agent iast 1.17 s 107.029 ms (10.1%)
Agent profiling 1.27 s 206.9 ms (19.5%)
Total tracing 10.308 s -
Total appsec 10.491 s 183.285 ms (1.8%)
Total iast 10.711 s 403.29 ms (3.9%)
Total profiling 10.631 s 323.55 ms (3.1%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.936 ms) : 0, 670936
BytebuddyAgent [candidate] (666.342 ms) : 0, 666342
GlobalTracer [baseline] (305.419 ms) : 0, 305419
GlobalTracer [candidate] (303.491 ms) : 0, 303491
AppSec [baseline] (50.391 ms) : 0, 50391
AppSec [candidate] (50.181 ms) : 0, 50181
Remote Config [baseline] (692.088 µs) : 0, 692
Remote Config [candidate] (689.535 µs) : 0, 690
Telemetry [baseline] (7.658 ms) : 0, 7658
Telemetry [candidate] (7.616 ms) : 0, 7616
section appsec
BytebuddyAgent [baseline] (680.013 ms) : 0, 680013
BytebuddyAgent [candidate] (679.097 ms) : 0, 679097
GlobalTracer [baseline] (298.496 ms) : 0, 298496
GlobalTracer [candidate] (298.693 ms) : 0, 298693
AppSec [baseline] (154.081 ms) : 0, 154081
AppSec [candidate] (154.203 ms) : 0, 154203
Remote Config [baseline] (639.423 µs) : 0, 639
Remote Config [candidate] (641.816 µs) : 0, 642
Telemetry [baseline] (9.472 ms) : 0, 9472
Telemetry [candidate] (9.159 ms) : 0, 9159
IAST [baseline] (21.114 ms) : 0, 21114
IAST [candidate] (20.963 ms) : 0, 20963
section iast
BytebuddyAgent [baseline] (779.674 ms) : 0, 779674
BytebuddyAgent [candidate] (779.815 ms) : 0, 779815
GlobalTracer [baseline] (293.151 ms) : 0, 293151
GlobalTracer [candidate] (293.511 ms) : 0, 293511
AppSec [baseline] (47.228 ms) : 0, 47228
AppSec [candidate] (47.07 ms) : 0, 47070
Remote Config [baseline] (635.653 µs) : 0, 636
Remote Config [candidate] (638.496 µs) : 0, 638
Telemetry [baseline] (7.722 ms) : 0, 7722
Telemetry [candidate] (6.818 ms) : 0, 6818
IAST [baseline] (27.346 ms) : 0, 27346
IAST [candidate] (28.626 ms) : 0, 28626
section profiling
BytebuddyAgent [baseline] (663.602 ms) : 0, 663602
BytebuddyAgent [candidate] (667.44 ms) : 0, 667440
GlobalTracer [baseline] (386.033 ms) : 0, 386033
GlobalTracer [candidate] (388.382 ms) : 0, 388382
AppSec [baseline] (51.537 ms) : 0, 51537
AppSec [candidate] (51.497 ms) : 0, 51497
Remote Config [baseline] (759.1 µs) : 0, 759
Remote Config [candidate] (720.803 µs) : 0, 721
Telemetry [baseline] (7.385 ms) : 0, 7385
Telemetry [candidate] (7.41 ms) : 0, 7410
ProfilingAgent [baseline] (95.829 ms) : 0, 95829
ProfilingAgent [candidate] (96.751 ms) : 0, 96751
Profiling [baseline] (95.854 ms) : 0, 95854
Profiling [candidate] (96.776 ms) : 0, 96776
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061309
Total [baseline] (8.522 s) : 0, 8522337
Agent [candidate] (1.061 s) : 0, 1060603
Total [candidate] (8.529 s) : 0, 8528763
section iast
Agent [baseline] (1.166 s) : 0, 1165846
Total [baseline] (8.986 s) : 0, 8985642
Agent [candidate] (1.177 s) : 0, 1177110
Total [candidate] (9.018 s) : 0, 9018213
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.175 s) : 0, 1175392
Total [baseline] (9.004 s) : 0, 9004258
Agent [candidate] (1.172 s) : 0, 1172193
Total [candidate] (9.015 s) : 0, 9014715
section iast_TELEMETRY_OFF
Agent [baseline] (1.172 s) : 0, 1172192
Total [baseline] (8.985 s) : 0, 8984971
Agent [candidate] (1.169 s) : 0, 1168809
Total [candidate] (8.989 s) : 0, 8988977
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.166 s 104.537 ms (9.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 114.084 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.172 s 110.883 ms (10.4%)
Total tracing 8.522 s -
Total iast 8.986 s 463.305 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.004 s 481.92 ms (5.7%)
Total iast_TELEMETRY_OFF 8.985 s 462.634 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.177 s 116.507 ms (11.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 111.59 ms (10.5%)
Agent iast_TELEMETRY_OFF 1.169 s 108.206 ms (10.2%)
Total tracing 8.529 s -
Total iast 9.018 s 489.45 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.015 s 485.952 ms (5.7%)
Total iast_TELEMETRY_OFF 8.989 s 460.214 ms (5.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (665.099 ms) : 0, 665099
BytebuddyAgent [candidate] (664.778 ms) : 0, 664778
GlobalTracer [baseline] (303.157 ms) : 0, 303157
GlobalTracer [candidate] (303.092 ms) : 0, 303092
AppSec [baseline] (50.43 ms) : 0, 50430
AppSec [candidate] (50.126 ms) : 0, 50126
Remote Config [baseline] (684.931 µs) : 0, 685
Remote Config [candidate] (680.45 µs) : 0, 680
Telemetry [baseline] (7.546 ms) : 0, 7546
Telemetry [candidate] (7.598 ms) : 0, 7598
section iast
BytebuddyAgent [baseline] (779.021 ms) : 0, 779021
BytebuddyAgent [candidate] (784.937 ms) : 0, 784937
GlobalTracer [baseline] (292.078 ms) : 0, 292078
GlobalTracer [candidate] (295.222 ms) : 0, 295222
AppSec [baseline] (47.047 ms) : 0, 47047
AppSec [candidate] (47.257 ms) : 0, 47257
Remote Config [baseline] (658.424 µs) : 0, 658
Remote Config [candidate] (614.332 µs) : 0, 614
Telemetry [baseline] (7.007 ms) : 0, 7007
Telemetry [candidate] (7.592 ms) : 0, 7592
IAST [baseline] (26.776 ms) : 0, 26776
IAST [candidate] (28.125 ms) : 0, 28125
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (785.494 ms) : 0, 785494
BytebuddyAgent [candidate] (780.879 ms) : 0, 780879
GlobalTracer [baseline] (295.401 ms) : 0, 295401
GlobalTracer [candidate] (294.034 ms) : 0, 294034
AppSec [baseline] (47.419 ms) : 0, 47419
AppSec [candidate] (47.298 ms) : 0, 47298
Remote Config [baseline] (659.123 µs) : 0, 659
Remote Config [candidate] (617.392 µs) : 0, 617
Telemetry [baseline] (7.065 ms) : 0, 7065
Telemetry [candidate] (7.713 ms) : 0, 7713
IAST [baseline] (25.97 ms) : 0, 25970
IAST [candidate] (28.29 ms) : 0, 28290
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (781.403 ms) : 0, 781403
BytebuddyAgent [candidate] (778.687 ms) : 0, 778687
GlobalTracer [baseline] (294.041 ms) : 0, 294041
GlobalTracer [candidate] (293.551 ms) : 0, 293551
AppSec [baseline] (47.378 ms) : 0, 47378
AppSec [candidate] (47.268 ms) : 0, 47268
Remote Config [baseline] (597.129 µs) : 0, 597
Remote Config [candidate] (587.039 µs) : 0, 587
Telemetry [baseline] (9.161 ms) : 0, 9161
Telemetry [candidate] (7.541 ms) : 0, 7541
IAST [baseline] (26.207 ms) : 0, 26207
IAST [candidate] (27.804 ms) : 0, 27804
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-19T14:46:10 2024-06-19T14:53:04
git_branch master nikita-tkachenko/ci-vis-telemetry-improve
git_commit_date 1718798323 1718807134
git_commit_sha 7294eaf d5684e9
release_version 1.36.0-SNAPSHOT~7294eaf157 1.36.0-SNAPSHOT~d5684e9254
start_time 2024-06-19T14:45:56 2024-06-19T14:52:50
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718809132 1718809132
ci_job_id 548139197 548139197
ci_pipeline_id 37115836 37115836
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.363 ms) : 1344, 1382
.   : milestone, 1363,
appsec (1.739 ms) : 1715, 1762
.   : milestone, 1739,
appsec_no_iast (1.736 ms) : 1711, 1760
.   : milestone, 1736,
iast (1.507 ms) : 1486, 1529
.   : milestone, 1507,
profiling (1.51 ms) : 1484, 1537
.   : milestone, 1510,
tracing (1.479 ms) : 1455, 1503
.   : milestone, 1479,
section candidate
no_agent (1.372 ms) : 1353, 1391
.   : milestone, 1372,
appsec (1.747 ms) : 1723, 1771
.   : milestone, 1747,
appsec_no_iast (1.733 ms) : 1708, 1757
.   : milestone, 1733,
iast (1.497 ms) : 1474, 1519
.   : milestone, 1497,
profiling (1.521 ms) : 1495, 1547
.   : milestone, 1521,
tracing (1.474 ms) : 1450, 1498
.   : milestone, 1474,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.363 ms [1.344 ms, 1.382 ms] -
appsec 1.739 ms [1.715 ms, 1.762 ms] 375.607 µs (27.6%)
appsec_no_iast 1.736 ms [1.711 ms, 1.76 ms] 372.518 µs (27.3%)
iast 1.507 ms [1.486 ms, 1.529 ms] 144.31 µs (10.6%)
profiling 1.51 ms [1.484 ms, 1.537 ms] 147.23 µs (10.8%)
tracing 1.479 ms [1.455 ms, 1.503 ms] 115.82 µs (8.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.372 ms [1.353 ms, 1.391 ms] -
appsec 1.747 ms [1.723 ms, 1.771 ms] 375.031 µs (27.3%)
appsec_no_iast 1.733 ms [1.708 ms, 1.757 ms] 360.929 µs (26.3%)
iast 1.497 ms [1.474 ms, 1.519 ms] 124.718 µs (9.1%)
profiling 1.521 ms [1.495 ms, 1.547 ms] 149.398 µs (10.9%)
tracing 1.474 ms [1.45 ms, 1.498 ms] 102.236 µs (7.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.688 µs) : 352, 392
.   : milestone, 372,
iast (492.511 µs) : 471, 514
.   : milestone, 493,
iast_FULL (561.976 µs) : 541, 583
.   : milestone, 562,
iast_GLOBAL (510.218 µs) : 489, 531
.   : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (488.711 µs) : 467, 510
.   : milestone, 489,
iast_INACTIVE (469.278 µs) : 447, 492
.   : milestone, 469,
iast_TELEMETRY_OFF (482.093 µs) : 461, 504
.   : milestone, 482,
tracing (450.766 µs) : 430, 472
.   : milestone, 451,
section candidate
no_agent (376.027 µs) : 356, 396
.   : milestone, 376,
iast (491.642 µs) : 470, 513
.   : milestone, 492,
iast_FULL (556.569 µs) : 535, 578
.   : milestone, 557,
iast_GLOBAL (515.819 µs) : 494, 538
.   : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (493.144 µs) : 472, 514
.   : milestone, 493,
iast_INACTIVE (461.401 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (478.383 µs) : 457, 500
.   : milestone, 478,
tracing (450.661 µs) : 430, 472
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.688 µs [351.642 µs, 391.734 µs] -
iast 492.511 µs [471.216 µs, 513.807 µs] 120.824 µs (32.5%)
iast_FULL 561.976 µs [540.886 µs, 583.066 µs] 190.288 µs (51.2%)
iast_GLOBAL 510.218 µs [489.392 µs, 531.045 µs] 138.531 µs (37.3%)
iast_HARDCODED_SECRET_DISABLED 488.711 µs [467.315 µs, 510.106 µs] 117.023 µs (31.5%)
iast_INACTIVE 469.278 µs [446.997 µs, 491.56 µs] 97.591 µs (26.3%)
iast_TELEMETRY_OFF 482.093 µs [460.662 µs, 503.524 µs] 110.405 µs (29.7%)
tracing 450.766 µs [429.657 µs, 471.875 µs] 79.078 µs (21.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.027 µs [356.208 µs, 395.846 µs] -
iast 491.642 µs [470.053 µs, 513.232 µs] 115.616 µs (30.7%)
iast_FULL 556.569 µs [535.377 µs, 577.762 µs] 180.543 µs (48.0%)
iast_GLOBAL 515.819 µs [493.674 µs, 537.965 µs] 139.792 µs (37.2%)
iast_HARDCODED_SECRET_DISABLED 493.144 µs [471.821 µs, 514.466 µs] 117.117 µs (31.1%)
iast_INACTIVE 461.401 µs [440.249 µs, 482.554 µs] 85.375 µs (22.7%)
iast_TELEMETRY_OFF 478.383 µs [457.192 µs, 499.575 µs] 102.357 µs (27.2%)
tracing 450.661 µs [429.769 µs, 471.553 µs] 74.634 µs (19.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/ci-vis-telemetry-improve
git_commit_date 1718798323 1718807134
git_commit_sha 7294eaf d5684e9
release_version 1.36.0-SNAPSHOT~7294eaf157 1.36.0-SNAPSHOT~d5684e9254
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718809652 1718809652
ci_job_id 548139198 548139198
ci_pipeline_id 37115836 37115836
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.456 ms) : 1445, 1468
.   : milestone, 1456,
appsec (2.211 ms) : 2176, 2246
.   : milestone, 2211,
iast (1.961 ms) : 1920, 2002
.   : milestone, 1961,
iast_GLOBAL (1.999 ms) : 1958, 2040
.   : milestone, 1999,
profiling (1.854 ms) : 1819, 1888
.   : milestone, 1854,
tracing (1.818 ms) : 1786, 1849
.   : milestone, 1818,
section candidate
no_agent (1.458 ms) : 1446, 1469
.   : milestone, 1458,
appsec (2.205 ms) : 2171, 2239
.   : milestone, 2205,
iast (1.954 ms) : 1913, 1995
.   : milestone, 1954,
iast_GLOBAL (1.983 ms) : 1942, 2024
.   : milestone, 1983,
profiling (1.834 ms) : 1800, 1868
.   : milestone, 1834,
tracing (1.822 ms) : 1790, 1854
.   : milestone, 1822,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.456 ms [1.445 ms, 1.468 ms] -
appsec 2.211 ms [2.176 ms, 2.246 ms] 754.743 µs (51.8%)
iast 1.961 ms [1.92 ms, 2.002 ms] 504.802 µs (34.7%)
iast_GLOBAL 1.999 ms [1.958 ms, 2.04 ms] 542.974 µs (37.3%)
profiling 1.854 ms [1.819 ms, 1.888 ms] 397.194 µs (27.3%)
tracing 1.818 ms [1.786 ms, 1.849 ms] 361.184 µs (24.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.458 ms [1.446 ms, 1.469 ms] -
appsec 2.205 ms [2.171 ms, 2.239 ms] 747.324 µs (51.3%)
iast 1.954 ms [1.913 ms, 1.995 ms] 496.484 µs (34.1%)
iast_GLOBAL 1.983 ms [1.942 ms, 2.024 ms] 524.995 µs (36.0%)
profiling 1.834 ms [1.8 ms, 1.868 ms] 376.756 µs (25.8%)
tracing 1.822 ms [1.79 ms, 1.854 ms] 364.5 µs (25.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.064 s) : 15064000, 15064000
.   : milestone, 15064000,
appsec (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
iast (18.968 s) : 18968000, 18968000
.   : milestone, 18968000,
iast_GLOBAL (18.044 s) : 18044000, 18044000
.   : milestone, 18044000,
profiling (15.584 s) : 15584000, 15584000
.   : milestone, 15584000,
tracing (15.257 s) : 15257000, 15257000
.   : milestone, 15257000,
section candidate
no_agent (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
appsec (15.022 s) : 15022000, 15022000
.   : milestone, 15022000,
iast (19.083 s) : 19083000, 19083000
.   : milestone, 19083000,
iast_GLOBAL (17.9 s) : 17900000, 17900000
.   : milestone, 17900000,
profiling (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
tracing (15.169 s) : 15169000, 15169000
.   : milestone, 15169000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.064 s [15.064 s, 15.064 s] -
appsec 14.831 s [14.831 s, 14.831 s] -233.0 ms (-1.5%)
iast 18.968 s [18.968 s, 18.968 s] 3.904 s (25.9%)
iast_GLOBAL 18.044 s [18.044 s, 18.044 s] 2.98 s (19.8%)
profiling 15.584 s [15.584 s, 15.584 s] 520.0 ms (3.5%)
tracing 15.257 s [15.257 s, 15.257 s] 193.0 ms (1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.006 s [15.006 s, 15.006 s] -
appsec 15.022 s [15.022 s, 15.022 s] 16.0 ms (0.1%)
iast 19.083 s [19.083 s, 19.083 s] 4.077 s (27.2%)
iast_GLOBAL 17.9 s [17.9 s, 17.9 s] 2.894 s (19.3%)
profiling 15.145 s [15.145 s, 15.145 s] 139.0 ms (0.9%)
tracing 15.169 s [15.169 s, 15.169 s] 163.0 ms (1.1%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 01fd984 into master Jun 20, 2024
84 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/ci-vis-telemetry-improve branch June 20, 2024 08:49
@github-actions github-actions bot added this to the 1.36.0 milestone Jun 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@anmarchenko anmarchenko anmarchenko approved these changes

@tonyredondo tonyredondo Awaiting requested review from tonyredondo tonyredondo is a code owner automatically assigned from DataDog/ci-app-libraries-java

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-java

@nayeem-kamal nayeem-kamal Awaiting requested review from nayeem-kamal nayeem-kamal is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility
Projects
None yet
Milestone
1.36.0
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@nikita-tkachenko-datadog @anmarchenko