-
Notifications
You must be signed in to change notification settings - Fork 278
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tag telemetry data with CI Visibility product when applicable #7301
Open
nikita-tkachenko-datadog
wants to merge
1
commit into
master
Choose a base branch
from
nikita-tkachenko/telemetry-ci-vis-product
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Tag telemetry data with CI Visibility product when applicable #7301
nikita-tkachenko-datadog
wants to merge
1
commit into
master
from
nikita-tkachenko/telemetry-ci-vis-product
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1073502
Total [baseline] (10.331 s) : 0, 10330861
Agent [candidate] (1.072 s) : 0, 1072133
Total [candidate] (10.345 s) : 0, 10345451
section appsec
Agent [baseline] (1.19 s) : 0, 1189730
Total [baseline] (10.503 s) : 0, 10503120
Agent [candidate] (1.184 s) : 0, 1184426
Total [candidate] (10.502 s) : 0, 10501941
section iast
Agent [baseline] (1.174 s) : 0, 1174295
Total [baseline] (10.749 s) : 0, 10748810
Agent [candidate] (1.176 s) : 0, 1175509
Total [candidate] (10.757 s) : 0, 10757027
section profiling
Agent [baseline] (1.263 s) : 0, 1262633
Total [baseline] (10.606 s) : 0, 10605509
Agent [candidate] (1.265 s) : 0, 1265062
Total [candidate] (10.612 s) : 0, 10611784
gantt
title petclinic - break down per module: candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (671.815 ms) : 0, 671815
BytebuddyAgent [candidate] (671.324 ms) : 0, 671324
GlobalTracer [baseline] (307.801 ms) : 0, 307801
GlobalTracer [candidate] (307.182 ms) : 0, 307182
AppSec [baseline] (50.518 ms) : 0, 50518
AppSec [candidate] (50.367 ms) : 0, 50367
Remote Config [baseline] (680.571 µs) : 0, 681
Remote Config [candidate] (691.283 µs) : 0, 691
Telemetry [baseline] (7.733 ms) : 0, 7733
Telemetry [candidate] (7.732 ms) : 0, 7732
section appsec
BytebuddyAgent [baseline] (680.592 ms) : 0, 680592
BytebuddyAgent [candidate] (676.707 ms) : 0, 676707
GlobalTracer [baseline] (300.408 ms) : 0, 300408
GlobalTracer [candidate] (299.956 ms) : 0, 299956
AppSec [baseline] (154.424 ms) : 0, 154424
AppSec [candidate] (154.512 ms) : 0, 154512
Remote Config [baseline] (625.491 µs) : 0, 625
Remote Config [candidate] (625.782 µs) : 0, 626
Telemetry [baseline] (8.297 ms) : 0, 8297
Telemetry [candidate] (7.692 ms) : 0, 7692
IAST [baseline] (21.095 ms) : 0, 21095
IAST [candidate] (20.445 ms) : 0, 20445
section iast
BytebuddyAgent [baseline] (780.881 ms) : 0, 780881
BytebuddyAgent [candidate] (784.891 ms) : 0, 784891
GlobalTracer [baseline] (296.324 ms) : 0, 296324
GlobalTracer [candidate] (295.805 ms) : 0, 295805
AppSec [baseline] (47.22 ms) : 0, 47220
AppSec [candidate] (47.188 ms) : 0, 47188
Remote Config [baseline] (570.704 µs) : 0, 571
Remote Config [candidate] (576.026 µs) : 0, 576
Telemetry [baseline] (6.946 ms) : 0, 6946
Telemetry [candidate] (7.044 ms) : 0, 7044
IAST [baseline] (28.795 ms) : 0, 28795
IAST [candidate] (26.341 ms) : 0, 26341
section profiling
BytebuddyAgent [baseline] (662.368 ms) : 0, 662368
BytebuddyAgent [candidate] (662.699 ms) : 0, 662699
GlobalTracer [baseline] (388.171 ms) : 0, 388171
GlobalTracer [candidate] (388.793 ms) : 0, 388793
AppSec [baseline] (51.552 ms) : 0, 51552
AppSec [candidate] (51.54 ms) : 0, 51540
Remote Config [baseline] (641.879 µs) : 0, 642
Remote Config [candidate] (651.717 µs) : 0, 652
Telemetry [baseline] (7.354 ms) : 0, 7354
Telemetry [candidate] (7.352 ms) : 0, 7352
ProfilingAgent [baseline] (95.481 ms) : 0, 95481
ProfilingAgent [candidate] (96.728 ms) : 0, 96728
Profiling [baseline] (95.505 ms) : 0, 95505
Profiling [candidate] (96.753 ms) : 0, 96753
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064952
Total [baseline] (8.516 s) : 0, 8515626
Agent [candidate] (1.064 s) : 0, 1063655
Total [candidate] (8.514 s) : 0, 8513964
section iast
Agent [baseline] (1.181 s) : 0, 1180678
Total [baseline] (8.983 s) : 0, 8983227
Agent [candidate] (1.173 s) : 0, 1172636
Total [candidate] (8.95 s) : 0, 8950102
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.17 s) : 0, 1170155
Total [baseline] (8.927 s) : 0, 8927264
Agent [candidate] (1.172 s) : 0, 1172131
Total [candidate] (8.922 s) : 0, 8921853
section iast_TELEMETRY_OFF
Agent [baseline] (1.17 s) : 0, 1170313
Total [baseline] (8.954 s) : 0, 8954043
Agent [candidate] (1.169 s) : 0, 1169039
Total [candidate] (8.937 s) : 0, 8937213
gantt
title insecure-bank - break down per module: candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.093 ms) : 0, 666093
BytebuddyAgent [candidate] (665.677 ms) : 0, 665677
GlobalTracer [baseline] (305.881 ms) : 0, 305881
GlobalTracer [candidate] (305.153 ms) : 0, 305153
AppSec [baseline] (49.986 ms) : 0, 49986
AppSec [candidate] (49.881 ms) : 0, 49881
Remote Config [baseline] (668.874 µs) : 0, 669
Remote Config [candidate] (669.574 µs) : 0, 670
Telemetry [baseline] (7.668 ms) : 0, 7668
Telemetry [candidate] (7.698 ms) : 0, 7698
section iast
BytebuddyAgent [baseline] (785.728 ms) : 0, 785728
BytebuddyAgent [candidate] (780.088 ms) : 0, 780088
GlobalTracer [baseline] (297.903 ms) : 0, 297903
GlobalTracer [candidate] (295.921 ms) : 0, 295921
AppSec [baseline] (49.066 ms) : 0, 49066
AppSec [candidate] (47.999 ms) : 0, 47999
IAST [baseline] (26.143 ms) : 0, 26143
IAST [candidate] (27.568 ms) : 0, 27568
Remote Config [baseline] (572.989 µs) : 0, 573
Remote Config [candidate] (575.43 µs) : 0, 575
Telemetry [baseline] (7.701 ms) : 0, 7701
Telemetry [candidate] (6.955 ms) : 0, 6955
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (778.108 ms) : 0, 778108
BytebuddyAgent [candidate] (779.522 ms) : 0, 779522
GlobalTracer [baseline] (295.82 ms) : 0, 295820
GlobalTracer [candidate] (296.049 ms) : 0, 296049
AppSec [baseline] (47.338 ms) : 0, 47338
AppSec [candidate] (47.337 ms) : 0, 47337
IAST [baseline] (27.925 ms) : 0, 27925
IAST [candidate] (28.139 ms) : 0, 28139
Remote Config [baseline] (572.055 µs) : 0, 572
Remote Config [candidate] (578.213 µs) : 0, 578
Telemetry [baseline] (6.892 ms) : 0, 6892
Telemetry [candidate] (6.95 ms) : 0, 6950
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.547 ms) : 0, 777547
BytebuddyAgent [candidate] (776.518 ms) : 0, 776518
GlobalTracer [baseline] (295.861 ms) : 0, 295861
GlobalTracer [candidate] (295.869 ms) : 0, 295869
AppSec [baseline] (47.12 ms) : 0, 47120
AppSec [candidate] (47.246 ms) : 0, 47246
IAST [baseline] (28.859 ms) : 0, 28859
IAST [candidate] (28.417 ms) : 0, 28417
Remote Config [baseline] (592.286 µs) : 0, 592
Remote Config [candidate] (603.326 µs) : 0, 603
Telemetry [baseline] (6.79 ms) : 0, 6790
Telemetry [candidate] (6.862 ms) : 0, 6862
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section baseline
no_agent (1.341 ms) : 1323, 1360
. : milestone, 1341,
appsec (1.712 ms) : 1687, 1736
. : milestone, 1712,
appsec_no_iast (1.717 ms) : 1693, 1740
. : milestone, 1717,
iast (1.478 ms) : 1455, 1500
. : milestone, 1478,
profiling (1.487 ms) : 1463, 1512
. : milestone, 1487,
tracing (1.462 ms) : 1439, 1486
. : milestone, 1462,
section candidate
no_agent (1.347 ms) : 1327, 1366
. : milestone, 1347,
appsec (1.724 ms) : 1701, 1747
. : milestone, 1724,
appsec_no_iast (1.714 ms) : 1690, 1738
. : milestone, 1714,
iast (1.482 ms) : 1460, 1504
. : milestone, 1482,
profiling (1.483 ms) : 1459, 1508
. : milestone, 1483,
tracing (1.46 ms) : 1435, 1484
. : milestone, 1460,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section baseline
no_agent (361.753 µs) : 343, 381
. : milestone, 362,
iast (477.494 µs) : 456, 499
. : milestone, 477,
iast_FULL (547.482 µs) : 527, 568
. : milestone, 547,
iast_GLOBAL (500.848 µs) : 480, 522
. : milestone, 501,
iast_HARDCODED_SECRET_DISABLED (477.301 µs) : 456, 498
. : milestone, 477,
iast_INACTIVE (463.594 µs) : 443, 485
. : milestone, 464,
iast_TELEMETRY_OFF (469.533 µs) : 448, 491
. : milestone, 470,
tracing (440.88 µs) : 420, 462
. : milestone, 441,
section candidate
no_agent (363.468 µs) : 343, 384
. : milestone, 363,
iast (483.057 µs) : 462, 505
. : milestone, 483,
iast_FULL (548.594 µs) : 528, 570
. : milestone, 549,
iast_GLOBAL (505.058 µs) : 484, 526
. : milestone, 505,
iast_HARDCODED_SECRET_DISABLED (478.922 µs) : 458, 500
. : milestone, 479,
iast_INACTIVE (445.064 µs) : 424, 466
. : milestone, 445,
iast_TELEMETRY_OFF (469.143 µs) : 448, 491
. : milestone, 469,
tracing (437.719 µs) : 417, 458
. : milestone, 438,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section baseline
no_agent (1.465 ms) : 1454, 1477
. : milestone, 1465,
appsec (2.206 ms) : 2172, 2241
. : milestone, 2206,
iast (1.962 ms) : 1921, 2003
. : milestone, 1962,
iast_GLOBAL (2.004 ms) : 1963, 2045
. : milestone, 2004,
profiling (1.859 ms) : 1825, 1894
. : milestone, 1859,
tracing (1.841 ms) : 1809, 1874
. : milestone, 1841,
section candidate
no_agent (1.457 ms) : 1446, 1468
. : milestone, 1457,
appsec (2.214 ms) : 2179, 2248
. : milestone, 2214,
iast (1.948 ms) : 1906, 1989
. : milestone, 1948,
iast_GLOBAL (2.011 ms) : 1969, 2053
. : milestone, 2011,
profiling (1.844 ms) : 1810, 1877
. : milestone, 1844,
tracing (1.833 ms) : 1800, 1866
. : milestone, 1833,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~6d2542a9af, baseline=1.38.0-SNAPSHOT~8629967b44
dateFormat X
axisFormat %s
section baseline
no_agent (15.521 s) : 15521000, 15521000
. : milestone, 15521000,
appsec (14.817 s) : 14817000, 14817000
. : milestone, 14817000,
iast (19.05 s) : 19050000, 19050000
. : milestone, 19050000,
iast_GLOBAL (17.803 s) : 17803000, 17803000
. : milestone, 17803000,
profiling (15.429 s) : 15429000, 15429000
. : milestone, 15429000,
tracing (15.094 s) : 15094000, 15094000
. : milestone, 15094000,
section candidate
no_agent (15.078 s) : 15078000, 15078000
. : milestone, 15078000,
appsec (14.904 s) : 14904000, 14904000
. : milestone, 14904000,
iast (18.922 s) : 18922000, 18922000
. : milestone, 18922000,
iast_GLOBAL (18.065 s) : 18065000, 18065000
. : milestone, 18065000,
profiling (15.436 s) : 15436000, 15436000
. : milestone, 15436000,
tracing (15.064 s) : 15064000, 15064000
. : milestone, 15064000,
|
smola
approved these changes
Jul 11, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Tag telemetry requests with CI Visibility product if CI Visibility is enabled.
Jira ticket: SDTEST-544