-
Notifications
You must be signed in to change notification settings - Fork 290
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Report via telemetry if _dd.iast.json tag exceeds max tag size #6930
Merged
jandro996
merged 8 commits into
master
from
alejandro.gonzalez/add-telemetry-to-truncated-json
Apr 24, 2024
Merged
Report via telemetry if _dd.iast.json tag exceeds max tag size #6930
jandro996
merged 8 commits into
master
from
alejandro.gonzalez/add-telemetry-to-truncated-json
Apr 24, 2024
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
smola
changed the title
Report via telemetry if iast-json tag exceeds max tag size
Report via telemetry if _dd.iast.json tag exceeds max tag size
Apr 22, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.09 s) : 0, 1089816
Total [baseline] (8.583 s) : 0, 8582756
Agent [candidate] (1.075 s) : 0, 1074810
Total [candidate] (8.553 s) : 0, 8552958
section iast
Agent [baseline] (1.204 s) : 0, 1204497
Total [baseline] (9.048 s) : 0, 9047617
Agent [candidate] (1.196 s) : 0, 1196447
Total [candidate] (9.013 s) : 0, 9013118
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.205 s) : 0, 1205289
Total [baseline] (8.99 s) : 0, 8989812
Agent [candidate] (1.197 s) : 0, 1196859
Total [candidate] (9.022 s) : 0, 9022471
section iast_TELEMETRY_OFF
Agent [baseline] (1.195 s) : 0, 1195330
Total [baseline] (9.023 s) : 0, 9022539
Agent [candidate] (1.196 s) : 0, 1195692
Total [candidate] (8.995 s) : 0, 8995263
gantt
title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.618 ms) : 0, 682618
BytebuddyAgent [candidate] (672.532 ms) : 0, 672532
GlobalTracer [baseline] (313.583 ms) : 0, 313583
GlobalTracer [candidate] (309.993 ms) : 0, 309993
AppSec [baseline] (50.204 ms) : 0, 50204
AppSec [candidate] (49.734 ms) : 0, 49734
Remote Config [baseline] (671.621 µs) : 0, 672
Remote Config [candidate] (658.506 µs) : 0, 659
Telemetry [baseline] (7.723 ms) : 0, 7723
Telemetry [candidate] (7.558 ms) : 0, 7558
section iast
BytebuddyAgent [baseline] (798.389 ms) : 0, 798389
BytebuddyAgent [candidate] (792.393 ms) : 0, 792393
GlobalTracer [baseline] (289.484 ms) : 0, 289484
GlobalTracer [candidate] (287.441 ms) : 0, 287441
AppSec [baseline] (50.623 ms) : 0, 50623
AppSec [candidate] (51.115 ms) : 0, 51115
IAST [baseline] (22.506 ms) : 0, 22506
IAST [candidate] (23.027 ms) : 0, 23027
Remote Config [baseline] (579.495 µs) : 0, 579
Remote Config [candidate] (573.439 µs) : 0, 573
Telemetry [baseline] (8.36 ms) : 0, 8360
Telemetry [candidate] (7.45 ms) : 0, 7450
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (798.915 ms) : 0, 798915
BytebuddyAgent [candidate] (793.371 ms) : 0, 793371
GlobalTracer [baseline] (289.27 ms) : 0, 289270
GlobalTracer [candidate] (287.692 ms) : 0, 287692
AppSec [baseline] (49.582 ms) : 0, 49582
AppSec [candidate] (49.723 ms) : 0, 49723
IAST [baseline] (24.115 ms) : 0, 24115
IAST [candidate] (24.602 ms) : 0, 24602
Remote Config [baseline] (579.413 µs) : 0, 579
Remote Config [candidate] (555.389 µs) : 0, 555
Telemetry [baseline] (8.143 ms) : 0, 8143
Telemetry [candidate] (6.543 ms) : 0, 6543
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (791.759 ms) : 0, 791759
BytebuddyAgent [candidate] (791.371 ms) : 0, 791371
GlobalTracer [baseline] (288.178 ms) : 0, 288178
GlobalTracer [candidate] (287.899 ms) : 0, 287899
AppSec [baseline] (48.785 ms) : 0, 48785
AppSec [candidate] (48.053 ms) : 0, 48053
IAST [baseline] (23.609 ms) : 0, 23609
IAST [candidate] (25.168 ms) : 0, 25168
Remote Config [baseline] (589.218 µs) : 0, 589
Remote Config [candidate] (589.906 µs) : 0, 590
Telemetry [baseline] (8.064 ms) : 0, 8064
Telemetry [candidate] (8.083 ms) : 0, 8083
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1073228
Total [baseline] (10.459 s) : 0, 10458854
Agent [candidate] (1.078 s) : 0, 1077692
Total [candidate] (10.438 s) : 0, 10437536
section appsec
Agent [baseline] (1.192 s) : 0, 1192103
Total [baseline] (10.509 s) : 0, 10509043
Agent [candidate] (1.188 s) : 0, 1188370
Total [candidate] (10.46 s) : 0, 10460025
section iast
Agent [baseline] (1.199 s) : 0, 1198800
Total [baseline] (10.759 s) : 0, 10759206
Agent [candidate] (1.196 s) : 0, 1196042
Total [candidate] (10.807 s) : 0, 10806876
section profiling
Agent [baseline] (1.272 s) : 0, 1271757
Total [baseline] (10.669 s) : 0, 10668888
Agent [candidate] (1.267 s) : 0, 1267451
Total [candidate] (10.59 s) : 0, 10589594
gantt
title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.308 ms) : 0, 672308
BytebuddyAgent [candidate] (675.958 ms) : 0, 675958
GlobalTracer [baseline] (308.78 ms) : 0, 308780
GlobalTracer [candidate] (309.406 ms) : 0, 309406
AppSec [baseline] (49.459 ms) : 0, 49459
AppSec [candidate] (49.527 ms) : 0, 49527
Remote Config [baseline] (661.002 µs) : 0, 661
Remote Config [candidate] (657.341 µs) : 0, 657
Telemetry [baseline] (7.63 ms) : 0, 7630
Telemetry [candidate] (7.554 ms) : 0, 7554
section appsec
BytebuddyAgent [baseline] (696.066 ms) : 0, 696066
BytebuddyAgent [candidate] (694.532 ms) : 0, 694532
GlobalTracer [baseline] (292.638 ms) : 0, 292638
GlobalTracer [candidate] (291.057 ms) : 0, 291057
AppSec [baseline] (149.812 ms) : 0, 149812
AppSec [candidate] (149.7 ms) : 0, 149700
IAST [baseline] (19.442 ms) : 0, 19442
IAST [candidate] (19.144 ms) : 0, 19144
Remote Config [baseline] (619.548 µs) : 0, 620
Remote Config [candidate] (617.013 µs) : 0, 617
Telemetry [baseline] (8.811 ms) : 0, 8811
Telemetry [candidate] (8.419 ms) : 0, 8419
section iast
BytebuddyAgent [baseline] (794.635 ms) : 0, 794635
BytebuddyAgent [candidate] (791.568 ms) : 0, 791568
GlobalTracer [baseline] (288.475 ms) : 0, 288475
GlobalTracer [candidate] (287.878 ms) : 0, 287878
AppSec [baseline] (48.959 ms) : 0, 48959
AppSec [candidate] (49.62 ms) : 0, 49620
IAST [baseline] (24.953 ms) : 0, 24953
IAST [candidate] (25.493 ms) : 0, 25493
Remote Config [baseline] (576.418 µs) : 0, 576
Remote Config [candidate] (576.779 µs) : 0, 577
Telemetry [baseline] (6.629 ms) : 0, 6629
Telemetry [candidate] (6.581 ms) : 0, 6581
section profiling
BytebuddyAgent [baseline] (678.072 ms) : 0, 678072
BytebuddyAgent [candidate] (676.433 ms) : 0, 676433
GlobalTracer [baseline] (381.958 ms) : 0, 381958
GlobalTracer [candidate] (380.171 ms) : 0, 380171
AppSec [baseline] (50.536 ms) : 0, 50536
AppSec [candidate] (50.228 ms) : 0, 50228
Remote Config [baseline] (710.063 µs) : 0, 710
Remote Config [candidate] (724.418 µs) : 0, 724
Telemetry [baseline] (7.512 ms) : 0, 7512
Telemetry [candidate] (7.464 ms) : 0, 7464
ProfilingAgent [baseline] (96.551 ms) : 0, 96551
ProfilingAgent [candidate] (95.967 ms) : 0, 95967
Profiling [baseline] (96.574 ms) : 0, 96574
Profiling [candidate] (95.991 ms) : 0, 95991
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 1 performance regressions! Performance is the same for 12 metrics, 15 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section baseline
no_agent (378.204 µs) : 359, 398
. : milestone, 378,
iast (478.093 µs) : 457, 499
. : milestone, 478,
iast_FULL (550.731 µs) : 529, 572
. : milestone, 551,
iast_GLOBAL (516.008 µs) : 494, 538
. : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (482.796 µs) : 462, 504
. : milestone, 483,
iast_INACTIVE (460.667 µs) : 439, 482
. : milestone, 461,
iast_TELEMETRY_OFF (472.31 µs) : 452, 493
. : milestone, 472,
tracing (453.953 µs) : 433, 475
. : milestone, 454,
section candidate
no_agent (370.649 µs) : 351, 390
. : milestone, 371,
iast (481.43 µs) : 461, 502
. : milestone, 481,
iast_FULL (548.009 µs) : 527, 569
. : milestone, 548,
iast_GLOBAL (504.367 µs) : 483, 526
. : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (481.745 µs) : 461, 502
. : milestone, 482,
iast_INACTIVE (450.617 µs) : 430, 471
. : milestone, 451,
iast_TELEMETRY_OFF (483.964 µs) : 463, 505
. : milestone, 484,
tracing (443.726 µs) : 424, 464
. : milestone, 444,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section baseline
no_agent (1.362 ms) : 1342, 1383
. : milestone, 1362,
appsec (1.732 ms) : 1708, 1755
. : milestone, 1732,
appsec_no_iast (1.741 ms) : 1717, 1766
. : milestone, 1741,
iast (1.485 ms) : 1461, 1508
. : milestone, 1485,
profiling (1.497 ms) : 1473, 1521
. : milestone, 1497,
tracing (1.492 ms) : 1467, 1516
. : milestone, 1492,
section candidate
no_agent (1.355 ms) : 1336, 1374
. : milestone, 1355,
appsec (1.726 ms) : 1701, 1751
. : milestone, 1726,
appsec_no_iast (1.727 ms) : 1702, 1752
. : milestone, 1727,
iast (1.479 ms) : 1455, 1502
. : milestone, 1479,
profiling (1.558 ms) : 1533, 1583
. : milestone, 1558,
tracing (1.499 ms) : 1475, 1523
. : milestone, 1499,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section baseline
no_agent (1.459 ms) : 1448, 1471
. : milestone, 1459,
appsec (2.18 ms) : 2147, 2214
. : milestone, 2180,
iast (1.869 ms) : 1835, 1904
. : milestone, 1869,
iast_GLOBAL (1.911 ms) : 1875, 1946
. : milestone, 1911,
profiling (1.836 ms) : 1803, 1870
. : milestone, 1836,
tracing (1.823 ms) : 1791, 1855
. : milestone, 1823,
section candidate
no_agent (1.463 ms) : 1451, 1474
. : milestone, 1463,
appsec (2.188 ms) : 2155, 2222
. : milestone, 2188,
iast (1.866 ms) : 1831, 1900
. : milestone, 1866,
iast_GLOBAL (1.903 ms) : 1869, 1938
. : milestone, 1903,
profiling (1.841 ms) : 1807, 1875
. : milestone, 1841,
tracing (1.825 ms) : 1793, 1857
. : milestone, 1825,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~1aceb39018, baseline=1.34.0-SNAPSHOT~8c37f09d8c
dateFormat X
axisFormat %s
section baseline
no_agent (15.13 s) : 15130000, 15130000
. : milestone, 15130000,
appsec (15.009 s) : 15009000, 15009000
. : milestone, 15009000,
iast (18.936 s) : 18936000, 18936000
. : milestone, 18936000,
iast_GLOBAL (17.817 s) : 17817000, 17817000
. : milestone, 17817000,
profiling (15.508 s) : 15508000, 15508000
. : milestone, 15508000,
tracing (14.883 s) : 14883000, 14883000
. : milestone, 14883000,
section candidate
no_agent (15.021 s) : 15021000, 15021000
. : milestone, 15021000,
appsec (14.909 s) : 14909000, 14909000
. : milestone, 14909000,
iast (18.858 s) : 18858000, 18858000
. : milestone, 18858000,
iast_GLOBAL (18.013 s) : 18013000, 18013000
. : milestone, 18013000,
profiling (15.166 s) : 15166000, 15166000
. : milestone, 15166000,
tracing (15.251 s) : 15251000, 15251000
. : milestone, 15251000,
|
smola
approved these changes
Apr 22, 2024
internal-api/src/main/java/datadog/trace/api/iast/telemetry/IastMetric.java
Outdated
Show resolved
Hide resolved
internal-api/src/main/java/datadog/trace/api/iast/telemetry/IastMetric.java
Outdated
Show resolved
Hide resolved
manuel-alvarez-alvarez
approved these changes
Apr 24, 2024
jandro996
deleted the
alejandro.gonzalez/add-telemetry-to-truncated-json
branch
April 24, 2024 07:59
PerfectSlayer
added
tag: diagnostics
Diagnostics related changes
comp: asm iast
Application Security Management (IAST)
labels
Apr 29, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Add a new telemetry metric (
iast.json.tag.size.exceeded
) to measure how many times_dd.iast.json
tag exceeds max tag sizeMotivation
We need metrics related with how many times source code vulnerabilities information exceeds the maximum size allowed
Additional Notes
Jira ticket: APPSEC-11540