-
Notifications
You must be signed in to change notification settings - Fork 277
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Dynamic Instrumentation] Consolidate PII redaction keys for all libraries. #6980
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jpbempel
reviewed
May 2, 2024
...bugger/debugger-bootstrap/src/main/java/datadog/trace/bootstrap/debugger/util/Redaction.java
Show resolved
Hide resolved
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1075043
Total [baseline] (8.58 s) : 0, 8579862
Agent [candidate] (1.076 s) : 0, 1075665
Total [candidate] (8.551 s) : 0, 8551461
section iast
Agent [baseline] (1.203 s) : 0, 1202572
Total [baseline] (9.014 s) : 0, 9013877
Agent [candidate] (1.202 s) : 0, 1202306
Total [candidate] (9.004 s) : 0, 9003535
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.215 s) : 0, 1214721
Total [baseline] (9.014 s) : 0, 9013507
Agent [candidate] (1.207 s) : 0, 1207381
Total [candidate] (8.995 s) : 0, 8994629
section iast_TELEMETRY_OFF
Agent [baseline] (1.206 s) : 0, 1206374
Total [baseline] (9.091 s) : 0, 9090998
Agent [candidate] (1.206 s) : 0, 1206282
Total [candidate] (9.015 s) : 0, 9014918
gantt
title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (673.806 ms) : 0, 673806
BytebuddyAgent [candidate] (674.153 ms) : 0, 674153
GlobalTracer [baseline] (309.38 ms) : 0, 309380
GlobalTracer [candidate] (309.589 ms) : 0, 309589
AppSec [baseline] (49.229 ms) : 0, 49229
AppSec [candidate] (49.339 ms) : 0, 49339
Remote Config [baseline] (657.38 µs) : 0, 657
Remote Config [candidate] (658.125 µs) : 0, 658
Telemetry [baseline] (7.594 ms) : 0, 7594
Telemetry [candidate] (7.567 ms) : 0, 7567
section iast
BytebuddyAgent [baseline] (796.996 ms) : 0, 796996
BytebuddyAgent [candidate] (795.819 ms) : 0, 795819
GlobalTracer [baseline] (289.266 ms) : 0, 289266
GlobalTracer [candidate] (289.157 ms) : 0, 289157
AppSec [baseline] (51.246 ms) : 0, 51246
AppSec [candidate] (50.422 ms) : 0, 50422
IAST [baseline] (23.331 ms) : 0, 23331
IAST [candidate] (25.099 ms) : 0, 25099
Remote Config [baseline] (587.158 µs) : 0, 587
Remote Config [candidate] (612.211 µs) : 0, 612
Telemetry [baseline] (6.622 ms) : 0, 6622
Telemetry [candidate] (6.572 ms) : 0, 6572
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (805.825 ms) : 0, 805825
BytebuddyAgent [candidate] (794.873 ms) : 0, 794873
GlobalTracer [baseline] (291.021 ms) : 0, 291021
GlobalTracer [candidate] (295.088 ms) : 0, 295088
AppSec [baseline] (53.741 ms) : 0, 53741
AppSec [candidate] (51.534 ms) : 0, 51534
IAST [baseline] (21.136 ms) : 0, 21136
IAST [candidate] (22.69 ms) : 0, 22690
Remote Config [baseline] (584.881 µs) : 0, 585
Remote Config [candidate] (2.05 ms) : 0, 2050
Telemetry [baseline] (7.486 ms) : 0, 7486
Telemetry [candidate] (6.678 ms) : 0, 6678
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (799.162 ms) : 0, 799162
BytebuddyAgent [candidate] (798.948 ms) : 0, 798948
GlobalTracer [baseline] (290.031 ms) : 0, 290031
GlobalTracer [candidate] (290.247 ms) : 0, 290247
AppSec [baseline] (51.473 ms) : 0, 51473
AppSec [candidate] (51.989 ms) : 0, 51989
IAST [baseline] (23.119 ms) : 0, 23119
IAST [candidate] (23.237 ms) : 0, 23237
Remote Config [baseline] (581.028 µs) : 0, 581
Remote Config [candidate] (582.161 µs) : 0, 582
Telemetry [baseline] (7.366 ms) : 0, 7366
Telemetry [candidate] (6.677 ms) : 0, 6677
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076429
Total [baseline] (10.411 s) : 0, 10411117
Agent [candidate] (1.078 s) : 0, 1078014
Total [candidate] (10.458 s) : 0, 10457771
section appsec
Agent [baseline] (1.19 s) : 0, 1190401
Total [baseline] (10.46 s) : 0, 10460110
Agent [candidate] (1.194 s) : 0, 1194419
Total [candidate] (10.502 s) : 0, 10502489
section iast
Agent [baseline] (1.207 s) : 0, 1206734
Total [baseline] (10.772 s) : 0, 10772372
Agent [candidate] (1.2 s) : 0, 1199721
Total [candidate] (10.711 s) : 0, 10710863
section profiling
Agent [baseline] (1.27 s) : 0, 1269910
Total [baseline] (10.621 s) : 0, 10621014
Agent [candidate] (1.28 s) : 0, 1279796
Total [candidate] (10.706 s) : 0, 10706361
gantt
title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (674.494 ms) : 0, 674494
BytebuddyAgent [candidate] (674.417 ms) : 0, 674417
GlobalTracer [baseline] (309.722 ms) : 0, 309722
GlobalTracer [candidate] (311.095 ms) : 0, 311095
AppSec [baseline] (49.521 ms) : 0, 49521
AppSec [candidate] (49.724 ms) : 0, 49724
Remote Config [baseline] (667.748 µs) : 0, 668
Remote Config [candidate] (666.974 µs) : 0, 667
Telemetry [baseline] (7.634 ms) : 0, 7634
Telemetry [candidate] (7.672 ms) : 0, 7672
section appsec
BytebuddyAgent [baseline] (696.153 ms) : 0, 696153
BytebuddyAgent [candidate] (698.82 ms) : 0, 698820
GlobalTracer [baseline] (291.958 ms) : 0, 291958
GlobalTracer [candidate] (293.008 ms) : 0, 293008
AppSec [baseline] (149.185 ms) : 0, 149185
AppSec [candidate] (149.587 ms) : 0, 149587
IAST [baseline] (19.146 ms) : 0, 19146
IAST [candidate] (19.217 ms) : 0, 19217
Remote Config [baseline] (619.523 µs) : 0, 620
Remote Config [candidate] (625.877 µs) : 0, 626
Telemetry [baseline] (8.499 ms) : 0, 8499
Telemetry [candidate] (8.203 ms) : 0, 8203
section iast
BytebuddyAgent [baseline] (800.873 ms) : 0, 800873
BytebuddyAgent [candidate] (794.768 ms) : 0, 794768
GlobalTracer [baseline] (290.208 ms) : 0, 290208
GlobalTracer [candidate] (288.542 ms) : 0, 288542
AppSec [baseline] (50.469 ms) : 0, 50469
AppSec [candidate] (50.205 ms) : 0, 50205
IAST [baseline] (23.413 ms) : 0, 23413
IAST [candidate] (23.916 ms) : 0, 23916
Remote Config [baseline] (578.521 µs) : 0, 579
Remote Config [candidate] (562.103 µs) : 0, 562
Telemetry [baseline] (6.629 ms) : 0, 6629
Telemetry [candidate] (7.323 ms) : 0, 7323
section profiling
BytebuddyAgent [baseline] (679.057 ms) : 0, 679057
BytebuddyAgent [candidate] (684.17 ms) : 0, 684170
GlobalTracer [baseline] (380.799 ms) : 0, 380799
GlobalTracer [candidate] (383.426 ms) : 0, 383426
AppSec [baseline] (49.716 ms) : 0, 49716
AppSec [candidate] (50.381 ms) : 0, 50381
Remote Config [baseline] (722.859 µs) : 0, 723
Remote Config [candidate] (718.562 µs) : 0, 719
Telemetry [baseline] (7.518 ms) : 0, 7518
Telemetry [candidate] (7.596 ms) : 0, 7596
ProfilingAgent [baseline] (95.427 ms) : 0, 95427
ProfilingAgent [candidate] (96.404 ms) : 0, 96404
Profiling [baseline] (95.451 ms) : 0, 95451
Profiling [candidate] (96.428 ms) : 0, 96428
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section baseline
no_agent (378.077 µs) : 359, 397
. : milestone, 378,
iast (478.304 µs) : 458, 499
. : milestone, 478,
iast_FULL (545.348 µs) : 524, 567
. : milestone, 545,
iast_GLOBAL (514.062 µs) : 491, 537
. : milestone, 514,
iast_HARDCODED_SECRET_DISABLED (478.195 µs) : 458, 499
. : milestone, 478,
iast_INACTIVE (459.097 µs) : 438, 480
. : milestone, 459,
iast_TELEMETRY_OFF (467.59 µs) : 447, 489
. : milestone, 468,
tracing (452.298 µs) : 432, 473
. : milestone, 452,
section candidate
no_agent (367.227 µs) : 348, 387
. : milestone, 367,
iast (479.006 µs) : 458, 500
. : milestone, 479,
iast_FULL (542.22 µs) : 522, 563
. : milestone, 542,
iast_GLOBAL (506.447 µs) : 486, 527
. : milestone, 506,
iast_HARDCODED_SECRET_DISABLED (483.989 µs) : 463, 505
. : milestone, 484,
iast_INACTIVE (454.93 µs) : 434, 476
. : milestone, 455,
iast_TELEMETRY_OFF (475.897 µs) : 454, 497
. : milestone, 476,
tracing (446.915 µs) : 426, 467
. : milestone, 447,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section baseline
no_agent (1.362 ms) : 1342, 1381
. : milestone, 1362,
appsec (1.743 ms) : 1719, 1766
. : milestone, 1743,
appsec_no_iast (1.747 ms) : 1723, 1771
. : milestone, 1747,
iast (1.504 ms) : 1481, 1527
. : milestone, 1504,
profiling (1.515 ms) : 1491, 1540
. : milestone, 1515,
tracing (1.482 ms) : 1455, 1510
. : milestone, 1482,
section candidate
no_agent (1.363 ms) : 1344, 1382
. : milestone, 1363,
appsec (1.752 ms) : 1728, 1776
. : milestone, 1752,
appsec_no_iast (1.734 ms) : 1709, 1759
. : milestone, 1734,
iast (1.488 ms) : 1465, 1511
. : milestone, 1488,
profiling (1.544 ms) : 1518, 1570
. : milestone, 1544,
tracing (1.501 ms) : 1476, 1525
. : milestone, 1501,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section baseline
no_agent (1.457 ms) : 1446, 1469
. : milestone, 1457,
appsec (2.182 ms) : 2149, 2216
. : milestone, 2182,
iast (1.868 ms) : 1833, 1903
. : milestone, 1868,
iast_GLOBAL (1.912 ms) : 1877, 1948
. : milestone, 1912,
profiling (1.85 ms) : 1816, 1884
. : milestone, 1850,
tracing (1.829 ms) : 1797, 1861
. : milestone, 1829,
section candidate
no_agent (1.455 ms) : 1444, 1466
. : milestone, 1455,
appsec (2.197 ms) : 2163, 2231
. : milestone, 2197,
iast (1.868 ms) : 1833, 1902
. : milestone, 1868,
iast_GLOBAL (1.903 ms) : 1868, 1938
. : milestone, 1903,
profiling (1.842 ms) : 1810, 1875
. : milestone, 1842,
tracing (1.839 ms) : 1806, 1871
. : milestone, 1839,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~6b184e6e54, baseline=1.34.0-SNAPSHOT~0b241711ac
dateFormat X
axisFormat %s
section baseline
no_agent (15.463 s) : 15463000, 15463000
. : milestone, 15463000,
appsec (14.789 s) : 14789000, 14789000
. : milestone, 14789000,
iast (18.44 s) : 18440000, 18440000
. : milestone, 18440000,
iast_GLOBAL (17.856 s) : 17856000, 17856000
. : milestone, 17856000,
profiling (15.904 s) : 15904000, 15904000
. : milestone, 15904000,
tracing (14.885 s) : 14885000, 14885000
. : milestone, 14885000,
section candidate
no_agent (15.438 s) : 15438000, 15438000
. : milestone, 15438000,
appsec (15.165 s) : 15165000, 15165000
. : milestone, 15165000,
iast (18.579 s) : 18579000, 18579000
. : milestone, 18579000,
iast_GLOBAL (17.869 s) : 17869000, 17869000
. : milestone, 17869000,
profiling (15.522 s) : 15522000, 15522000
. : milestone, 15522000,
tracing (15.111 s) : 15111000, 15111000
. : milestone, 15111000,
|
cimi
reviewed
May 3, 2024
...bugger/debugger-bootstrap/src/main/java/datadog/trace/bootstrap/debugger/util/Redaction.java
Show resolved
Hide resolved
cimi
approved these changes
May 3, 2024
P403n1x87
pushed a commit
to DataDog/dd-trace-py
that referenced
this pull request
May 21, 2024
) ## Checklist Consolidate PII redaction keys for all libraries. ## Notes Related PRs: `dotnet` - DataDog/dd-trace-dotnet#5522 `java` - DataDog/dd-trace-java#6980 - [x] Change(s) are motivated and described in the PR description - [x] Testing strategy is described if automated tests are not included in the PR - [x] Risks are described (performance impact, potential for breakage, maintainability) - [x] Change is maintainable (easy to change, telemetry, documentation) - [x] [Library release note guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html) are followed or label `changelog/no-changelog` is set - [x] Documentation is included (in-code, generated user docs, [public corp docs](https://github.com/DataDog/documentation/)) - [x] Backport labels are set (if [applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)) - [x] If this PR changes the public interface, I've notified `@DataDog/apm-tees`. ## Reviewer Checklist - [x] Title is accurate - [x] All changes are related to the pull request's stated goal - [x] Description motivates each change - [x] Avoids breaking [API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces) changes - [x] Testing strategy adequately addresses listed risks - [x] Change is maintainable (easy to change, telemetry, documentation) - [x] Release note makes sense to a user of the library - [x] Author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment - [x] Backport labels are set in a manner that is consistent with the [release branch maintenance policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Consolidate PII redaction keys for all libraries.
Additional Notes
Related PRs:
dotnet
- DataDog/dd-trace-dotnet#5522python
- DataDog/dd-trace-py#9148