-
Notifications
You must be signed in to change notification settings - Fork 290
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integrate initial list of third party libraries #6928
Integrate initial list of third party libraries #6928
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1072425
Total [baseline] (8.52 s) : 0, 8519522
Agent [candidate] (1.073 s) : 0, 1072715
Total [candidate] (8.57 s) : 0, 8570199
section iast
Agent [baseline] (1.203 s) : 0, 1202638
Total [baseline] (9.056 s) : 0, 9055673
Agent [candidate] (1.202 s) : 0, 1202077
Total [candidate] (9.038 s) : 0, 9037836
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.197 s) : 0, 1197079
Total [baseline] (8.956 s) : 0, 8956498
Agent [candidate] (1.208 s) : 0, 1208266
Total [candidate] (8.996 s) : 0, 8996300
section iast_TELEMETRY_OFF
Agent [baseline] (1.194 s) : 0, 1193591
Total [baseline] (8.967 s) : 0, 8966778
Agent [candidate] (1.197 s) : 0, 1196525
Total [candidate] (8.977 s) : 0, 8976637
gantt
title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (671.836 ms) : 0, 671836
BytebuddyAgent [candidate] (671.73 ms) : 0, 671730
GlobalTracer [baseline] (308.623 ms) : 0, 308623
GlobalTracer [candidate] (309.095 ms) : 0, 309095
AppSec [baseline] (49.381 ms) : 0, 49381
AppSec [candidate] (49.375 ms) : 0, 49375
Remote Config [baseline] (660.347 µs) : 0, 660
Remote Config [candidate] (655.407 µs) : 0, 655
Telemetry [baseline] (7.602 ms) : 0, 7602
Telemetry [candidate] (7.589 ms) : 0, 7589
section iast
BytebuddyAgent [baseline] (797.247 ms) : 0, 797247
BytebuddyAgent [candidate] (795.93 ms) : 0, 795930
GlobalTracer [baseline] (288.092 ms) : 0, 288092
GlobalTracer [candidate] (290.343 ms) : 0, 290343
AppSec [baseline] (49.783 ms) : 0, 49783
AppSec [candidate] (50.527 ms) : 0, 50527
IAST [baseline] (25.708 ms) : 0, 25708
IAST [candidate] (23.49 ms) : 0, 23490
Remote Config [baseline] (577.202 µs) : 0, 577
Remote Config [candidate] (578.396 µs) : 0, 578
Telemetry [baseline] (6.592 ms) : 0, 6592
Telemetry [candidate] (6.749 ms) : 0, 6749
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (793.218 ms) : 0, 793218
BytebuddyAgent [candidate] (801.204 ms) : 0, 801204
GlobalTracer [baseline] (287.765 ms) : 0, 287765
GlobalTracer [candidate] (290.284 ms) : 0, 290284
AppSec [baseline] (52.071 ms) : 0, 52071
AppSec [candidate] (50.926 ms) : 0, 50926
IAST [baseline] (22.531 ms) : 0, 22531
IAST [candidate] (23.914 ms) : 0, 23914
Remote Config [baseline] (565.414 µs) : 0, 565
Remote Config [candidate] (558.067 µs) : 0, 558
Telemetry [baseline] (6.598 ms) : 0, 6598
Telemetry [candidate] (6.564 ms) : 0, 6564
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (790.45 ms) : 0, 790450
BytebuddyAgent [candidate] (792.533 ms) : 0, 792533
GlobalTracer [baseline] (287.243 ms) : 0, 287243
GlobalTracer [candidate] (288.612 ms) : 0, 288612
AppSec [baseline] (49.23 ms) : 0, 49230
AppSec [candidate] (48.078 ms) : 0, 48078
IAST [baseline] (23.68 ms) : 0, 23680
IAST [candidate] (24.261 ms) : 0, 24261
Remote Config [baseline] (588.371 µs) : 0, 588
Remote Config [candidate] (579.487 µs) : 0, 579
Telemetry [baseline] (8.021 ms) : 0, 8021
Telemetry [candidate] (8.058 ms) : 0, 8058
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070792
Total [baseline] (10.373 s) : 0, 10373278
Agent [candidate] (1.075 s) : 0, 1074873
Total [candidate] (10.348 s) : 0, 10348437
section appsec
Agent [baseline] (1.186 s) : 0, 1186477
Total [baseline] (10.452 s) : 0, 10451690
Agent [candidate] (1.187 s) : 0, 1186818
Total [candidate] (10.482 s) : 0, 10481900
section iast
Agent [baseline] (1.196 s) : 0, 1196295
Total [baseline] (10.652 s) : 0, 10651889
Agent [candidate] (1.198 s) : 0, 1198004
Total [candidate] (10.777 s) : 0, 10776520
section profiling
Agent [baseline] (1.265 s) : 0, 1265347
Total [baseline] (10.555 s) : 0, 10554781
Agent [candidate] (1.266 s) : 0, 1266153
Total [candidate] (10.604 s) : 0, 10603973
gantt
title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.617 ms) : 0, 670617
BytebuddyAgent [candidate] (673.298 ms) : 0, 673298
GlobalTracer [baseline] (308.384 ms) : 0, 308384
GlobalTracer [candidate] (309.554 ms) : 0, 309554
AppSec [baseline] (49.37 ms) : 0, 49370
AppSec [candidate] (49.374 ms) : 0, 49374
Remote Config [baseline] (651.676 µs) : 0, 652
Remote Config [candidate] (658.28 µs) : 0, 658
Telemetry [baseline] (7.566 ms) : 0, 7566
Telemetry [candidate] (7.59 ms) : 0, 7590
section appsec
BytebuddyAgent [baseline] (694.09 ms) : 0, 694090
BytebuddyAgent [candidate] (694.077 ms) : 0, 694077
GlobalTracer [baseline] (290.368 ms) : 0, 290368
GlobalTracer [candidate] (291.097 ms) : 0, 291097
AppSec [baseline] (149.235 ms) : 0, 149235
AppSec [candidate] (149.346 ms) : 0, 149346
Remote Config [baseline] (615.466 µs) : 0, 615
Remote Config [candidate] (619.411 µs) : 0, 619
Telemetry [baseline] (8.181 ms) : 0, 8181
Telemetry [candidate] (7.796 ms) : 0, 7796
IAST [baseline] (19.36 ms) : 0, 19360
IAST [candidate] (19.123 ms) : 0, 19123
section iast
BytebuddyAgent [baseline] (792.358 ms) : 0, 792358
BytebuddyAgent [candidate] (793.814 ms) : 0, 793814
GlobalTracer [baseline] (287.121 ms) : 0, 287121
GlobalTracer [candidate] (287.762 ms) : 0, 287762
AppSec [baseline] (50.239 ms) : 0, 50239
AppSec [candidate] (49.384 ms) : 0, 49384
Remote Config [baseline] (578.805 µs) : 0, 579
Remote Config [candidate] (562.883 µs) : 0, 563
Telemetry [baseline] (7.399 ms) : 0, 7399
Telemetry [candidate] (7.999 ms) : 0, 7999
IAST [baseline] (24.35 ms) : 0, 24350
IAST [candidate] (24.065 ms) : 0, 24065
section profiling
BytebuddyAgent [baseline] (676.144 ms) : 0, 676144
BytebuddyAgent [candidate] (675.973 ms) : 0, 675973
GlobalTracer [baseline] (379.252 ms) : 0, 379252
GlobalTracer [candidate] (379.598 ms) : 0, 379598
AppSec [baseline] (50.01 ms) : 0, 50010
AppSec [candidate] (50.074 ms) : 0, 50074
Remote Config [baseline] (698.855 µs) : 0, 699
Remote Config [candidate] (717.614 µs) : 0, 718
Telemetry [baseline] (7.455 ms) : 0, 7455
Telemetry [candidate] (7.479 ms) : 0, 7479
ProfilingAgent [baseline] (95.554 ms) : 0, 95554
ProfilingAgent [candidate] (95.919 ms) : 0, 95919
Profiling [baseline] (95.578 ms) : 0, 95578
Profiling [candidate] (95.943 ms) : 0, 95943
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section baseline
no_agent (368.608 µs) : 349, 388
. : milestone, 369,
iast (472.497 µs) : 451, 494
. : milestone, 472,
iast_FULL (539.343 µs) : 518, 561
. : milestone, 539,
iast_GLOBAL (490.393 µs) : 469, 511
. : milestone, 490,
iast_HARDCODED_SECRET_DISABLED (468.759 µs) : 447, 490
. : milestone, 469,
iast_INACTIVE (446.612 µs) : 426, 468
. : milestone, 447,
iast_TELEMETRY_OFF (461.224 µs) : 440, 483
. : milestone, 461,
tracing (445.88 µs) : 425, 467
. : milestone, 446,
section candidate
no_agent (372.193 µs) : 353, 392
. : milestone, 372,
iast (473.639 µs) : 453, 495
. : milestone, 474,
iast_FULL (533.155 µs) : 512, 554
. : milestone, 533,
iast_GLOBAL (494.385 µs) : 473, 516
. : milestone, 494,
iast_HARDCODED_SECRET_DISABLED (474.275 µs) : 453, 496
. : milestone, 474,
iast_INACTIVE (446.573 µs) : 426, 468
. : milestone, 447,
iast_TELEMETRY_OFF (471.931 µs) : 451, 493
. : milestone, 472,
tracing (440.356 µs) : 420, 461
. : milestone, 440,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section baseline
no_agent (1.356 ms) : 1337, 1375
. : milestone, 1356,
appsec (1.72 ms) : 1696, 1744
. : milestone, 1720,
appsec_no_iast (1.714 ms) : 1691, 1738
. : milestone, 1714,
iast (1.481 ms) : 1458, 1504
. : milestone, 1481,
profiling (1.485 ms) : 1461, 1509
. : milestone, 1485,
tracing (1.464 ms) : 1439, 1488
. : milestone, 1464,
section candidate
no_agent (1.346 ms) : 1327, 1365
. : milestone, 1346,
appsec (1.727 ms) : 1703, 1751
. : milestone, 1727,
appsec_no_iast (1.717 ms) : 1694, 1740
. : milestone, 1717,
iast (1.5 ms) : 1478, 1522
. : milestone, 1500,
profiling (1.483 ms) : 1458, 1508
. : milestone, 1483,
tracing (1.48 ms) : 1455, 1505
. : milestone, 1480,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section baseline
no_agent (1.458 ms) : 1447, 1470
. : milestone, 1458,
appsec (2.188 ms) : 2155, 2221
. : milestone, 2188,
iast (1.875 ms) : 1840, 1910
. : milestone, 1875,
iast_GLOBAL (1.912 ms) : 1878, 1947
. : milestone, 1912,
profiling (2.324 ms) : 2145, 2503
. : milestone, 2324,
tracing (1.831 ms) : 1799, 1863
. : milestone, 1831,
section candidate
no_agent (1.458 ms) : 1446, 1469
. : milestone, 1458,
appsec (2.194 ms) : 2160, 2228
. : milestone, 2194,
iast (1.879 ms) : 1844, 1914
. : milestone, 1879,
iast_GLOBAL (1.918 ms) : 1883, 1954
. : milestone, 1918,
profiling (1.845 ms) : 1812, 1878
. : milestone, 1845,
tracing (1.817 ms) : 1786, 1848
. : milestone, 1817,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~5affc93ea8, baseline=1.34.0-SNAPSHOT~f34dfb52a1
dateFormat X
axisFormat %s
section baseline
no_agent (15.336 s) : 15336000, 15336000
. : milestone, 15336000,
appsec (15.197 s) : 15197000, 15197000
. : milestone, 15197000,
iast (18.753 s) : 18753000, 18753000
. : milestone, 18753000,
iast_GLOBAL (17.848 s) : 17848000, 17848000
. : milestone, 17848000,
profiling (15.488 s) : 15488000, 15488000
. : milestone, 15488000,
tracing (15.04 s) : 15040000, 15040000
. : milestone, 15040000,
section candidate
no_agent (15.432 s) : 15432000, 15432000
. : milestone, 15432000,
appsec (15.06 s) : 15060000, 15060000
. : milestone, 15060000,
iast (18.725 s) : 18725000, 18725000
. : milestone, 18725000,
iast_GLOBAL (17.836 s) : 17836000, 17836000
. : milestone, 17836000,
profiling (15.026 s) : 15026000, 15026000
. : milestone, 15026000,
tracing (15.274 s) : 15274000, 15274000
. : milestone, 15274000,
|
4ad2913
to
8bac278
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks clean! Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I reviewed and added few comments.
If Stuarts can also chime in with the native-image
question, it could be great.
private static final JsonAdapter<InternalConfig> ADAPTER = | ||
new Moshi.Builder().build().adapter(InternalConfig.class); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I wonder if any Moshi
usage should be enclosed into a dedicated static class like here: https://github.com/DataDog/dd-trace-java/pull/6892/files
cc @mcculls
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In general yes, but in this case it isn't necessary because native image doesn't support dynamic-instrumentation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This might be something useful to document in some knowledge base. Any idea where to put it?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You could start a new doc under https://github.com/DataDog/dd-trace-java/tree/master/docs ?
Not quite FAQs, but would capture common patterns / recommendations
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good idea. I will start an Instrumentation development pattern document.
We can start aggregate similar tricks and knowledge in it.
add explicit exclusions of JDK packages in tests
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the changes! 👍
Don’t forget to squash your commits when merging.
What Does This Do
Add third party filtering and use it in SymDB / ER.
Motivation
Additional Notes
Jira ticket: DEBUG-1942