Migrate OtlpWriterCombinedTest from groovy to junit#11245
Migrate OtlpWriterCombinedTest from groovy to junit#11245gh-worker-dd-mergequeue-cf854d[bot] merged 23 commits intomasterfrom
Conversation
…, plus related tests
|
|
||
| @Test | ||
| void happyPathOverHttp() throws IOException, InterruptedException { | ||
| injectSysConfig(TRACE_OTEL_EXPORTER, "otlp"); |
There was a problem hiding this comment.
you can alternatively annotate the test method like that: @WithConfig(key = "service", value = "my_service")
There was a problem hiding this comment.
oh! this is great to know.
amarziali
left a comment
There was a problem hiding this comment.
thanks for the effort!
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071938
Total [baseline] (8.845 s) : 0, 8845469
Agent [candidate] (1.063 s) : 0, 1063337
Total [candidate] (8.834 s) : 0, 8834173
section iast
Agent [baseline] (1.245 s) : 0, 1244614
Total [baseline] (9.556 s) : 0, 9555751
Agent [candidate] (1.248 s) : 0, 1247513
Total [candidate] (9.531 s) : 0, 9530964
gantt
title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (641.272 ms) : 0, 641272
BytebuddyAgent [candidate] (636.528 ms) : 0, 636528
AgentMeter [baseline] (29.58 ms) : 0, 29580
AgentMeter [candidate] (29.543 ms) : 0, 29543
GlobalTracer [baseline] (250.218 ms) : 0, 250218
GlobalTracer [candidate] (248.955 ms) : 0, 248955
AppSec [baseline] (33.213 ms) : 0, 33213
AppSec [candidate] (32.711 ms) : 0, 32711
Debugger [baseline] (60.41 ms) : 0, 60410
Debugger [candidate] (59.712 ms) : 0, 59712
Remote Config [baseline] (613.451 µs) : 0, 613
Remote Config [candidate] (601.993 µs) : 0, 602
Telemetry [baseline] (10.092 ms) : 0, 10092
Telemetry [candidate] (10.687 ms) : 0, 10687
Flare Poller [baseline] (9.215 ms) : 0, 9215
Flare Poller [candidate] (7.422 ms) : 0, 7422
section iast
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.239 ms) : 0, 1239
BytebuddyAgent [baseline] (822.871 ms) : 0, 822871
BytebuddyAgent [candidate] (826.049 ms) : 0, 826049
AgentMeter [baseline] (11.345 ms) : 0, 11345
AgentMeter [candidate] (11.289 ms) : 0, 11289
GlobalTracer [baseline] (238.456 ms) : 0, 238456
GlobalTracer [candidate] (238.881 ms) : 0, 238881
AppSec [baseline] (29.991 ms) : 0, 29991
AppSec [candidate] (32.241 ms) : 0, 32241
Debugger [baseline] (63.511 ms) : 0, 63511
Debugger [candidate] (62.4 ms) : 0, 62400
Remote Config [baseline] (532.77 µs) : 0, 533
Remote Config [candidate] (519.169 µs) : 0, 519
Telemetry [baseline] (8.047 ms) : 0, 8047
Telemetry [candidate] (7.899 ms) : 0, 7899
Flare Poller [baseline] (3.4 ms) : 0, 3400
Flare Poller [candidate] (3.342 ms) : 0, 3342
IAST [baseline] (29.213 ms) : 0, 29213
IAST [candidate] (27.493 ms) : 0, 27493
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067142
Total [baseline] (11.108 s) : 0, 11108497
Agent [candidate] (1.07 s) : 0, 1069614
Total [candidate] (10.991 s) : 0, 10990566
section appsec
Agent [baseline] (1.273 s) : 0, 1273043
Total [baseline] (11.022 s) : 0, 11022463
Agent [candidate] (1.266 s) : 0, 1265541
Total [candidate] (11.03 s) : 0, 11029692
section iast
Agent [baseline] (1.248 s) : 0, 1247521
Total [baseline] (11.215 s) : 0, 11215472
Agent [candidate] (1.244 s) : 0, 1243662
Total [candidate] (11.284 s) : 0, 11283912
section profiling
Agent [baseline] (1.188 s) : 0, 1187683
Total [baseline] (10.917 s) : 0, 10916694
Agent [candidate] (1.186 s) : 0, 1186333
Total [candidate] (10.963 s) : 0, 10963427
gantt
title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.232 ms) : 0, 1232
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (638.088 ms) : 0, 638088
BytebuddyAgent [candidate] (639.016 ms) : 0, 639016
AgentMeter [baseline] (29.489 ms) : 0, 29489
AgentMeter [candidate] (29.646 ms) : 0, 29646
GlobalTracer [baseline] (249.603 ms) : 0, 249603
GlobalTracer [candidate] (249.498 ms) : 0, 249498
AppSec [baseline] (33.07 ms) : 0, 33070
AppSec [candidate] (32.999 ms) : 0, 32999
Debugger [baseline] (60.788 ms) : 0, 60788
Debugger [candidate] (60.765 ms) : 0, 60765
Remote Config [baseline] (599.475 µs) : 0, 599
Remote Config [candidate] (604.287 µs) : 0, 604
Telemetry [baseline] (9.995 ms) : 0, 9995
Telemetry [candidate] (10.726 ms) : 0, 10726
Flare Poller [baseline] (8.242 ms) : 0, 8242
Flare Poller [candidate] (9.04 ms) : 0, 9040
section appsec
crashtracking [baseline] (1.234 ms) : 0, 1234
crashtracking [candidate] (1.211 ms) : 0, 1211
BytebuddyAgent [baseline] (680.111 ms) : 0, 680111
BytebuddyAgent [candidate] (674.82 ms) : 0, 674820
AgentMeter [baseline] (12.36 ms) : 0, 12360
AgentMeter [candidate] (12.191 ms) : 0, 12191
GlobalTracer [baseline] (250.941 ms) : 0, 250941
GlobalTracer [candidate] (249.204 ms) : 0, 249204
AppSec [baseline] (186.019 ms) : 0, 186019
AppSec [candidate] (185.464 ms) : 0, 185464
Debugger [baseline] (64.872 ms) : 0, 64872
Debugger [candidate] (64.631 ms) : 0, 64631
Remote Config [baseline] (569.485 µs) : 0, 569
Remote Config [candidate] (566.241 µs) : 0, 566
Telemetry [baseline] (7.826 ms) : 0, 7826
Telemetry [candidate] (7.805 ms) : 0, 7805
Flare Poller [baseline] (7.377 ms) : 0, 7377
Flare Poller [candidate] (6.631 ms) : 0, 6631
IAST [baseline] (24.918 ms) : 0, 24918
IAST [candidate] (24.712 ms) : 0, 24712
section iast
crashtracking [baseline] (1.244 ms) : 0, 1244
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (826.892 ms) : 0, 826892
BytebuddyAgent [candidate] (823.473 ms) : 0, 823473
AgentMeter [baseline] (11.29 ms) : 0, 11290
AgentMeter [candidate] (11.309 ms) : 0, 11309
GlobalTracer [baseline] (237.237 ms) : 0, 237237
GlobalTracer [candidate] (237.499 ms) : 0, 237499
AppSec [baseline] (31.284 ms) : 0, 31284
AppSec [candidate] (30.479 ms) : 0, 30479
Debugger [baseline] (63.417 ms) : 0, 63417
Debugger [candidate] (62.99 ms) : 0, 62990
Remote Config [baseline] (528.087 µs) : 0, 528
Remote Config [candidate] (518.242 µs) : 0, 518
Telemetry [baseline] (8.012 ms) : 0, 8012
Telemetry [candidate] (7.985 ms) : 0, 7985
Flare Poller [baseline] (3.455 ms) : 0, 3455
Flare Poller [candidate] (3.353 ms) : 0, 3353
IAST [baseline] (28.037 ms) : 0, 28037
IAST [candidate] (28.813 ms) : 0, 28813
section profiling
ProfilingAgent [baseline] (93.757 ms) : 0, 93757
ProfilingAgent [candidate] (94.084 ms) : 0, 94084
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (693.16 ms) : 0, 693160
BytebuddyAgent [candidate] (692.06 ms) : 0, 692060
AgentMeter [baseline] (8.958 ms) : 0, 8958
AgentMeter [candidate] (8.908 ms) : 0, 8908
GlobalTracer [baseline] (208.181 ms) : 0, 208181
GlobalTracer [candidate] (207.844 ms) : 0, 207844
AppSec [baseline] (32.737 ms) : 0, 32737
AppSec [candidate] (32.694 ms) : 0, 32694
Debugger [baseline] (65.989 ms) : 0, 65989
Debugger [candidate] (65.93 ms) : 0, 65930
Remote Config [baseline] (568.556 µs) : 0, 569
Remote Config [candidate] (570.205 µs) : 0, 570
Telemetry [baseline] (8.092 ms) : 0, 8092
Telemetry [candidate] (8.141 ms) : 0, 8141
Flare Poller [baseline] (3.558 ms) : 0, 3558
Flare Poller [candidate] (3.543 ms) : 0, 3543
Profiling [baseline] (94.31 ms) : 0, 94310
Profiling [candidate] (94.631 ms) : 0, 94631
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section baseline
no_agent (19.14 ms) : 18943, 19337
. : milestone, 19140,
appsec (18.676 ms) : 18487, 18865
. : milestone, 18676,
code_origins (17.699 ms) : 17525, 17872
. : milestone, 17699,
iast (18.114 ms) : 17935, 18293
. : milestone, 18114,
profiling (18.354 ms) : 18170, 18537
. : milestone, 18354,
tracing (18.273 ms) : 18093, 18452
. : milestone, 18273,
section candidate
no_agent (19.21 ms) : 19016, 19405
. : milestone, 19210,
appsec (18.66 ms) : 18474, 18847
. : milestone, 18660,
code_origins (17.789 ms) : 17614, 17963
. : milestone, 17789,
iast (17.964 ms) : 17789, 18140
. : milestone, 17964,
profiling (19.474 ms) : 19275, 19673
. : milestone, 19474,
tracing (17.857 ms) : 17682, 18032
. : milestone, 17857,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section baseline
no_agent (1.236 ms) : 1225, 1247
. : milestone, 1236,
iast (3.54 ms) : 3482, 3598
. : milestone, 3540,
iast_FULL (5.994 ms) : 5933, 6055
. : milestone, 5994,
iast_GLOBAL (3.716 ms) : 3654, 3778
. : milestone, 3716,
profiling (2.62 ms) : 2595, 2646
. : milestone, 2620,
tracing (1.917 ms) : 1901, 1934
. : milestone, 1917,
section candidate
no_agent (1.241 ms) : 1229, 1253
. : milestone, 1241,
iast (3.387 ms) : 3339, 3434
. : milestone, 3387,
iast_FULL (5.809 ms) : 5751, 5867
. : milestone, 5809,
iast_GLOBAL (3.667 ms) : 3607, 3728
. : milestone, 3667,
profiling (2.215 ms) : 2195, 2235
. : milestone, 2215,
tracing (1.898 ms) : 1882, 1914
. : milestone, 1898,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section baseline
no_agent (15.073 s) : 15073000, 15073000
. : milestone, 15073000,
appsec (14.906 s) : 14906000, 14906000
. : milestone, 14906000,
iast (18.284 s) : 18284000, 18284000
. : milestone, 18284000,
iast_GLOBAL (17.773 s) : 17773000, 17773000
. : milestone, 17773000,
profiling (14.75 s) : 14750000, 14750000
. : milestone, 14750000,
tracing (14.787 s) : 14787000, 14787000
. : milestone, 14787000,
section candidate
no_agent (14.892 s) : 14892000, 14892000
. : milestone, 14892000,
appsec (14.939 s) : 14939000, 14939000
. : milestone, 14939000,
iast (18.19 s) : 18190000, 18190000
. : milestone, 18190000,
iast_GLOBAL (17.838 s) : 17838000, 17838000
. : milestone, 17838000,
profiling (14.962 s) : 14962000, 14962000
. : milestone, 14962000,
tracing (14.815 s) : 14815000, 14815000
. : milestone, 14815000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~a09c99e6ad, baseline=1.62.0-SNAPSHOT~e6cac64dfd
dateFormat X
axisFormat %s
section baseline
no_agent (1.5 ms) : 1488, 1512
. : milestone, 1500,
appsec (2.566 ms) : 2511, 2621
. : milestone, 2566,
iast (2.296 ms) : 2226, 2366
. : milestone, 2296,
iast_GLOBAL (2.33 ms) : 2260, 2400
. : milestone, 2330,
profiling (2.111 ms) : 2057, 2166
. : milestone, 2111,
tracing (2.085 ms) : 2032, 2139
. : milestone, 2085,
section candidate
no_agent (1.499 ms) : 1487, 1511
. : milestone, 1499,
appsec (3.825 ms) : 3604, 4047
. : milestone, 3825,
iast (2.297 ms) : 2227, 2367
. : milestone, 2297,
iast_GLOBAL (2.337 ms) : 2266, 2407
. : milestone, 2337,
profiling (2.124 ms) : 2068, 2179
. : milestone, 2124,
tracing (2.082 ms) : 2028, 2136
. : milestone, 2082,
|
|
Can you merge/rebase onto latest master - that will cleanup the commits for the already merged OTLP code and also fix the muzzle failure |
mcculls
left a comment
There was a problem hiding this comment.
LGTM - you can simplify it by using @WithConfig as Andrea pointed out
Also remember to delete the old OtlpWriterCombinedTest.groovy which this replaces.
|
/merge |
|
View all feedbacks in Devflow UI.
The expected merge time in
|
Motivation
A previous PR introduced new test file OtlpWriterCombinedTest.groovy. This PR migrates that test to junit as per the ongoing migration.
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any other useful labelsclose,fix, or any linking keywords when referencing an issueUse
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]
Note: Once your PR is ready to merge, add it to the merge queue by commenting
/merge./merge -ccancels the queue request./merge -f --reason "reason"skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.