-
Notifications
You must be signed in to change notification settings - Fork 312
Add support for JUnit 5.14 #9664
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
🎯 Code Coverage 🔗 Commit SHA: 5e1b025 | Docs | Was this helpful? Give us feedback! |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.033 s) : 0, 1032835
Total [baseline] (10.842 s) : 0, 10841789
Agent [candidate] (1.02 s) : 0, 1020215
Total [candidate] (10.779 s) : 0, 10778636
section appsec
Agent [baseline] (1.197 s) : 0, 1197352
Total [baseline] (11.075 s) : 0, 11074774
Agent [candidate] (1.194 s) : 0, 1193954
Total [candidate] (11.063 s) : 0, 11062833
section iast
Agent [baseline] (1.155 s) : 0, 1155171
Total [baseline] (10.917 s) : 0, 10917326
Agent [candidate] (1.152 s) : 0, 1152135
Total [candidate] (10.913 s) : 0, 10912752
section profiling
Agent [baseline] (1.174 s) : 0, 1174061
Total [baseline] (11.19 s) : 0, 11190450
Agent [candidate] (1.173 s) : 0, 1173406
Total [candidate] (11.131 s) : 0, 11131220
gantt
title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (702.625 ms) : 0, 702625
BytebuddyAgent [candidate] (693.833 ms) : 0, 693833
GlobalTracer [baseline] (246.32 ms) : 0, 246320
GlobalTracer [candidate] (244.183 ms) : 0, 244183
AppSec [baseline] (32.979 ms) : 0, 32979
AppSec [candidate] (32.925 ms) : 0, 32925
Debugger [baseline] (6.453 ms) : 0, 6453
Debugger [candidate] (6.364 ms) : 0, 6364
Remote Config [baseline] (691.003 µs) : 0, 691
Remote Config [candidate] (690.931 µs) : 0, 691
Telemetry [baseline] (9.374 ms) : 0, 9374
Telemetry [candidate] (9.288 ms) : 0, 9288
Flare Poller [baseline] (11.522 ms) : 0, 11522
Flare Poller [candidate] (10.238 ms) : 0, 10238
section appsec
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (719.023 ms) : 0, 719023
BytebuddyAgent [candidate] (716.685 ms) : 0, 716685
GlobalTracer [baseline] (236.24 ms) : 0, 236240
GlobalTracer [candidate] (235.983 ms) : 0, 235983
IAST [baseline] (24.982 ms) : 0, 24982
IAST [candidate] (24.876 ms) : 0, 24876
AppSec [baseline] (175.354 ms) : 0, 175354
AppSec [candidate] (173.992 ms) : 0, 173992
Debugger [baseline] (6.128 ms) : 0, 6128
Debugger [candidate] (6.073 ms) : 0, 6073
Remote Config [baseline] (641.605 µs) : 0, 642
Remote Config [candidate] (642.071 µs) : 0, 642
Telemetry [baseline] (8.495 ms) : 0, 8495
Telemetry [candidate] (9.25 ms) : 0, 9250
Flare Poller [baseline] (3.909 ms) : 0, 3909
Flare Poller [candidate] (3.942 ms) : 0, 3942
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (816.977 ms) : 0, 816977
BytebuddyAgent [candidate] (815.298 ms) : 0, 815298
GlobalTracer [baseline] (234.352 ms) : 0, 234352
GlobalTracer [candidate] (233.281 ms) : 0, 233281
IAST [baseline] (26.356 ms) : 0, 26356
IAST [candidate] (26.288 ms) : 0, 26288
AppSec [baseline] (35.177 ms) : 0, 35177
AppSec [candidate] (35.173 ms) : 0, 35173
Debugger [baseline] (6.151 ms) : 0, 6151
Debugger [candidate] (6.094 ms) : 0, 6094
Remote Config [baseline] (593.152 µs) : 0, 593
Remote Config [candidate] (618.406 µs) : 0, 618
Telemetry [baseline] (8.476 ms) : 0, 8476
Telemetry [candidate] (8.47 ms) : 0, 8470
Flare Poller [baseline] (4.261 ms) : 0, 4261
Flare Poller [candidate] (4.24 ms) : 0, 4240
section profiling
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (729.236 ms) : 0, 729236
BytebuddyAgent [candidate] (727.683 ms) : 0, 727683
GlobalTracer [baseline] (220.573 ms) : 0, 220573
GlobalTracer [candidate] (220.981 ms) : 0, 220981
AppSec [baseline] (33.159 ms) : 0, 33159
AppSec [candidate] (32.97 ms) : 0, 32970
Debugger [baseline] (7.343 ms) : 0, 7343
Debugger [candidate] (6.559 ms) : 0, 6559
Remote Config [baseline] (779.467 µs) : 0, 779
Remote Config [candidate] (846.654 µs) : 0, 847
Telemetry [baseline] (16.076 ms) : 0, 16076
Telemetry [candidate] (16.881 ms) : 0, 16881
Flare Poller [baseline] (4.152 ms) : 0, 4152
Flare Poller [candidate] (4.158 ms) : 0, 4158
ProfilingAgent [baseline] (108.337 ms) : 0, 108337
ProfilingAgent [candidate] (108.764 ms) : 0, 108764
Profiling [baseline] (109.014 ms) : 0, 109014
Profiling [candidate] (109.716 ms) : 0, 109716
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1019917
Total [baseline] (8.66 s) : 0, 8660032
Agent [candidate] (1.022 s) : 0, 1021550
Total [candidate] (8.687 s) : 0, 8687314
section iast
Agent [baseline] (1.156 s) : 0, 1155535
Total [baseline] (9.295 s) : 0, 9295486
Agent [candidate] (1.157 s) : 0, 1156506
Total [candidate] (9.288 s) : 0, 9287832
gantt
title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (693.469 ms) : 0, 693469
BytebuddyAgent [candidate] (695.066 ms) : 0, 695066
GlobalTracer [baseline] (243.364 ms) : 0, 243364
GlobalTracer [candidate] (243.423 ms) : 0, 243423
AppSec [baseline] (32.641 ms) : 0, 32641
AppSec [candidate] (32.655 ms) : 0, 32655
Debugger [baseline] (6.35 ms) : 0, 6350
Debugger [candidate] (6.349 ms) : 0, 6349
Remote Config [baseline] (681.618 µs) : 0, 682
Remote Config [candidate] (669.696 µs) : 0, 670
Telemetry [baseline] (9.301 ms) : 0, 9301
Telemetry [candidate] (9.325 ms) : 0, 9325
Flare Poller [baseline] (11.568 ms) : 0, 11568
Flare Poller [candidate] (11.436 ms) : 0, 11436
section iast
crashtracking [baseline] (1.48 ms) : 0, 1480
crashtracking [candidate] (1.473 ms) : 0, 1473
BytebuddyAgent [baseline] (816.731 ms) : 0, 816731
BytebuddyAgent [candidate] (817.643 ms) : 0, 817643
GlobalTracer [baseline] (234.244 ms) : 0, 234244
GlobalTracer [candidate] (234.892 ms) : 0, 234892
AppSec [baseline] (35.62 ms) : 0, 35620
AppSec [candidate] (34.238 ms) : 0, 34238
Debugger [baseline] (6.127 ms) : 0, 6127
Debugger [candidate] (6.184 ms) : 0, 6184
Remote Config [baseline] (593.461 µs) : 0, 593
Remote Config [candidate] (594.101 µs) : 0, 594
Telemetry [baseline] (8.628 ms) : 0, 8628
Telemetry [candidate] (8.514 ms) : 0, 8514
Flare Poller [baseline] (4.242 ms) : 0, 4242
Flare Poller [candidate] (4.21 ms) : 0, 4210
IAST [baseline] (26.608 ms) : 0, 26608
IAST [candidate] (27.422 ms) : 0, 27422
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section baseline
no_agent (36.683 ms) : 36387, 36979
. : milestone, 36683,
appsec (50.404 ms) : 49955, 50854
. : milestone, 50404,
code_origins (43.049 ms) : 42664, 43434
. : milestone, 43049,
iast (43.824 ms) : 43451, 44197
. : milestone, 43824,
profiling (47.66 ms) : 47205, 48115
. : milestone, 47660,
tracing (44.137 ms) : 43759, 44515
. : milestone, 44137,
section candidate
no_agent (36.995 ms) : 36696, 37294
. : milestone, 36995,
appsec (49.836 ms) : 49403, 50268
. : milestone, 49836,
code_origins (44.576 ms) : 44182, 44970
. : milestone, 44576,
iast (44.784 ms) : 44403, 45165
. : milestone, 44784,
profiling (46.465 ms) : 46033, 46897
. : milestone, 46465,
tracing (44.424 ms) : 44036, 44812
. : milestone, 44424,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section baseline
no_agent (4.316 ms) : 4265, 4367
. : milestone, 4316,
iast (10.528 ms) : 10346, 10710
. : milestone, 10528,
iast_FULL (14.167 ms) : 13884, 14451
. : milestone, 14167,
iast_GLOBAL (10.797 ms) : 10602, 10992
. : milestone, 10797,
profiling (8.602 ms) : 8468, 8735
. : milestone, 8602,
tracing (7.867 ms) : 7753, 7981
. : milestone, 7867,
section candidate
no_agent (4.377 ms) : 4321, 4433
. : milestone, 4377,
iast (9.427 ms) : 9269, 9585
. : milestone, 9427,
iast_FULL (14.712 ms) : 14418, 15007
. : milestone, 14712,
iast_GLOBAL (10.745 ms) : 10546, 10944
. : milestone, 10745,
profiling (8.662 ms) : 8527, 8797
. : milestone, 8662,
tracing (7.818 ms) : 7707, 7929
. : milestone, 7818,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
. : milestone, 1482,
appsec (2.473 ms) : 2423, 2524
. : milestone, 2473,
iast (2.218 ms) : 2155, 2282
. : milestone, 2218,
iast_GLOBAL (2.244 ms) : 2180, 2307
. : milestone, 2244,
profiling (2.481 ms) : 2264, 2698
. : milestone, 2481,
tracing (2.044 ms) : 1994, 2094
. : milestone, 2044,
section candidate
no_agent (1.485 ms) : 1473, 1496
. : milestone, 1485,
appsec (2.471 ms) : 2420, 2522
. : milestone, 2471,
iast (2.208 ms) : 2145, 2271
. : milestone, 2208,
iast_GLOBAL (2.26 ms) : 2196, 2324
. : milestone, 2260,
profiling (2.085 ms) : 2032, 2138
. : milestone, 2085,
tracing (2.029 ms) : 1980, 2079
. : milestone, 2029,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5e1b025bdb, baseline=1.54.0-SNAPSHOT~bd0c1fb5ad
dateFormat X
axisFormat %s
section baseline
no_agent (15.037 s) : 15037000, 15037000
. : milestone, 15037000,
appsec (15.007 s) : 15007000, 15007000
. : milestone, 15007000,
iast (18.2 s) : 18200000, 18200000
. : milestone, 18200000,
iast_GLOBAL (18.063 s) : 18063000, 18063000
. : milestone, 18063000,
profiling (15.325 s) : 15325000, 15325000
. : milestone, 15325000,
tracing (15.243 s) : 15243000, 15243000
. : milestone, 15243000,
section candidate
no_agent (15.549 s) : 15549000, 15549000
. : milestone, 15549000,
appsec (15.106 s) : 15106000, 15106000
. : milestone, 15106000,
iast (18.879 s) : 18879000, 18879000
. : milestone, 18879000,
iast_GLOBAL (17.669 s) : 17669000, 17669000
. : milestone, 17669000,
profiling (15.405 s) : 15405000, 15405000
. : milestone, 15405000,
tracing (15.413 s) : 15413000, 15413000
. : milestone, 15413000,
|
What Does This Do
ExecutionRequestFactory
logic to only consider final releases (removed references to release candidates)Motivation
Recently both 5.14 and 6.0 versions of JUnit were released.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any useful labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]