Abort bootstrap JDK tool tests#11134
Abort bootstrap JDK tool tests#11134gh-worker-dd-mergequeue-cf854d[bot] merged 4 commits intomasterfrom
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060414
Total [baseline] (11.031 s) : 0, 11031001
Agent [candidate] (1.055 s) : 0, 1055375
Total [candidate] (11.124 s) : 0, 11124358
section appsec
Agent [baseline] (1.247 s) : 0, 1247219
Total [baseline] (11.102 s) : 0, 11102141
Agent [candidate] (1.245 s) : 0, 1244807
Total [candidate] (11.136 s) : 0, 11136330
section iast
Agent [baseline] (1.23 s) : 0, 1230227
Total [baseline] (11.342 s) : 0, 11341832
Agent [candidate] (1.222 s) : 0, 1222386
Total [candidate] (11.413 s) : 0, 11412568
section profiling
Agent [baseline] (1.189 s) : 0, 1188928
Total [baseline] (11.023 s) : 0, 11022544
Agent [candidate] (1.185 s) : 0, 1184670
Total [candidate] (11.054 s) : 0, 11053745
gantt
title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (635.936 ms) : 0, 635936
BytebuddyAgent [candidate] (631.244 ms) : 0, 631244
AgentMeter [baseline] (29.596 ms) : 0, 29596
AgentMeter [candidate] (29.351 ms) : 0, 29351
GlobalTracer [baseline] (248.248 ms) : 0, 248248
GlobalTracer [candidate] (248.193 ms) : 0, 248193
AppSec [baseline] (32.315 ms) : 0, 32315
AppSec [candidate] (32.312 ms) : 0, 32312
Debugger [baseline] (59.878 ms) : 0, 59878
Debugger [candidate] (59.933 ms) : 0, 59933
Remote Config [baseline] (593.583 µs) : 0, 594
Remote Config [candidate] (628.013 µs) : 0, 628
Telemetry [baseline] (8.03 ms) : 0, 8030
Telemetry [candidate] (8.058 ms) : 0, 8058
Flare Poller [baseline] (8.302 ms) : 0, 8302
Flare Poller [candidate] (8.302 ms) : 0, 8302
section appsec
crashtracking [baseline] (1.231 ms) : 0, 1231
crashtracking [candidate] (1.244 ms) : 0, 1244
BytebuddyAgent [baseline] (661.322 ms) : 0, 661322
BytebuddyAgent [candidate] (660.383 ms) : 0, 660383
AgentMeter [baseline] (12.1 ms) : 0, 12100
AgentMeter [candidate] (12.02 ms) : 0, 12020
GlobalTracer [baseline] (248.179 ms) : 0, 248179
GlobalTracer [candidate] (247.491 ms) : 0, 247491
IAST [baseline] (24.551 ms) : 0, 24551
IAST [candidate] (24.422 ms) : 0, 24422
AppSec [baseline] (185.099 ms) : 0, 185099
AppSec [candidate] (184.621 ms) : 0, 184621
Debugger [baseline] (65.726 ms) : 0, 65726
Debugger [candidate] (65.743 ms) : 0, 65743
Remote Config [baseline] (613.741 µs) : 0, 614
Remote Config [candidate] (615.623 µs) : 0, 616
Telemetry [baseline] (8.51 ms) : 0, 8510
Telemetry [candidate] (8.471 ms) : 0, 8471
Flare Poller [baseline] (3.559 ms) : 0, 3559
Flare Poller [candidate] (3.529 ms) : 0, 3529
section iast
crashtracking [baseline] (1.233 ms) : 0, 1233
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (804.87 ms) : 0, 804870
BytebuddyAgent [candidate] (799.321 ms) : 0, 799321
AgentMeter [baseline] (11.652 ms) : 0, 11652
AgentMeter [candidate] (11.469 ms) : 0, 11469
GlobalTracer [baseline] (239.807 ms) : 0, 239807
GlobalTracer [candidate] (238.324 ms) : 0, 238324
IAST [baseline] (25.924 ms) : 0, 25924
IAST [candidate] (25.671 ms) : 0, 25671
AppSec [baseline] (32.175 ms) : 0, 32175
AppSec [candidate] (32.936 ms) : 0, 32936
Debugger [baseline] (64.423 ms) : 0, 64423
Debugger [candidate] (63.613 ms) : 0, 63613
Remote Config [baseline] (559.102 µs) : 0, 559
Remote Config [candidate] (555.876 µs) : 0, 556
Telemetry [baseline] (9.711 ms) : 0, 9711
Telemetry [candidate] (9.702 ms) : 0, 9702
Flare Poller [baseline] (3.631 ms) : 0, 3631
Flare Poller [candidate] (3.58 ms) : 0, 3580
section profiling
crashtracking [baseline] (1.169 ms) : 0, 1169
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (691.829 ms) : 0, 691829
BytebuddyAgent [candidate] (691.733 ms) : 0, 691733
AgentMeter [baseline] (9.115 ms) : 0, 9115
AgentMeter [candidate] (9.146 ms) : 0, 9146
GlobalTracer [baseline] (208.584 ms) : 0, 208584
GlobalTracer [candidate] (206.89 ms) : 0, 206890
AppSec [baseline] (32.999 ms) : 0, 32999
AppSec [candidate] (32.867 ms) : 0, 32867
Debugger [baseline] (66.262 ms) : 0, 66262
Debugger [candidate] (65.657 ms) : 0, 65657
Remote Config [baseline] (592.844 µs) : 0, 593
Remote Config [candidate] (571.966 µs) : 0, 572
Telemetry [baseline] (7.927 ms) : 0, 7927
Telemetry [candidate] (7.78 ms) : 0, 7780
Flare Poller [baseline] (3.591 ms) : 0, 3591
Flare Poller [candidate] (3.565 ms) : 0, 3565
ProfilingAgent [baseline] (95.438 ms) : 0, 95438
ProfilingAgent [candidate] (93.924 ms) : 0, 93924
Profiling [baseline] (96.025 ms) : 0, 96025
Profiling [candidate] (94.492 ms) : 0, 94492
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068624
Total [baseline] (8.961 s) : 0, 8961167
Agent [candidate] (1.055 s) : 0, 1054676
Total [candidate] (8.84 s) : 0, 8839620
section iast
Agent [baseline] (1.236 s) : 0, 1236076
Total [baseline] (9.569 s) : 0, 9568931
Agent [candidate] (1.222 s) : 0, 1221536
Total [candidate] (9.577 s) : 0, 9576537
gantt
title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.246 ms) : 0, 1246
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (641.995 ms) : 0, 641995
BytebuddyAgent [candidate] (631.252 ms) : 0, 631252
AgentMeter [baseline] (29.804 ms) : 0, 29804
AgentMeter [candidate] (29.228 ms) : 0, 29228
GlobalTracer [baseline] (250.365 ms) : 0, 250365
GlobalTracer [candidate] (247.846 ms) : 0, 247846
AppSec [baseline] (32.544 ms) : 0, 32544
AppSec [candidate] (32.364 ms) : 0, 32364
Debugger [baseline] (59.379 ms) : 0, 59379
Debugger [candidate] (58.912 ms) : 0, 58912
Remote Config [baseline] (622.045 µs) : 0, 622
Remote Config [candidate] (592.177 µs) : 0, 592
Telemetry [baseline] (8.154 ms) : 0, 8154
Telemetry [candidate] (7.981 ms) : 0, 7981
Flare Poller [baseline] (8.083 ms) : 0, 8083
Flare Poller [candidate] (9.135 ms) : 0, 9135
section iast
crashtracking [baseline] (1.259 ms) : 0, 1259
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (810.872 ms) : 0, 810872
BytebuddyAgent [candidate] (799.406 ms) : 0, 799406
AgentMeter [baseline] (11.807 ms) : 0, 11807
AgentMeter [candidate] (11.447 ms) : 0, 11447
GlobalTracer [baseline] (240.14 ms) : 0, 240140
GlobalTracer [candidate] (238.696 ms) : 0, 238696
IAST [baseline] (25.939 ms) : 0, 25939
IAST [candidate] (26.435 ms) : 0, 26435
AppSec [baseline] (31.548 ms) : 0, 31548
AppSec [candidate] (31.365 ms) : 0, 31365
Debugger [baseline] (64.615 ms) : 0, 64615
Debugger [candidate] (63.393 ms) : 0, 63393
Remote Config [baseline] (554.968 µs) : 0, 555
Remote Config [candidate] (541.972 µs) : 0, 542
Telemetry [baseline] (9.457 ms) : 0, 9457
Telemetry [candidate] (9.322 ms) : 0, 9322
Flare Poller [baseline] (3.51 ms) : 0, 3510
Flare Poller [candidate] (3.591 ms) : 0, 3591
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section baseline
no_agent (1.246 ms) : 1234, 1259
. : milestone, 1246,
iast (3.39 ms) : 3339, 3440
. : milestone, 3390,
iast_FULL (6.005 ms) : 5944, 6065
. : milestone, 6005,
iast_GLOBAL (3.669 ms) : 3610, 3727
. : milestone, 3669,
profiling (2.116 ms) : 2096, 2136
. : milestone, 2116,
tracing (1.914 ms) : 1898, 1930
. : milestone, 1914,
section candidate
no_agent (1.256 ms) : 1244, 1269
. : milestone, 1256,
iast (3.384 ms) : 3337, 3432
. : milestone, 3384,
iast_FULL (6.203 ms) : 6139, 6267
. : milestone, 6203,
iast_GLOBAL (3.701 ms) : 3641, 3762
. : milestone, 3701,
profiling (2.057 ms) : 2038, 2076
. : milestone, 2057,
tracing (1.966 ms) : 1949, 1984
. : milestone, 1966,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section baseline
no_agent (19.445 ms) : 19244, 19645
. : milestone, 19445,
appsec (18.762 ms) : 18577, 18947
. : milestone, 18762,
code_origins (17.835 ms) : 17659, 18012
. : milestone, 17835,
iast (17.908 ms) : 17731, 18085
. : milestone, 17908,
profiling (18.119 ms) : 17941, 18297
. : milestone, 18119,
tracing (18.061 ms) : 17883, 18239
. : milestone, 18061,
section candidate
no_agent (18.301 ms) : 18111, 18491
. : milestone, 18301,
appsec (18.806 ms) : 18619, 18994
. : milestone, 18806,
code_origins (18.005 ms) : 17829, 18182
. : milestone, 18005,
iast (17.989 ms) : 17811, 18166
. : milestone, 17989,
profiling (18.304 ms) : 18122, 18487
. : milestone, 18304,
tracing (17.893 ms) : 17716, 18070
. : milestone, 17893,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section baseline
no_agent (15.648 s) : 15648000, 15648000
. : milestone, 15648000,
appsec (14.73 s) : 14730000, 14730000
. : milestone, 14730000,
iast (18.141 s) : 18141000, 18141000
. : milestone, 18141000,
iast_GLOBAL (17.799 s) : 17799000, 17799000
. : milestone, 17799000,
profiling (15.396 s) : 15396000, 15396000
. : milestone, 15396000,
tracing (15.069 s) : 15069000, 15069000
. : milestone, 15069000,
section candidate
no_agent (15.052 s) : 15052000, 15052000
. : milestone, 15052000,
appsec (14.565 s) : 14565000, 14565000
. : milestone, 14565000,
iast (17.957 s) : 17957000, 17957000
. : milestone, 17957000,
iast_GLOBAL (17.793 s) : 17793000, 17793000
. : milestone, 17793000,
profiling (14.687 s) : 14687000, 14687000
. : milestone, 14687000,
tracing (14.955 s) : 14955000, 14955000
. : milestone, 14955000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~4ddeeb1d20, baseline=1.62.0-SNAPSHOT~81e22942d7
dateFormat X
axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
. : milestone, 1483,
appsec (3.816 ms) : 3594, 4037
. : milestone, 3816,
iast (2.269 ms) : 2199, 2338
. : milestone, 2269,
iast_GLOBAL (2.314 ms) : 2244, 2384
. : milestone, 2314,
profiling (2.096 ms) : 2041, 2151
. : milestone, 2096,
tracing (2.069 ms) : 2015, 2122
. : milestone, 2069,
section candidate
no_agent (1.482 ms) : 1471, 1494
. : milestone, 1482,
appsec (3.823 ms) : 3603, 4044
. : milestone, 3823,
iast (2.262 ms) : 2192, 2331
. : milestone, 2262,
iast_GLOBAL (2.314 ms) : 2244, 2384
. : milestone, 2314,
profiling (2.095 ms) : 2040, 2150
. : milestone, 2095,
tracing (2.097 ms) : 2043, 2152
. : milestone, 2097,
|
mcculls
left a comment
There was a problem hiding this comment.
Thanks for the comprehensive test coverage
|
/merge |
|
View all feedbacks in Devflow UI.
This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
devflow unqueued this merge request: It did not become mergeable within the expected time |
2504116 to
2f8fa46
Compare
2f8fa46 to
4ddeeb1
Compare
|
/merge |
|
View all feedbacks in Devflow UI.
The expected merge time in
|
What Does This Do
This pull request ensures that tests involving the bootstrap JDK tools are aborted as needed to handle errors gracefully.
Tests for #11133
Smoke tests revealed a few other tools to handle.