Pin system tests for release branch#11065
Merged
PerfectSlayer merged 2 commits intorelease/v1.61.xfrom Apr 9, 2026
Merged
Conversation
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055690
Total [baseline] (8.848 s) : 0, 8848009
Agent [candidate] (1.053 s) : 0, 1053459
Total [candidate] (8.819 s) : 0, 8818944
section iast
Agent [baseline] (1.222 s) : 0, 1222280
Total [baseline] (9.579 s) : 0, 9578776
Agent [candidate] (1.23 s) : 0, 1229846
Total [candidate] (9.561 s) : 0, 9561195
gantt
title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (631.381 ms) : 0, 631381
BytebuddyAgent [candidate] (631.302 ms) : 0, 631302
AgentMeter [baseline] (29.352 ms) : 0, 29352
AgentMeter [candidate] (29.472 ms) : 0, 29472
GlobalTracer [baseline] (248.848 ms) : 0, 248848
GlobalTracer [candidate] (248.149 ms) : 0, 248149
AppSec [baseline] (32.026 ms) : 0, 32026
AppSec [candidate] (31.974 ms) : 0, 31974
Debugger [baseline] (59.069 ms) : 0, 59069
Debugger [candidate] (59.178 ms) : 0, 59178
Remote Config [baseline] (600.507 µs) : 0, 601
Remote Config [candidate] (603.717 µs) : 0, 604
Telemetry [baseline] (8.116 ms) : 0, 8116
Telemetry [candidate] (8.081 ms) : 0, 8081
Flare Poller [baseline] (8.955 ms) : 0, 8955
Flare Poller [candidate] (7.498 ms) : 0, 7498
section iast
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (800.858 ms) : 0, 800858
BytebuddyAgent [candidate] (806.128 ms) : 0, 806128
AgentMeter [baseline] (11.307 ms) : 0, 11307
AgentMeter [candidate] (11.47 ms) : 0, 11470
GlobalTracer [baseline] (238.453 ms) : 0, 238453
GlobalTracer [candidate] (239.962 ms) : 0, 239962
AppSec [baseline] (30.363 ms) : 0, 30363
AppSec [candidate] (31.378 ms) : 0, 31378
Debugger [baseline] (61.891 ms) : 0, 61891
Debugger [candidate] (62.165 ms) : 0, 62165
Remote Config [baseline] (539.292 µs) : 0, 539
Remote Config [candidate] (542.303 µs) : 0, 542
Telemetry [baseline] (12.033 ms) : 0, 12033
Telemetry [candidate] (11.195 ms) : 0, 11195
Flare Poller [baseline] (3.476 ms) : 0, 3476
Flare Poller [candidate] (3.473 ms) : 0, 3473
IAST [baseline] (25.732 ms) : 0, 25732
IAST [candidate] (25.987 ms) : 0, 25987
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062160
Total [baseline] (11.003 s) : 0, 11003315
Agent [candidate] (1.058 s) : 0, 1057946
Total [candidate] (11.092 s) : 0, 11091662
section appsec
Agent [baseline] (1.253 s) : 0, 1252702
Total [baseline] (11.202 s) : 0, 11201952
Agent [candidate] (1.248 s) : 0, 1247889
Total [candidate] (11.157 s) : 0, 11157010
section iast
Agent [baseline] (1.238 s) : 0, 1238050
Total [baseline] (11.258 s) : 0, 11257551
Agent [candidate] (1.224 s) : 0, 1224187
Total [candidate] (11.323 s) : 0, 11322515
section profiling
Agent [baseline] (1.187 s) : 0, 1186914
Total [baseline] (10.983 s) : 0, 10982592
Agent [candidate] (1.182 s) : 0, 1181834
Total [candidate] (11.07 s) : 0, 11070309
gantt
title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.249 ms) : 0, 1249
crashtracking [candidate] (1.239 ms) : 0, 1239
BytebuddyAgent [baseline] (636.754 ms) : 0, 636754
BytebuddyAgent [candidate] (633.152 ms) : 0, 633152
AgentMeter [baseline] (29.569 ms) : 0, 29569
AgentMeter [candidate] (29.421 ms) : 0, 29421
GlobalTracer [baseline] (250.429 ms) : 0, 250429
GlobalTracer [candidate] (248.864 ms) : 0, 248864
AppSec [baseline] (32.168 ms) : 0, 32168
AppSec [candidate] (31.928 ms) : 0, 31928
Debugger [baseline] (60.226 ms) : 0, 60226
Debugger [candidate] (59.814 ms) : 0, 59814
Remote Config [baseline] (599.508 µs) : 0, 600
Remote Config [candidate] (590.46 µs) : 0, 590
Telemetry [baseline] (8.175 ms) : 0, 8175
Telemetry [candidate] (8.07 ms) : 0, 8070
Flare Poller [baseline] (6.753 ms) : 0, 6753
Flare Poller [candidate] (8.78 ms) : 0, 8780
section appsec
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.224 ms) : 0, 1224
BytebuddyAgent [baseline] (664.628 ms) : 0, 664628
BytebuddyAgent [candidate] (661.653 ms) : 0, 661653
AgentMeter [baseline] (12.03 ms) : 0, 12030
AgentMeter [candidate] (12.035 ms) : 0, 12035
GlobalTracer [baseline] (249.665 ms) : 0, 249665
GlobalTracer [candidate] (248.697 ms) : 0, 248697
AppSec [baseline] (185.07 ms) : 0, 185070
AppSec [candidate] (184.337 ms) : 0, 184337
Debugger [baseline] (66.187 ms) : 0, 66187
Debugger [candidate] (66.246 ms) : 0, 66246
Remote Config [baseline] (606.257 µs) : 0, 606
Remote Config [candidate] (592.723 µs) : 0, 593
Telemetry [baseline] (8.665 ms) : 0, 8665
Telemetry [candidate] (8.644 ms) : 0, 8644
Flare Poller [baseline] (3.57 ms) : 0, 3570
Flare Poller [candidate] (3.582 ms) : 0, 3582
IAST [baseline] (24.628 ms) : 0, 24628
IAST [candidate] (24.578 ms) : 0, 24578
section iast
crashtracking [baseline] (1.25 ms) : 0, 1250
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (810.953 ms) : 0, 810953
BytebuddyAgent [candidate] (801.7 ms) : 0, 801700
AgentMeter [baseline] (11.841 ms) : 0, 11841
AgentMeter [candidate] (11.382 ms) : 0, 11382
GlobalTracer [baseline] (242.309 ms) : 0, 242309
GlobalTracer [candidate] (238.663 ms) : 0, 238663
AppSec [baseline] (33.542 ms) : 0, 33542
AppSec [candidate] (32.273 ms) : 0, 32273
Debugger [baseline] (59.337 ms) : 0, 59337
Debugger [candidate] (58.737 ms) : 0, 58737
Remote Config [baseline] (528.932 µs) : 0, 529
Remote Config [candidate] (1.646 ms) : 0, 1646
Telemetry [baseline] (12.339 ms) : 0, 12339
Telemetry [candidate] (13.077 ms) : 0, 13077
Flare Poller [baseline] (3.41 ms) : 0, 3410
Flare Poller [candidate] (3.456 ms) : 0, 3456
IAST [baseline] (26.199 ms) : 0, 26199
IAST [candidate] (25.721 ms) : 0, 25721
section profiling
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (693.847 ms) : 0, 693847
BytebuddyAgent [candidate] (690.08 ms) : 0, 690080
AgentMeter [baseline] (9.174 ms) : 0, 9174
AgentMeter [candidate] (9.05 ms) : 0, 9050
GlobalTracer [baseline] (207.157 ms) : 0, 207157
GlobalTracer [candidate] (206.66 ms) : 0, 206660
AppSec [baseline] (32.445 ms) : 0, 32445
AppSec [candidate] (32.498 ms) : 0, 32498
Debugger [baseline] (65.599 ms) : 0, 65599
Debugger [candidate] (65.293 ms) : 0, 65293
Remote Config [baseline] (575.816 µs) : 0, 576
Remote Config [candidate] (570.723 µs) : 0, 571
Telemetry [baseline] (7.839 ms) : 0, 7839
Telemetry [candidate] (7.915 ms) : 0, 7915
Flare Poller [baseline] (3.561 ms) : 0, 3561
Flare Poller [candidate] (3.594 ms) : 0, 3594
ProfilingAgent [baseline] (94.141 ms) : 0, 94141
ProfilingAgent [candidate] (93.845 ms) : 0, 93845
Profiling [baseline] (94.719 ms) : 0, 94719
Profiling [candidate] (94.414 ms) : 0, 94414
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 4 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section baseline
no_agent (18.215 ms) : 18028, 18402
. : milestone, 18215,
appsec (18.647 ms) : 18458, 18835
. : milestone, 18647,
code_origins (18.089 ms) : 17911, 18266
. : milestone, 18089,
iast (18.393 ms) : 18208, 18577
. : milestone, 18393,
profiling (18.399 ms) : 18220, 18578
. : milestone, 18399,
tracing (17.834 ms) : 17659, 18009
. : milestone, 17834,
section candidate
no_agent (18.082 ms) : 17901, 18264
. : milestone, 18082,
appsec (18.601 ms) : 18417, 18784
. : milestone, 18601,
code_origins (17.721 ms) : 17548, 17893
. : milestone, 17721,
iast (18.066 ms) : 17887, 18244
. : milestone, 18066,
profiling (20.95 ms) : 20735, 21165
. : milestone, 20950,
tracing (17.848 ms) : 17671, 18024
. : milestone, 17848,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section baseline
no_agent (1.256 ms) : 1244, 1269
. : milestone, 1256,
iast (3.155 ms) : 3115, 3194
. : milestone, 3155,
iast_FULL (6.042 ms) : 5981, 6104
. : milestone, 6042,
iast_GLOBAL (3.704 ms) : 3642, 3765
. : milestone, 3704,
profiling (2.164 ms) : 2145, 2184
. : milestone, 2164,
tracing (1.914 ms) : 1898, 1930
. : milestone, 1914,
section candidate
no_agent (1.239 ms) : 1226, 1251
. : milestone, 1239,
iast (3.418 ms) : 3370, 3466
. : milestone, 3418,
iast_FULL (6.03 ms) : 5969, 6092
. : milestone, 6030,
iast_GLOBAL (3.79 ms) : 3719, 3862
. : milestone, 3790,
profiling (2.071 ms) : 2053, 2089
. : milestone, 2071,
tracing (1.857 ms) : 1842, 1873
. : milestone, 1857,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section baseline
no_agent (15.261 s) : 15261000, 15261000
. : milestone, 15261000,
appsec (14.941 s) : 14941000, 14941000
. : milestone, 14941000,
iast (18.292 s) : 18292000, 18292000
. : milestone, 18292000,
iast_GLOBAL (18.045 s) : 18045000, 18045000
. : milestone, 18045000,
profiling (15.032 s) : 15032000, 15032000
. : milestone, 15032000,
tracing (14.695 s) : 14695000, 14695000
. : milestone, 14695000,
section candidate
no_agent (15.542 s) : 15542000, 15542000
. : milestone, 15542000,
appsec (14.519 s) : 14519000, 14519000
. : milestone, 14519000,
iast (18.266 s) : 18266000, 18266000
. : milestone, 18266000,
iast_GLOBAL (18.305 s) : 18305000, 18305000
. : milestone, 18305000,
profiling (14.722 s) : 14722000, 14722000
. : milestone, 14722000,
tracing (14.987 s) : 14987000, 14987000
. : milestone, 14987000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~d1d243ff95, baseline=1.62.0-SNAPSHOT~68a2e632a8
dateFormat X
axisFormat %s
section baseline
no_agent (1.493 ms) : 1482, 1505
. : milestone, 1493,
appsec (3.838 ms) : 3613, 4063
. : milestone, 3838,
iast (2.285 ms) : 2215, 2355
. : milestone, 2285,
iast_GLOBAL (2.325 ms) : 2255, 2395
. : milestone, 2325,
profiling (2.102 ms) : 2046, 2157
. : milestone, 2102,
tracing (2.092 ms) : 2038, 2147
. : milestone, 2092,
section candidate
no_agent (1.488 ms) : 1476, 1499
. : milestone, 1488,
appsec (3.802 ms) : 3579, 4026
. : milestone, 3802,
iast (2.277 ms) : 2207, 2347
. : milestone, 2277,
iast_GLOBAL (2.326 ms) : 2256, 2396
. : milestone, 2326,
profiling (2.517 ms) : 2299, 2736
. : milestone, 2517,
tracing (2.086 ms) : 2032, 2140
. : milestone, 2086,
|
PerfectSlayer
approved these changes
Apr 9, 2026
Contributor
|
Retrying parametric tests |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR pins the system-tests reference for the release branch.