-
Notifications
You must be signed in to change notification settings - Fork 319
Fix system tests check step #10033
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Fix system tests check step #10033
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
amarziali
approved these changes
Nov 26, 2025
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062298
Total [baseline] (10.887 s) : 0, 10886567
Agent [candidate] (1.061 s) : 0, 1061190
Total [candidate] (10.817 s) : 0, 10816881
section appsec
Agent [baseline] (1.231 s) : 0, 1231254
Total [baseline] (11.003 s) : 0, 11002544
Agent [candidate] (1.231 s) : 0, 1230614
Total [candidate] (10.871 s) : 0, 10870583
section iast
Agent [baseline] (1.195 s) : 0, 1194976
Total [baseline] (11.287 s) : 0, 11287132
Agent [candidate] (1.194 s) : 0, 1194000
Total [candidate] (11.141 s) : 0, 11140653
section profiling
Agent [baseline] (1.205 s) : 0, 1204715
Total [baseline] (10.998 s) : 0, 10998410
Agent [candidate] (1.207 s) : 0, 1207093
Total [candidate] (10.92 s) : 0, 10919749
gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.517 ms) : 0, 1517
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (714.22 ms) : 0, 714220
BytebuddyAgent [candidate] (713.619 ms) : 0, 713619
GlobalTracer [baseline] (251.386 ms) : 0, 251386
GlobalTracer [candidate] (251.233 ms) : 0, 251233
AppSec [baseline] (32.391 ms) : 0, 32391
AppSec [candidate] (32.406 ms) : 0, 32406
Debugger [baseline] (6.493 ms) : 0, 6493
Debugger [candidate] (6.458 ms) : 0, 6458
Remote Config [baseline] (684.416 µs) : 0, 684
Remote Config [candidate] (683.34 µs) : 0, 683
Telemetry [baseline] (14.83 ms) : 0, 14830
Telemetry [candidate] (16.2 ms) : 0, 16200
Flare Poller [baseline] (5.667 ms) : 0, 5667
Flare Poller [candidate] (4.135 ms) : 0, 4135
section appsec
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.49 ms) : 0, 1490
BytebuddyAgent [baseline] (733.098 ms) : 0, 733098
BytebuddyAgent [candidate] (734.627 ms) : 0, 734627
GlobalTracer [baseline] (241.752 ms) : 0, 241752
GlobalTracer [candidate] (240.979 ms) : 0, 240979
IAST [baseline] (24.795 ms) : 0, 24795
IAST [candidate] (24.747 ms) : 0, 24747
AppSec [baseline] (175.868 ms) : 0, 175868
AppSec [candidate] (174.68 ms) : 0, 174680
Debugger [baseline] (6.368 ms) : 0, 6368
Debugger [candidate] (6.285 ms) : 0, 6285
Remote Config [baseline] (686.28 µs) : 0, 686
Remote Config [candidate] (692.106 µs) : 0, 692
Telemetry [baseline] (8.163 ms) : 0, 8163
Telemetry [candidate] (8.105 ms) : 0, 8105
Flare Poller [baseline] (4.048 ms) : 0, 4048
Flare Poller [candidate] (3.955 ms) : 0, 3955
section iast
crashtracking [baseline] (1.509 ms) : 0, 1509
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (833.476 ms) : 0, 833476
BytebuddyAgent [candidate] (832.384 ms) : 0, 832384
GlobalTracer [baseline] (238.093 ms) : 0, 238093
GlobalTracer [candidate] (238.111 ms) : 0, 238111
IAST [baseline] (33.516 ms) : 0, 33516
IAST [candidate] (32.119 ms) : 0, 32119
AppSec [baseline] (27.932 ms) : 0, 27932
AppSec [candidate] (29.508 ms) : 0, 29508
Debugger [baseline] (5.981 ms) : 0, 5981
Debugger [candidate] (6.075 ms) : 0, 6075
Remote Config [baseline] (609.676 µs) : 0, 610
Remote Config [candidate] (604.839 µs) : 0, 605
Telemetry [baseline] (7.848 ms) : 0, 7848
Telemetry [candidate] (7.922 ms) : 0, 7922
Flare Poller [baseline] (10.867 ms) : 0, 10867
Flare Poller [candidate] (10.932 ms) : 0, 10932
section profiling
crashtracking [baseline] (1.428 ms) : 0, 1428
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (738.033 ms) : 0, 738033
BytebuddyAgent [candidate] (739.624 ms) : 0, 739624
GlobalTracer [baseline] (224.238 ms) : 0, 224238
GlobalTracer [candidate] (223.771 ms) : 0, 223771
AppSec [baseline] (32.364 ms) : 0, 32364
AppSec [candidate] (32.398 ms) : 0, 32398
Debugger [baseline] (7.61 ms) : 0, 7610
Debugger [candidate] (7.816 ms) : 0, 7816
Remote Config [baseline] (1.438 ms) : 0, 1438
Remote Config [candidate] (690.666 µs) : 0, 691
Telemetry [baseline] (14.628 ms) : 0, 14628
Telemetry [candidate] (15.579 ms) : 0, 15579
Flare Poller [baseline] (4.186 ms) : 0, 4186
Flare Poller [candidate] (4.082 ms) : 0, 4082
ProfilingAgent [baseline] (111.662 ms) : 0, 111662
ProfilingAgent [candidate] (112.25 ms) : 0, 112250
Profiling [baseline] (112.323 ms) : 0, 112323
Profiling [candidate] (112.901 ms) : 0, 112901
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053343
Total [baseline] (8.684 s) : 0, 8683729
Agent [candidate] (1.051 s) : 0, 1050559
Total [candidate] (8.706 s) : 0, 8705881
section iast
Agent [baseline] (1.195 s) : 0, 1195363
Total [baseline] (9.343 s) : 0, 9343029
Agent [candidate] (1.193 s) : 0, 1192910
Total [candidate] (9.329 s) : 0, 9328766
gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.489 ms) : 0, 1489
crashtracking [candidate] (1.497 ms) : 0, 1497
BytebuddyAgent [baseline] (708.611 ms) : 0, 708611
BytebuddyAgent [candidate] (706.57 ms) : 0, 706570
GlobalTracer [baseline] (248.827 ms) : 0, 248827
GlobalTracer [candidate] (248.626 ms) : 0, 248626
AppSec [baseline] (32.119 ms) : 0, 32119
AppSec [candidate] (31.902 ms) : 0, 31902
Debugger [baseline] (6.389 ms) : 0, 6389
Debugger [candidate] (6.379 ms) : 0, 6379
Remote Config [baseline] (674.446 µs) : 0, 674
Remote Config [candidate] (666.75 µs) : 0, 667
Telemetry [baseline] (16.235 ms) : 0, 16235
Telemetry [candidate] (15.292 ms) : 0, 15292
Flare Poller [baseline] (4.097 ms) : 0, 4097
Flare Poller [candidate] (4.775 ms) : 0, 4775
section iast
crashtracking [baseline] (1.5 ms) : 0, 1500
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (833.524 ms) : 0, 833524
BytebuddyAgent [candidate] (831.263 ms) : 0, 831263
GlobalTracer [baseline] (238.285 ms) : 0, 238285
GlobalTracer [candidate] (238.178 ms) : 0, 238178
IAST [baseline] (31.982 ms) : 0, 31982
IAST [candidate] (30.844 ms) : 0, 30844
AppSec [baseline] (29.837 ms) : 0, 29837
AppSec [candidate] (30.597 ms) : 0, 30597
Debugger [baseline] (6.069 ms) : 0, 6069
Debugger [candidate] (6.101 ms) : 0, 6101
Remote Config [baseline] (615.475 µs) : 0, 615
Remote Config [candidate] (609.61 µs) : 0, 610
Telemetry [baseline] (7.92 ms) : 0, 7920
Telemetry [candidate] (7.965 ms) : 0, 7965
Flare Poller [baseline] (10.761 ms) : 0, 10761
Flare Poller [candidate] (10.925 ms) : 0, 10925
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 17 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section baseline
no_agent (1.224 ms) : 1211, 1236
. : milestone, 1224,
iast (3.265 ms) : 3217, 3312
. : milestone, 3265,
iast_FULL (5.808 ms) : 5750, 5866
. : milestone, 5808,
iast_GLOBAL (3.708 ms) : 3642, 3773
. : milestone, 3708,
profiling (2.085 ms) : 2067, 2104
. : milestone, 2085,
tracing (1.796 ms) : 1781, 1811
. : milestone, 1796,
section candidate
no_agent (1.201 ms) : 1190, 1213
. : milestone, 1201,
iast (3.306 ms) : 3266, 3346
. : milestone, 3306,
iast_FULL (5.949 ms) : 5889, 6010
. : milestone, 5949,
iast_GLOBAL (3.629 ms) : 3578, 3680
. : milestone, 3629,
profiling (1.915 ms) : 1899, 1930
. : milestone, 1915,
tracing (1.783 ms) : 1768, 1798
. : milestone, 1783,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section baseline
no_agent (17.936 ms) : 17754, 18119
. : milestone, 17936,
appsec (18.596 ms) : 18407, 18784
. : milestone, 18596,
code_origins (17.595 ms) : 17422, 17768
. : milestone, 17595,
iast (17.745 ms) : 17569, 17920
. : milestone, 17745,
profiling (18.823 ms) : 18638, 19008
. : milestone, 18823,
tracing (17.734 ms) : 17557, 17911
. : milestone, 17734,
section candidate
no_agent (18.38 ms) : 18189, 18570
. : milestone, 18380,
appsec (18.551 ms) : 18362, 18740
. : milestone, 18551,
code_origins (17.831 ms) : 17654, 18007
. : milestone, 17831,
iast (18.082 ms) : 17900, 18264
. : milestone, 18082,
profiling (18.529 ms) : 18338, 18720
. : milestone, 18529,
tracing (17.771 ms) : 17594, 17948
. : milestone, 17771,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
. : milestone, 1476,
appsec (3.709 ms) : 3492, 3925
. : milestone, 3709,
iast (2.214 ms) : 2149, 2279
. : milestone, 2214,
iast_GLOBAL (2.254 ms) : 2189, 2319
. : milestone, 2254,
profiling (2.086 ms) : 2032, 2141
. : milestone, 2086,
tracing (2.044 ms) : 1993, 2095
. : milestone, 2044,
section candidate
no_agent (1.478 ms) : 1467, 1490
. : milestone, 1478,
appsec (3.632 ms) : 3419, 3845
. : milestone, 3632,
iast (2.219 ms) : 2154, 2284
. : milestone, 2219,
iast_GLOBAL (2.256 ms) : 2191, 2321
. : milestone, 2256,
profiling (2.092 ms) : 2038, 2147
. : milestone, 2092,
tracing (2.046 ms) : 1995, 2097
. : milestone, 2046,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~9b8b7d8ae5, baseline=1.57.0-SNAPSHOT~4447d5ee04
dateFormat X
axisFormat %s
section baseline
no_agent (15.049 s) : 15049000, 15049000
. : milestone, 15049000,
appsec (14.761 s) : 14761000, 14761000
. : milestone, 14761000,
iast (18.118 s) : 18118000, 18118000
. : milestone, 18118000,
iast_GLOBAL (17.902 s) : 17902000, 17902000
. : milestone, 17902000,
profiling (15.214 s) : 15214000, 15214000
. : milestone, 15214000,
tracing (14.935 s) : 14935000, 14935000
. : milestone, 14935000,
section candidate
no_agent (15.479 s) : 15479000, 15479000
. : milestone, 15479000,
appsec (14.88 s) : 14880000, 14880000
. : milestone, 14880000,
iast (18.807 s) : 18807000, 18807000
. : milestone, 18807000,
iast_GLOBAL (17.927 s) : 17927000, 17927000
. : milestone, 17927000,
profiling (15.272 s) : 15272000, 15272000
. : milestone, 15272000,
tracing (14.717 s) : 14717000, 14717000
. : milestone, 14717000,
|
bric3
approved these changes
Nov 26, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
comp: tooling
Build & Tooling
tag: no release notes
Changes to exclude from release notes
type: bug
Bug report and fix
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR makes sure the system tests run.
Motivation
Even if build is failing and main is skipped, check is run (which was not with the last update) but check does not faill.
Check will now verify the status of both build (can fail) and main (can be skipped or fail).
Here is a case where system tests failed but the PR is ready to merge:
Here is the workflow status showing the check step is not verifying properly the build and main step despite being run when main is skipped:
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any useful labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]