-
Notifications
You must be signed in to change notification settings - Fork 312
Improve back-porting script #9638
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
🎯 Code Coverage 🔗 Commit SHA: 2015545 | Docs | Was this helpful? Give us feedback! |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.014 s) : 0, 1013698
Total [baseline] (10.705 s) : 0, 10705082
Agent [candidate] (1.015 s) : 0, 1014913
Total [candidate] (10.781 s) : 0, 10780521
section appsec
Agent [baseline] (1.196 s) : 0, 1196417
Total [baseline] (10.972 s) : 0, 10971528
Agent [candidate] (1.197 s) : 0, 1196810
Total [candidate] (11.063 s) : 0, 11063167
section iast
Agent [baseline] (1.155 s) : 0, 1154833
Total [baseline] (10.988 s) : 0, 10988225
Agent [candidate] (1.148 s) : 0, 1148253
Total [candidate] (11.03 s) : 0, 11029944
section profiling
Agent [baseline] (1.157 s) : 0, 1157319
Total [baseline] (11.152 s) : 0, 11151779
Agent [candidate] (1.154 s) : 0, 1153675
Total [candidate] (11.064 s) : 0, 11063891
gantt
title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (690.398 ms) : 0, 690398
BytebuddyAgent [candidate] (690.902 ms) : 0, 690902
GlobalTracer [baseline] (242.371 ms) : 0, 242371
GlobalTracer [candidate] (242.941 ms) : 0, 242941
AppSec [baseline] (31.406 ms) : 0, 31406
AppSec [candidate] (31.318 ms) : 0, 31318
Debugger [baseline] (6.389 ms) : 0, 6389
Debugger [candidate] (6.361 ms) : 0, 6361
Remote Config [baseline] (690.18 µs) : 0, 690
Remote Config [candidate] (680.293 µs) : 0, 680
Telemetry [baseline] (9.058 ms) : 0, 9058
Telemetry [candidate] (9.077 ms) : 0, 9077
Flare Poller [baseline] (10.769 ms) : 0, 10769
Flare Poller [candidate] (10.942 ms) : 0, 10942
section appsec
crashtracking [baseline] (1.489 ms) : 0, 1489
crashtracking [candidate] (1.473 ms) : 0, 1473
BytebuddyAgent [baseline] (720.365 ms) : 0, 720365
BytebuddyAgent [candidate] (719.572 ms) : 0, 719572
GlobalTracer [baseline] (236.174 ms) : 0, 236174
GlobalTracer [candidate] (236.26 ms) : 0, 236260
AppSec [baseline] (172.104 ms) : 0, 172104
AppSec [candidate] (172.46 ms) : 0, 172460
Debugger [baseline] (6.126 ms) : 0, 6126
Debugger [candidate] (6.145 ms) : 0, 6145
Remote Config [baseline] (640.47 µs) : 0, 640
Remote Config [candidate] (638.984 µs) : 0, 639
Telemetry [baseline] (9.204 ms) : 0, 9204
Telemetry [candidate] (9.887 ms) : 0, 9887
Flare Poller [baseline] (4.033 ms) : 0, 4033
Flare Poller [candidate] (4.034 ms) : 0, 4034
IAST [baseline] (25.087 ms) : 0, 25087
IAST [candidate] (25.089 ms) : 0, 25089
section iast
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (820.077 ms) : 0, 820077
BytebuddyAgent [candidate] (813.256 ms) : 0, 813256
GlobalTracer [baseline] (232.333 ms) : 0, 232333
GlobalTracer [candidate] (232.14 ms) : 0, 232140
AppSec [baseline] (34.021 ms) : 0, 34021
AppSec [candidate] (33.313 ms) : 0, 33313
Debugger [baseline] (5.987 ms) : 0, 5987
Debugger [candidate] (6.119 ms) : 0, 6119
Remote Config [baseline] (581.564 µs) : 0, 582
Remote Config [candidate] (598.506 µs) : 0, 599
Telemetry [baseline] (8.104 ms) : 0, 8104
Telemetry [candidate] (8.389 ms) : 0, 8389
Flare Poller [baseline] (4.237 ms) : 0, 4237
Flare Poller [candidate] (4.247 ms) : 0, 4247
IAST [baseline] (26.484 ms) : 0, 26484
IAST [candidate] (27.365 ms) : 0, 27365
section profiling
ProfilingAgent [baseline] (104.07 ms) : 0, 104070
ProfilingAgent [candidate] (100.902 ms) : 0, 100902
crashtracking [baseline] (1.417 ms) : 0, 1417
crashtracking [candidate] (1.411 ms) : 0, 1411
BytebuddyAgent [baseline] (720.649 ms) : 0, 720649
BytebuddyAgent [candidate] (720.901 ms) : 0, 720901
GlobalTracer [baseline] (218.347 ms) : 0, 218347
GlobalTracer [candidate] (218.127 ms) : 0, 218127
AppSec [baseline] (31.561 ms) : 0, 31561
AppSec [candidate] (31.423 ms) : 0, 31423
Debugger [baseline] (7.306 ms) : 0, 7306
Debugger [candidate] (6.548 ms) : 0, 6548
Remote Config [baseline] (740.69 µs) : 0, 741
Remote Config [candidate] (713.645 µs) : 0, 714
Telemetry [baseline] (15.805 ms) : 0, 15805
Telemetry [candidate] (16.423 ms) : 0, 16423
Flare Poller [baseline] (4.285 ms) : 0, 4285
Flare Poller [candidate] (4.237 ms) : 0, 4237
Profiling [baseline] (105.333 ms) : 0, 105333
Profiling [candidate] (102.1 ms) : 0, 102100
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1016844
Total [baseline] (8.652 s) : 0, 8651521
Agent [candidate] (1.013 s) : 0, 1013074
Total [candidate] (8.659 s) : 0, 8658683
section iast
Agent [baseline] (1.148 s) : 0, 1147692
Total [baseline] (9.21 s) : 0, 9209509
Agent [candidate] (1.147 s) : 0, 1146906
Total [candidate] (9.255 s) : 0, 9255099
gantt
title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.484 ms) : 0, 1484
BytebuddyAgent [baseline] (692.579 ms) : 0, 692579
BytebuddyAgent [candidate] (690.879 ms) : 0, 690879
GlobalTracer [baseline] (244.909 ms) : 0, 244909
GlobalTracer [candidate] (243.136 ms) : 0, 243136
AppSec [baseline] (31.714 ms) : 0, 31714
AppSec [candidate] (31.471 ms) : 0, 31471
Debugger [baseline] (6.412 ms) : 0, 6412
Debugger [candidate] (6.41 ms) : 0, 6410
Remote Config [baseline] (710.131 µs) : 0, 710
Remote Config [candidate] (668.327 µs) : 0, 668
Telemetry [baseline] (9.188 ms) : 0, 9188
Telemetry [candidate] (9.177 ms) : 0, 9177
Flare Poller [baseline] (8.723 ms) : 0, 8723
Flare Poller [candidate] (8.777 ms) : 0, 8777
section iast
crashtracking [baseline] (1.485 ms) : 0, 1485
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (812.915 ms) : 0, 812915
BytebuddyAgent [candidate] (812.154 ms) : 0, 812154
GlobalTracer [baseline] (232.597 ms) : 0, 232597
GlobalTracer [candidate] (232.762 ms) : 0, 232762
IAST [baseline] (26.287 ms) : 0, 26287
IAST [candidate] (26.377 ms) : 0, 26377
AppSec [baseline] (33.81 ms) : 0, 33810
AppSec [candidate] (33.644 ms) : 0, 33644
Debugger [baseline] (6.054 ms) : 0, 6054
Debugger [candidate] (6.066 ms) : 0, 6066
Remote Config [baseline] (585.935 µs) : 0, 586
Remote Config [candidate] (592.374 µs) : 0, 592
Telemetry [baseline] (8.314 ms) : 0, 8314
Telemetry [candidate] (8.226 ms) : 0, 8226
Flare Poller [baseline] (4.309 ms) : 0, 4309
Flare Poller [candidate] (4.223 ms) : 0, 4223
LoadParameters
See matching parameters
SummaryFound 4 performance improvements and 1 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section baseline
no_agent (36.281 ms) : 35990, 36572
. : milestone, 36281,
appsec (49.166 ms) : 48734, 49598
. : milestone, 49166,
code_origins (45.166 ms) : 44767, 45566
. : milestone, 45166,
iast (46.373 ms) : 45971, 46776
. : milestone, 46373,
profiling (50.133 ms) : 49656, 50610
. : milestone, 50133,
tracing (45.508 ms) : 45130, 45885
. : milestone, 45508,
section candidate
no_agent (36.768 ms) : 36464, 37071
. : milestone, 36768,
appsec (49.249 ms) : 48809, 49690
. : milestone, 49249,
code_origins (42.635 ms) : 42265, 43005
. : milestone, 42635,
iast (46.271 ms) : 45869, 46673
. : milestone, 46271,
profiling (50.405 ms) : 49887, 50922
. : milestone, 50405,
tracing (44.353 ms) : 43976, 44731
. : milestone, 44353,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section baseline
no_agent (4.325 ms) : 4277, 4373
. : milestone, 4325,
iast (9.627 ms) : 9451, 9803
. : milestone, 9627,
iast_FULL (13.978 ms) : 13704, 14251
. : milestone, 13978,
iast_GLOBAL (10.831 ms) : 10626, 11036
. : milestone, 10831,
profiling (9.332 ms) : 9185, 9480
. : milestone, 9332,
tracing (8.251 ms) : 8128, 8374
. : milestone, 8251,
section candidate
no_agent (4.384 ms) : 4335, 4433
. : milestone, 4384,
iast (9.6 ms) : 9439, 9761
. : milestone, 9600,
iast_FULL (14.75 ms) : 14455, 15046
. : milestone, 14750,
iast_GLOBAL (10.252 ms) : 10070, 10434
. : milestone, 10252,
profiling (8.935 ms) : 8789, 9081
. : milestone, 8935,
tracing (7.712 ms) : 7591, 7834
. : milestone, 7712,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section baseline
no_agent (1.489 ms) : 1478, 1501
. : milestone, 1489,
appsec (2.481 ms) : 2431, 2532
. : milestone, 2481,
iast (2.22 ms) : 2157, 2284
. : milestone, 2220,
iast_GLOBAL (2.264 ms) : 2200, 2328
. : milestone, 2264,
profiling (2.519 ms) : 2348, 2690
. : milestone, 2519,
tracing (2.038 ms) : 1989, 2088
. : milestone, 2038,
section candidate
no_agent (1.485 ms) : 1473, 1496
. : milestone, 1485,
appsec (3.73 ms) : 3510, 3949
. : milestone, 3730,
iast (2.22 ms) : 2157, 2283
. : milestone, 2220,
iast_GLOBAL (2.263 ms) : 2199, 2326
. : milestone, 2263,
profiling (2.074 ms) : 2022, 2127
. : milestone, 2074,
tracing (2.039 ms) : 1989, 2089
. : milestone, 2039,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~2015545cd6, baseline=1.54.0-SNAPSHOT~450f7b5139
dateFormat X
axisFormat %s
section baseline
no_agent (15.29 s) : 15290000, 15290000
. : milestone, 15290000,
appsec (14.983 s) : 14983000, 14983000
. : milestone, 14983000,
iast (18.887 s) : 18887000, 18887000
. : milestone, 18887000,
iast_GLOBAL (17.706 s) : 17706000, 17706000
. : milestone, 17706000,
profiling (15.246 s) : 15246000, 15246000
. : milestone, 15246000,
tracing (15.153 s) : 15153000, 15153000
. : milestone, 15153000,
section candidate
no_agent (15.358 s) : 15358000, 15358000
. : milestone, 15358000,
appsec (14.984 s) : 14984000, 14984000
. : milestone, 14984000,
iast (18.819 s) : 18819000, 18819000
. : milestone, 18819000,
iast_GLOBAL (17.805 s) : 17805000, 17805000
. : milestone, 17805000,
profiling (15.352 s) : 15352000, 15352000
. : milestone, 15352000,
tracing (15.003 s) : 15003000, 15003000
. : milestone, 15003000,
|
28a8210
to
a38ee7b
Compare
Fix remote detection Fix merge commit handling Improve script output
a38ee7b
to
2015545
Compare
What Does This Do
This PR improves the back-porting script by:
Motivation
Following feedback from @mcculls on #9636
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any useful labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]