New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix KStreams with dynamic queue names #6857
Conversation
Kafka / producer-benchmarkParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics. See unchanged results
|
Kafka / consumer-benchmarkParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics. See unchanged results
|
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.32.0-SNAPSHOT~3bf87d6401, baseline=1.32.0-SNAPSHOT~08d7b46260
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076079
Total [baseline] (10.4 s) : 0, 10399503
Agent [candidate] (1.075 s) : 0, 1075473
Total [candidate] (10.415 s) : 0, 10415114
section appsec
Agent [baseline] (1.194 s) : 0, 1193866
Total [baseline] (10.552 s) : 0, 10551622
Agent [candidate] (1.196 s) : 0, 1195546
Total [candidate] (10.582 s) : 0, 10582341
section iast
Agent [baseline] (1.199 s) : 0, 1199302
Total [baseline] (10.733 s) : 0, 10732742
Agent [candidate] (1.197 s) : 0, 1197400
Total [candidate] (10.767 s) : 0, 10767434
section profiling
Agent [baseline] (1.267 s) : 0, 1266613
Total [baseline] (10.603 s) : 0, 10603041
Agent [candidate] (1.268 s) : 0, 1268098
Total [candidate] (10.68 s) : 0, 10680414
gantt
title petclinic - break down per module: candidate=1.32.0-SNAPSHOT~3bf87d6401, baseline=1.32.0-SNAPSHOT~08d7b46260
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.37 ms) : 0, 686370
BytebuddyAgent [candidate] (685.437 ms) : 0, 685437
GlobalTracer [baseline] (297.415 ms) : 0, 297415
GlobalTracer [candidate] (297.864 ms) : 0, 297864
AppSec [baseline] (49.536 ms) : 0, 49536
AppSec [candidate] (49.457 ms) : 0, 49457
Remote Config [baseline] (673.882 µs) : 0, 674
Remote Config [candidate] (674.223 µs) : 0, 674
Telemetry [baseline] (7.659 ms) : 0, 7659
Telemetry [candidate] (7.585 ms) : 0, 7585
section appsec
BytebuddyAgent [baseline] (693.382 ms) : 0, 693382
BytebuddyAgent [candidate] (694.226 ms) : 0, 694226
GlobalTracer [baseline] (290.558 ms) : 0, 290558
GlobalTracer [candidate] (291.248 ms) : 0, 291248
AppSec [baseline] (149.691 ms) : 0, 149691
AppSec [candidate] (149.83 ms) : 0, 149830
IAST [baseline] (18.666 ms) : 0, 18666
IAST [candidate] (18.642 ms) : 0, 18642
Remote Config [baseline] (602.165 µs) : 0, 602
Remote Config [candidate] (604.954 µs) : 0, 605
Telemetry [baseline] (6.755 ms) : 0, 6755
Telemetry [candidate] (6.734 ms) : 0, 6734
section iast
BytebuddyAgent [baseline] (794.558 ms) : 0, 794558
BytebuddyAgent [candidate] (793.05 ms) : 0, 793050
GlobalTracer [baseline] (288.481 ms) : 0, 288481
GlobalTracer [candidate] (288.201 ms) : 0, 288201
AppSec [baseline] (50.926 ms) : 0, 50926
AppSec [candidate] (48.824 ms) : 0, 48824
IAST [baseline] (22.124 ms) : 0, 22124
IAST [candidate] (25.215 ms) : 0, 25215
Remote Config [baseline] (576.349 µs) : 0, 576
Remote Config [candidate] (573.281 µs) : 0, 573
Telemetry [baseline] (8.182 ms) : 0, 8182
Telemetry [candidate] (7.294 ms) : 0, 7294
section profiling
BytebuddyAgent [baseline] (676.868 ms) : 0, 676868
BytebuddyAgent [candidate] (677.047 ms) : 0, 677047
GlobalTracer [baseline] (379.97 ms) : 0, 379970
GlobalTracer [candidate] (380.651 ms) : 0, 380651
AppSec [baseline] (50.148 ms) : 0, 50148
AppSec [candidate] (50.081 ms) : 0, 50081
Remote Config [baseline] (704.914 µs) : 0, 705
Remote Config [candidate] (698.685 µs) : 0, 699
Telemetry [baseline] (7.444 ms) : 0, 7444
Telemetry [candidate] (7.496 ms) : 0, 7496
ProfilingAgent [baseline] (95.367 ms) : 0, 95367
ProfilingAgent [candidate] (95.864 ms) : 0, 95864
Profiling [baseline] (95.391 ms) : 0, 95391
Profiling [candidate] (95.888 ms) : 0, 95888
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.32.0-SNAPSHOT~3bf87d6401, baseline=1.32.0-SNAPSHOT~08d7b46260
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1075059
Total [baseline] (8.558 s) : 0, 8558168
Agent [candidate] (1.091 s) : 0, 1091132
Total [candidate] (8.598 s) : 0, 8597723
section iast
Agent [baseline] (1.205 s) : 0, 1205322
Total [baseline] (9.116 s) : 0, 9115642
Agent [candidate] (1.201 s) : 0, 1200607
Total [candidate] (9.079 s) : 0, 9078576
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.208 s) : 0, 1207900
Total [baseline] (9.058 s) : 0, 9058108
Agent [candidate] (1.2 s) : 0, 1200322
Total [candidate] (9.086 s) : 0, 9085814
section iast_TELEMETRY_OFF
Agent [baseline] (1.194 s) : 0, 1193596
Total [baseline] (9.093 s) : 0, 9092676
Agent [candidate] (1.199 s) : 0, 1198704
Total [candidate] (9.12 s) : 0, 9119771
gantt
title insecure-bank - break down per module: candidate=1.32.0-SNAPSHOT~3bf87d6401, baseline=1.32.0-SNAPSHOT~08d7b46260
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.52 ms) : 0, 685520
BytebuddyAgent [candidate] (695.552 ms) : 0, 695552
GlobalTracer [baseline] (297.244 ms) : 0, 297244
GlobalTracer [candidate] (302.081 ms) : 0, 302081
AppSec [baseline] (49.664 ms) : 0, 49664
AppSec [candidate] (50.133 ms) : 0, 50133
Remote Config [baseline] (656.775 µs) : 0, 657
Remote Config [candidate] (676.23 µs) : 0, 676
Telemetry [baseline] (7.579 ms) : 0, 7579
Telemetry [candidate] (7.716 ms) : 0, 7716
section iast
BytebuddyAgent [baseline] (799.622 ms) : 0, 799622
BytebuddyAgent [candidate] (795.156 ms) : 0, 795156
GlobalTracer [baseline] (289.204 ms) : 0, 289204
GlobalTracer [candidate] (289.457 ms) : 0, 289457
AppSec [baseline] (48.888 ms) : 0, 48888
AppSec [candidate] (52.415 ms) : 0, 52415
IAST [baseline] (24.417 ms) : 0, 24417
IAST [candidate] (21.124 ms) : 0, 21124
Remote Config [baseline] (572.642 µs) : 0, 573
Remote Config [candidate] (573.532 µs) : 0, 574
Telemetry [baseline] (8.063 ms) : 0, 8063
Telemetry [candidate] (7.414 ms) : 0, 7414
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.356 ms) : 0, 800356
BytebuddyAgent [candidate] (794.487 ms) : 0, 794487
GlobalTracer [baseline] (290.546 ms) : 0, 290546
GlobalTracer [candidate] (289.477 ms) : 0, 289477
AppSec [baseline] (50.551 ms) : 0, 50551
AppSec [candidate] (49.529 ms) : 0, 49529
IAST [baseline] (24.468 ms) : 0, 24468
IAST [candidate] (23.616 ms) : 0, 23616
Remote Config [baseline] (592.828 µs) : 0, 593
Remote Config [candidate] (582.448 µs) : 0, 582
Telemetry [baseline] (6.601 ms) : 0, 6601
Telemetry [candidate] (8.099 ms) : 0, 8099
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (790.302 ms) : 0, 790302
BytebuddyAgent [candidate] (792.554 ms) : 0, 792554
GlobalTracer [baseline] (287.76 ms) : 0, 287760
GlobalTracer [candidate] (289.586 ms) : 0, 289586
AppSec [baseline] (48.83 ms) : 0, 48830
AppSec [candidate] (50.201 ms) : 0, 50201
IAST [baseline] (23.896 ms) : 0, 23896
IAST [candidate] (23.902 ms) : 0, 23902
Remote Config [baseline] (574.704 µs) : 0, 575
Remote Config [candidate] (608.622 µs) : 0, 609
Telemetry [baseline] (7.939 ms) : 0, 7939
Telemetry [candidate] (7.347 ms) : 0, 7347
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.32.0-SNAPSHOT~3bf87d6401, baseline=1.32.0-SNAPSHOT~08d7b46260
dateFormat X
axisFormat %s
section baseline
no_agent (1.35 ms) : 1331, 1369
. : milestone, 1350,
appsec (1.734 ms) : 1711, 1758
. : milestone, 1734,
appsec_no_iast (1.725 ms) : 1702, 1749
. : milestone, 1725,
iast (1.496 ms) : 1474, 1519
. : milestone, 1496,
profiling (1.54 ms) : 1515, 1565
. : milestone, 1540,
tracing (1.471 ms) : 1448, 1494
. : milestone, 1471,
section candidate
no_agent (1.348 ms) : 1328, 1368
. : milestone, 1348,
appsec (1.738 ms) : 1713, 1763
. : milestone, 1738,
appsec_no_iast (1.729 ms) : 1704, 1754
. : milestone, 1729,
iast (1.507 ms) : 1483, 1531
. : milestone, 1507,
profiling (1.525 ms) : 1500, 1550
. : milestone, 1525,
tracing (1.473 ms) : 1448, 1497
. : milestone, 1473,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.32.0-SNAPSHOT~3bf87d6401, baseline=1.32.0-SNAPSHOT~08d7b46260
dateFormat X
axisFormat %s
section baseline
no_agent (375.005 µs) : 355, 395
. : milestone, 375,
iast (478.647 µs) : 458, 499
. : milestone, 479,
iast_FULL (549.384 µs) : 529, 570
. : milestone, 549,
iast_GLOBAL (508.887 µs) : 486, 532
. : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (479.388 µs) : 459, 500
. : milestone, 479,
iast_INACTIVE (454.214 µs) : 433, 475
. : milestone, 454,
iast_TELEMETRY_OFF (480.423 µs) : 460, 501
. : milestone, 480,
tracing (449.26 µs) : 428, 470
. : milestone, 449,
section candidate
no_agent (380.948 µs) : 361, 401
. : milestone, 381,
iast (485.707 µs) : 465, 506
. : milestone, 486,
iast_FULL (545.585 µs) : 525, 566
. : milestone, 546,
iast_GLOBAL (505.374 µs) : 485, 526
. : milestone, 505,
iast_HARDCODED_SECRET_DISABLED (479.384 µs) : 458, 500
. : milestone, 479,
iast_INACTIVE (455.97 µs) : 435, 477
. : milestone, 456,
iast_TELEMETRY_OFF (477.377 µs) : 456, 498
. : milestone, 477,
tracing (455.397 µs) : 435, 476
. : milestone, 455,
|
What Does This Do
This PR fixes a bug reported by KStreams users. See this ticket for context.
Details
STREAMING_CONTEXT
relies on topology builder to get all source / sink / system topics. The issue with this approach is that some topics may not be part of the topology when it's created. An example may be.to(
call which uses some logic to determine the downstream sink. In the example belowRE_KEYED_BACKLOGS
topic will not be added to the streaming context, since it's not resolved when topology builder is invoked. The solution is to allow DSM checkpoints for all topics which are not known at the start of the application.