Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

mhlidd · 2025-09-18T22:03:37Z

What Does This Do

This PR migrates the tests from the classes in #9426 to config-utils, and migrates an abstracted version of ConfigInversionMetricCollector to config-utils while keeping the implementation in internal-api. This way, the telemetry can be used in config-utils but still registered within the Config object.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-09-18T22:39:03Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/migrate_config-utils_tests
git_commit_date	1758657961	1758662234
git_commit_sha	`11e677e`	`16b9315`
release_version	1.54.0-SNAPSHOT~11e677e239	1.54.0-SNAPSHOT~16b9315e0e

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758663903	1758663903
ci_job_id	1144299531	1144299531
ci_pipeline_id	77346506	77346506
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-cp17i3a9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-cp17i3a9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 3 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.014 s) : 0, 1013734
Total [baseline] (10.686 s) : 0, 10685706
Agent [candidate] (1.027 s) : 0, 1026754
Total [candidate] (10.76 s) : 0, 10759581
section appsec
Agent [baseline] (1.192 s) : 0, 1192223
Total [baseline] (11.026 s) : 0, 11025835
Agent [candidate] (1.19 s) : 0, 1190037
Total [candidate] (10.956 s) : 0, 10955745
section iast
Agent [baseline] (1.156 s) : 0, 1156127
Total [baseline] (11.084 s) : 0, 11084218
Agent [candidate] (1.151 s) : 0, 1151439
Total [candidate] (10.981 s) : 0, 10980863
section profiling
Agent [baseline] (1.151 s) : 0, 1150685
Total [baseline] (9.682 s) : 0, 9681834
Agent [candidate] (1.156 s) : 0, 1156337
Total [candidate] (11.062 s) : 0, 11061953

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.014 s	-
Agent	appsec	1.192 s	178.49 ms (17.6%)
Agent	iast	1.156 s	142.394 ms (14.0%)
Agent	profiling	1.151 s	136.951 ms (13.5%)
Total	tracing	10.686 s	-
Total	appsec	11.026 s	340.128 ms (3.2%)
Total	iast	11.084 s	398.512 ms (3.7%)
Total	profiling	9.682 s	-1.004 s (-9.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.027 s	-
Agent	appsec	1.19 s	163.282 ms (15.9%)
Agent	iast	1.151 s	124.684 ms (12.1%)
Agent	profiling	1.156 s	129.582 ms (12.6%)
Total	tracing	10.76 s	-
Total	appsec	10.956 s	196.164 ms (1.8%)
Total	iast	10.981 s	221.283 ms (2.1%)
Total	profiling	11.062 s	302.372 ms (2.8%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (693.871 ms) : 0, 693871
BytebuddyAgent [candidate] (702.643 ms) : 0, 702643
GlobalTracer [baseline] (249.693 ms) : 0, 249693
GlobalTracer [candidate] (252.827 ms) : 0, 252827
AppSec [baseline] (31.4 ms) : 0, 31400
AppSec [candidate] (32.003 ms) : 0, 32003
Debugger [baseline] (6.436 ms) : 0, 6436
Debugger [candidate] (6.547 ms) : 0, 6547
Remote Config [baseline] (685.149 µs) : 0, 685
Remote Config [candidate] (706.104 µs) : 0, 706
Telemetry [baseline] (8.996 ms) : 0, 8996
Telemetry [candidate] (9.204 ms) : 0, 9204
section appsec
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (714.78 ms) : 0, 714780
BytebuddyAgent [candidate] (713.92 ms) : 0, 713920
GlobalTracer [baseline] (241.354 ms) : 0, 241354
GlobalTracer [candidate] (240.756 ms) : 0, 240756
AppSec [baseline] (172.628 ms) : 0, 172628
AppSec [candidate] (171.289 ms) : 0, 171289
Debugger [baseline] (6.023 ms) : 0, 6023
Debugger [candidate] (6.044 ms) : 0, 6044
Remote Config [baseline] (648.91 µs) : 0, 649
Remote Config [candidate] (641.71 µs) : 0, 642
Telemetry [baseline] (9.311 ms) : 0, 9311
Telemetry [candidate] (9.933 ms) : 0, 9933
IAST [baseline] (24.757 ms) : 0, 24757
IAST [candidate] (24.826 ms) : 0, 24826
section iast
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (817.754 ms) : 0, 817754
BytebuddyAgent [candidate] (814.179 ms) : 0, 814179
GlobalTracer [baseline] (239.882 ms) : 0, 239882
GlobalTracer [candidate] (239.149 ms) : 0, 239149
AppSec [baseline] (33.971 ms) : 0, 33971
AppSec [candidate] (33.717 ms) : 0, 33717
Debugger [baseline] (6.165 ms) : 0, 6165
Debugger [candidate] (6.15 ms) : 0, 6150
Remote Config [baseline] (613.606 µs) : 0, 614
Remote Config [candidate] (599.024 µs) : 0, 599
Telemetry [baseline] (8.439 ms) : 0, 8439
Telemetry [candidate] (8.408 ms) : 0, 8408
IAST [baseline] (26.499 ms) : 0, 26499
IAST [candidate] (26.283 ms) : 0, 26283
section profiling
ProfilingAgent [baseline] (100.638 ms) : 0, 100638
ProfilingAgent [candidate] (101.244 ms) : 0, 101244
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (717.558 ms) : 0, 717558
BytebuddyAgent [candidate] (720.967 ms) : 0, 720967
GlobalTracer [baseline] (224.059 ms) : 0, 224059
GlobalTracer [candidate] (225.258 ms) : 0, 225258
AppSec [baseline] (31.378 ms) : 0, 31378
AppSec [candidate] (31.326 ms) : 0, 31326
Debugger [baseline] (6.649 ms) : 0, 6649
Debugger [candidate] (6.531 ms) : 0, 6531
Remote Config [baseline] (719.79 µs) : 0, 720
Remote Config [candidate] (710.499 µs) : 0, 710
Telemetry [baseline] (16.233 ms) : 0, 16233
Telemetry [candidate] (16.368 ms) : 0, 16368
Profiling [baseline] (101.234 ms) : 0, 101234
Profiling [candidate] (101.842 ms) : 0, 101842

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.016 s) : 0, 1016162
Total [baseline] (8.672 s) : 0, 8672312
Agent [candidate] (1.01 s) : 0, 1010477
Total [candidate] (8.675 s) : 0, 8675161
section iast
Agent [baseline] (1.15 s) : 0, 1150442
Total [baseline] (9.249 s) : 0, 9248845
Agent [candidate] (1.159 s) : 0, 1158810
Total [candidate] (9.273 s) : 0, 9273099

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.016 s	-
Agent	iast	1.15 s	134.279 ms (13.2%)
Total	tracing	8.672 s	-
Total	iast	9.249 s	576.533 ms (6.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.01 s	-
Agent	iast	1.159 s	148.333 ms (14.7%)
Total	tracing	8.675 s	-
Total	iast	9.273 s	597.938 ms (6.9%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (695.073 ms) : 0, 695073
BytebuddyAgent [candidate] (691.495 ms) : 0, 691495
GlobalTracer [baseline] (250.471 ms) : 0, 250471
GlobalTracer [candidate] (248.898 ms) : 0, 248898
AppSec [baseline] (31.635 ms) : 0, 31635
AppSec [candidate] (31.337 ms) : 0, 31337
Debugger [baseline] (6.49 ms) : 0, 6490
Debugger [candidate] (6.378 ms) : 0, 6378
Remote Config [baseline] (693.369 µs) : 0, 693
Remote Config [candidate] (679.134 µs) : 0, 679
Telemetry [baseline] (9.215 ms) : 0, 9215
Telemetry [candidate] (9.061 ms) : 0, 9061
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (814.957 ms) : 0, 814957
BytebuddyAgent [candidate] (819.966 ms) : 0, 819966
GlobalTracer [baseline] (237.556 ms) : 0, 237556
GlobalTracer [candidate] (240.191 ms) : 0, 240191
AppSec [baseline] (33.92 ms) : 0, 33920
AppSec [candidate] (33.932 ms) : 0, 33932
Debugger [baseline] (6.053 ms) : 0, 6053
Debugger [candidate] (6.16 ms) : 0, 6160
Remote Config [baseline] (584.142 µs) : 0, 584
Remote Config [candidate] (609.686 µs) : 0, 610
Telemetry [baseline] (8.335 ms) : 0, 8335
Telemetry [candidate] (8.442 ms) : 0, 8442
IAST [baseline] (26.212 ms) : 0, 26212
IAST [candidate] (26.616 ms) : 0, 26616

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/migrate_config-utils_tests
git_commit_date	1758657961	1758662234
git_commit_sha	`11e677e`	`16b9315`
release_version	1.54.0-SNAPSHOT~11e677e239	1.54.0-SNAPSHOT~16b9315e0e

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758663626	1758663626
ci_job_id	1144299533	1144299533
ci_pipeline_id	77346506	77346506
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-w5rltpyf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-w5rltpyf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 3 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+196.783µs; +449.691µs] or [+2.565%; +5.862%]	unstable [-100.739op/s; +52.551op/s] or [-16.688%; +8.706%]	7.995ms	579.562op/s	7.671ms	603.656op/s
scenario:load:insecure-bank:iast_FULL:high_load	worse [+1.334ms; +1.960ms] or [+9.742%; +14.316%]	unstable [-73.312op/s; +0.937op/s] or [-21.549%; +0.275%]	15.339ms	304.031op/s	13.692ms	340.219op/s
scenario:load:petclinic:profiling:high_load	worse [+2.463ms; +3.393ms] or [+5.425%; +7.473%]	unstable [-13.506op/s; +1.031op/s] or [-13.103%; +1.000%]	48.336ms	96.838op/s	45.408ms	103.075op/s
scenario:load:petclinic:no_agent:high_load	better [-1.534ms; -0.901ms] or [-4.121%; -2.420%]	unstable [-4.464op/s; +13.014op/s] or [-3.553%; +10.359%]	35.999ms	129.900op/s	37.216ms	125.625op/s
scenario:load:petclinic:tracing:high_load	better [-2.499ms; -1.685ms] or [-5.512%; -3.716%]	unstable [-2.366op/s; +12.341op/s] or [-2.293%; +11.959%]	43.255ms	108.175op/s	45.347ms	103.188op/s
scenario:load:petclinic:appsec:high_load	better [-2.089ms; -1.165ms] or [-4.311%; -2.405%]	unstable [-3.767op/s; +10.217op/s] or [-3.894%; +10.562%]	46.829ms	99.963op/s	48.456ms	96.737op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.216 ms) : 36918, 37514
.   : milestone, 37216,
appsec (48.456 ms) : 48024, 48889
.   : milestone, 48456,
code_origins (43.195 ms) : 42819, 43570
.   : milestone, 43195,
iast (45.882 ms) : 45493, 46271
.   : milestone, 45882,
profiling (45.408 ms) : 44995, 45820
.   : milestone, 45408,
tracing (45.347 ms) : 44957, 45737
.   : milestone, 45347,
section candidate
no_agent (35.999 ms) : 35708, 36289
.   : milestone, 35999,
appsec (46.829 ms) : 46403, 47255
.   : milestone, 46829,
code_origins (43.715 ms) : 43328, 44102
.   : milestone, 43715,
iast (45.54 ms) : 45162, 45918
.   : milestone, 45540,
profiling (48.336 ms) : 47885, 48787
.   : milestone, 48336,
tracing (43.255 ms) : 42888, 43621
.   : milestone, 43255,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.216 ms [36.918 ms, 37.514 ms]	-
appsec	48.456 ms [48.024 ms, 48.889 ms]	11.241 ms (30.2%)
code_origins	43.195 ms [42.819 ms, 43.57 ms]	5.979 ms (16.1%)
iast	45.882 ms [45.493 ms, 46.271 ms]	8.666 ms (23.3%)
profiling	45.408 ms [44.995 ms, 45.82 ms]	8.192 ms (22.0%)
tracing	45.347 ms [44.957 ms, 45.737 ms]	8.131 ms (21.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.999 ms [35.708 ms, 36.289 ms]	-
appsec	46.829 ms [46.403 ms, 47.255 ms]	10.831 ms (30.1%)
code_origins	43.715 ms [43.328 ms, 44.102 ms]	7.716 ms (21.4%)
iast	45.54 ms [45.162 ms, 45.918 ms]	9.541 ms (26.5%)
profiling	48.336 ms [47.885 ms, 48.787 ms]	12.337 ms (34.3%)
tracing	43.255 ms [42.888 ms, 43.621 ms]	7.256 ms (20.2%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.373 ms) : 4323, 4423
.   : milestone, 4373,
iast (10.281 ms) : 10107, 10455
.   : milestone, 10281,
iast_FULL (13.692 ms) : 13423, 13961
.   : milestone, 13692,
iast_GLOBAL (10.859 ms) : 10657, 11061
.   : milestone, 10859,
profiling (8.977 ms) : 8826, 9129
.   : milestone, 8977,
tracing (7.671 ms) : 7555, 7788
.   : milestone, 7671,
section candidate
no_agent (4.388 ms) : 4339, 4438
.   : milestone, 4388,
iast (9.926 ms) : 9749, 10104
.   : milestone, 9926,
iast_FULL (15.339 ms) : 15028, 15651
.   : milestone, 15339,
iast_GLOBAL (10.987 ms) : 10785, 11189
.   : milestone, 10987,
profiling (9.145 ms) : 9000, 9289
.   : milestone, 9145,
tracing (7.995 ms) : 7876, 8113
.   : milestone, 7995,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.373 ms [4.323 ms, 4.423 ms]	-
iast	10.281 ms [10.107 ms, 10.455 ms]	5.908 ms (135.1%)
iast_FULL	13.692 ms [13.423 ms, 13.961 ms]	9.319 ms (213.1%)
iast_GLOBAL	10.859 ms [10.657 ms, 11.061 ms]	6.486 ms (148.3%)
profiling	8.977 ms [8.826 ms, 9.129 ms]	4.604 ms (105.3%)
tracing	7.671 ms [7.555 ms, 7.788 ms]	3.299 ms (75.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.388 ms [4.339 ms, 4.438 ms]	-
iast	9.926 ms [9.749 ms, 10.104 ms]	5.538 ms (126.2%)
iast_FULL	15.339 ms [15.028 ms, 15.651 ms]	10.951 ms (249.5%)
iast_GLOBAL	10.987 ms [10.785 ms, 11.189 ms]	6.598 ms (150.4%)
profiling	9.145 ms [9.0 ms, 9.289 ms]	4.756 ms (108.4%)
tracing	7.995 ms [7.876 ms, 8.113 ms]	3.606 ms (82.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/migrate_config-utils_tests
git_commit_date	1758657961	1758662234
git_commit_sha	`11e677e`	`16b9315`
release_version	1.54.0-SNAPSHOT~11e677e239	1.54.0-SNAPSHOT~16b9315e0e

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1758664189	1758664189
ci_job_id	1144299534	1144299534
ci_pipeline_id	77346506	77346506
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-rhqmlmf8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-rhqmlmf8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.517 ms) : 2464, 2571
.   : milestone, 2517,
iast (2.203 ms) : 2140, 2265
.   : milestone, 2203,
iast_GLOBAL (2.243 ms) : 2181, 2306
.   : milestone, 2243,
profiling (2.076 ms) : 2024, 2128
.   : milestone, 2076,
tracing (2.027 ms) : 1978, 2076
.   : milestone, 2027,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.742 ms) : 3526, 3958
.   : milestone, 3742,
iast (2.202 ms) : 2139, 2265
.   : milestone, 2202,
iast_GLOBAL (2.24 ms) : 2177, 2302
.   : milestone, 2240,
profiling (2.059 ms) : 2007, 2111
.   : milestone, 2059,
tracing (2.035 ms) : 1986, 2084
.   : milestone, 2035,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.489 ms]	-
appsec	2.517 ms [2.464 ms, 2.571 ms]	1.039 ms (70.3%)
iast	2.203 ms [2.14 ms, 2.265 ms]	724.724 µs (49.0%)
iast_GLOBAL	2.243 ms [2.181 ms, 2.306 ms]	765.49 µs (51.8%)
profiling	2.076 ms [2.024 ms, 2.128 ms]	597.628 µs (40.4%)
tracing	2.027 ms [1.978 ms, 2.076 ms]	549.346 µs (37.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.468 ms, 1.491 ms]	-
appsec	3.742 ms [3.526 ms, 3.958 ms]	2.263 ms (153.0%)
iast	2.202 ms [2.139 ms, 2.265 ms]	722.26 µs (48.8%)
iast_GLOBAL	2.24 ms [2.177 ms, 2.302 ms]	760.267 µs (51.4%)
profiling	2.059 ms [2.007 ms, 2.111 ms]	579.932 µs (39.2%)
tracing	2.035 ms [1.986 ms, 2.084 ms]	556.093 µs (37.6%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~16b9315e0e, baseline=1.54.0-SNAPSHOT~11e677e239
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.841 s) : 14841000, 14841000
.   : milestone, 14841000,
appsec (15.185 s) : 15185000, 15185000
.   : milestone, 15185000,
iast (18.671 s) : 18671000, 18671000
.   : milestone, 18671000,
iast_GLOBAL (17.854 s) : 17854000, 17854000
.   : milestone, 17854000,
profiling (15.451 s) : 15451000, 15451000
.   : milestone, 15451000,
tracing (15.055 s) : 15055000, 15055000
.   : milestone, 15055000,
section candidate
no_agent (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
appsec (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
iast (18.564 s) : 18564000, 18564000
.   : milestone, 18564000,
iast_GLOBAL (18.136 s) : 18136000, 18136000
.   : milestone, 18136000,
profiling (15.339 s) : 15339000, 15339000
.   : milestone, 15339000,
tracing (15.1 s) : 15100000, 15100000
.   : milestone, 15100000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.841 s [14.841 s, 14.841 s]	-
appsec	15.185 s [15.185 s, 15.185 s]	344.0 ms (2.3%)
iast	18.671 s [18.671 s, 18.671 s]	3.83 s (25.8%)
iast_GLOBAL	17.854 s [17.854 s, 17.854 s]	3.013 s (20.3%)
profiling	15.451 s [15.451 s, 15.451 s]	610.0 ms (4.1%)
tracing	15.055 s [15.055 s, 15.055 s]	214.0 ms (1.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.946 s [14.946 s, 14.946 s]	-
appsec	15.06 s [15.06 s, 15.06 s]	114.0 ms (0.8%)
iast	18.564 s [18.564 s, 18.564 s]	3.618 s (24.2%)
iast_GLOBAL	18.136 s [18.136 s, 18.136 s]	3.19 s (21.3%)
profiling	15.339 s [15.339 s, 15.339 s]	393.0 ms (2.6%)
tracing	15.1 s [15.1 s, 15.1 s]	154.0 ms (1.0%)

datadog-datadog-prod-us1 · 2025-09-23T21:37:54Z

🎯 Code Coverage
• Patch Coverage: 42.86%
• Total Coverage: 57.85% (-1.98%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 16b9315 | Docs | Was this helpful? Give us feedback!}

mhlidd changed the base branch from master to mhlidd/config_inversion_plugins September 18, 2025 22:03

mhlidd added type: enhancement Enhancements and improvements comp: api Tracer public API labels Sep 19, 2025

mhlidd marked this pull request as ready for review September 19, 2025 00:32

mhlidd requested review from a team as code owners September 19, 2025 00:32

mhlidd requested review from PerfectSlayer and mcculls and removed request for a team September 19, 2025 00:32

This was referenced Sep 23, 2025

Implement Config Inversion with Default Strictness of Warning #9539

Open

Adding Gradle Plugins for Config Inversion #9565

Merged

Base automatically changed from mhlidd/config_inversion_plugins to master September 23, 2025 18:31

mhlidd added 3 commits September 23, 2025 14:01

adding supported-configurations.json file

c232d57

migrating config-utils tests and ConfigInversionMetric telemetry

295cbee

updating coverage and native image test

1574d9b

mhlidd force-pushed the mhlidd/migrate_config-utils_tests branch from 57483a2 to 1574d9b Compare September 23, 2025 21:02

mhlidd added 2 commits September 23, 2025 14:04

removing extra supported-configurations.json

e91b965

adding dependency

16b9315

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

Uh oh!

mhlidd commented Sep 18, 2025

Uh oh!

pr-commenter bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 23, 2025 •

edited by datadog-official bot

Loading

Uh oh!

Uh oh!

Migrate tests and ConfigInversionMetricCollector to config-utils module #9566

Are you sure you want to change the base?

Migrate tests and ConfigInversionMetricCollector to config-utils module #9566

Uh oh!

Conversation

mhlidd commented Sep 18, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 23, 2025 • edited by datadog-official bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

pr-commenter bot commented Sep 18, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Sep 23, 2025 •

edited by datadog-official bot

Loading