Skip to content

Improve Config JUnit extension#11094

Open
PerfectSlayer wants to merge 3 commits intomasterfrom
bbujon/groovy-to-java-config
Open

Improve Config JUnit extension#11094
PerfectSlayer wants to merge 3 commits intomasterfrom
bbujon/groovy-to-java-config

Conversation

@PerfectSlayer
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer commented Apr 13, 2026 •
edited
Loading

What Does This Do

This PR improves the newly introduces Config JUnit extension: #11076

  • Allow to add @WithConfig at any class hierarchy level. Child classes can now inherit parent config and enrich it.
  • Improve performance by building configuration only once per test method. It can still be rebuild if config is updated programmatically.
  • Apply class level configuration (ie @WithConfig annotation on class element) at @BeforeAll level so class level configuration is accessible in static test initializers.

Motivation

Using the extension allowed to refine both its behavior and performance.

Additional Notes

This PR is part of some bigger improvements in stacked PRs:

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@PerfectSlayer PerfectSlayer added type: enhancement Enhancements and improvements comp: testing Testing tag: ai generated Largely based on code generated by an AI or LLM labels Apr 13, 2026
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner April 13, 2026 13:42
@PerfectSlayer PerfectSlayer requested a review from mcculls April 13, 2026 13:42
This was referenced Apr 13, 2026
Open
Open
Draft
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 13, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/groovy-to-java-config
git_commit_date 1775834061 1776087091
git_commit_sha 5ab378f 8d727de
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~8d727dee32
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776089146 1776089146
ci_job_id 1589566349 1589566349
ci_pipeline_id 107365600 107365600
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-7ijscsid 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-7ijscsid 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056918
Total [baseline] (11.14 s) : 0, 11140392
Agent [candidate] (1.063 s) : 0, 1062992
Total [candidate] (11.049 s) : 0, 11048982
section appsec
Agent [baseline] (1.249 s) : 0, 1248696
Total [baseline] (11.169 s) : 0, 11169157
Agent [candidate] (1.248 s) : 0, 1247728
Total [candidate] (11.123 s) : 0, 11123105
section iast
Agent [baseline] (1.243 s) : 0, 1242772
Total [baseline] (11.315 s) : 0, 11315156
Agent [candidate] (1.229 s) : 0, 1228896
Total [candidate] (11.298 s) : 0, 11297774
section profiling
Agent [baseline] (1.185 s) : 0, 1184544
Total [baseline] (11.098 s) : 0, 11098486
Agent [candidate] (1.186 s) : 0, 1186418
Total [candidate] (11.235 s) : 0, 11235134
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.249 s 191.778 ms (18.1%)
Agent iast 1.243 s 185.855 ms (17.6%)
Agent profiling 1.185 s 127.627 ms (12.1%)
Total tracing 11.14 s -
Total appsec 11.169 s 28.764 ms (0.3%)
Total iast 11.315 s 174.764 ms (1.6%)
Total profiling 11.098 s -41.907 ms (-0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.248 s 184.736 ms (17.4%)
Agent iast 1.229 s 165.904 ms (15.6%)
Agent profiling 1.186 s 123.426 ms (11.6%)
Total tracing 11.049 s -
Total appsec 11.123 s 74.124 ms (0.7%)
Total iast 11.298 s 248.793 ms (2.3%)
Total profiling 11.235 s 186.152 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.24 ms) : 0, 1240
crashtracking [candidate] (1.238 ms) : 0, 1238
BytebuddyAgent [baseline] (632.185 ms) : 0, 632185
BytebuddyAgent [candidate] (637.103 ms) : 0, 637103
AgentMeter [baseline] (29.401 ms) : 0, 29401
AgentMeter [candidate] (29.457 ms) : 0, 29457
GlobalTracer [baseline] (248.779 ms) : 0, 248779
GlobalTracer [candidate] (248.909 ms) : 0, 248909
AppSec [baseline] (31.94 ms) : 0, 31940
AppSec [candidate] (31.878 ms) : 0, 31878
Debugger [baseline] (60.003 ms) : 0, 60003
Debugger [candidate] (59.819 ms) : 0, 59819
Remote Config [baseline] (595.292 µs) : 0, 595
Remote Config [candidate] (596.246 µs) : 0, 596
Telemetry [baseline] (8.145 ms) : 0, 8145
Telemetry [candidate] (8.05 ms) : 0, 8050
Flare Poller [baseline] (8.405 ms) : 0, 8405
Flare Poller [candidate] (9.598 ms) : 0, 9598
section appsec
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (661.574 ms) : 0, 661574
BytebuddyAgent [candidate] (661.524 ms) : 0, 661524
AgentMeter [baseline] (12.038 ms) : 0, 12038
AgentMeter [candidate] (12.131 ms) : 0, 12131
GlobalTracer [baseline] (248.941 ms) : 0, 248941
GlobalTracer [candidate] (248.996 ms) : 0, 248996
IAST [baseline] (24.547 ms) : 0, 24547
IAST [candidate] (24.522 ms) : 0, 24522
AppSec [baseline] (184.86 ms) : 0, 184860
AppSec [candidate] (184.321 ms) : 0, 184321
Debugger [baseline] (66.382 ms) : 0, 66382
Debugger [candidate] (65.91 ms) : 0, 65910
Remote Config [baseline] (599.871 µs) : 0, 600
Remote Config [candidate] (607.048 µs) : 0, 607
Telemetry [baseline] (8.607 ms) : 0, 8607
Telemetry [candidate] (8.47 ms) : 0, 8470
Flare Poller [baseline] (3.553 ms) : 0, 3553
Flare Poller [candidate] (3.577 ms) : 0, 3577
section iast
crashtracking [baseline] (1.258 ms) : 0, 1258
crashtracking [candidate] (1.246 ms) : 0, 1246
BytebuddyAgent [baseline] (816.734 ms) : 0, 816734
BytebuddyAgent [candidate] (805.603 ms) : 0, 805603
AgentMeter [baseline] (11.668 ms) : 0, 11668
AgentMeter [candidate] (11.426 ms) : 0, 11426
GlobalTracer [baseline] (241.229 ms) : 0, 241229
GlobalTracer [candidate] (239.145 ms) : 0, 239145
IAST [baseline] (25.967 ms) : 0, 25967
IAST [candidate] (25.848 ms) : 0, 25848
AppSec [baseline] (31.841 ms) : 0, 31841
AppSec [candidate] (33.537 ms) : 0, 33537
Debugger [baseline] (60.689 ms) : 0, 60689
Debugger [candidate] (57.601 ms) : 0, 57601
Remote Config [baseline] (523.937 µs) : 0, 524
Remote Config [candidate] (522.832 µs) : 0, 523
Telemetry [baseline] (12.466 ms) : 0, 12466
Telemetry [candidate] (14.063 ms) : 0, 14063
Flare Poller [baseline] (3.445 ms) : 0, 3445
Flare Poller [candidate] (3.519 ms) : 0, 3519
section profiling
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (691.275 ms) : 0, 691275
BytebuddyAgent [candidate] (692.691 ms) : 0, 692691
AgentMeter [baseline] (9.128 ms) : 0, 9128
AgentMeter [candidate] (9.11 ms) : 0, 9110
GlobalTracer [baseline] (207.371 ms) : 0, 207371
GlobalTracer [candidate] (207.336 ms) : 0, 207336
AppSec [baseline] (32.424 ms) : 0, 32424
AppSec [candidate] (32.664 ms) : 0, 32664
Debugger [baseline] (65.58 ms) : 0, 65580
Debugger [candidate] (65.772 ms) : 0, 65772
Remote Config [baseline] (572.466 µs) : 0, 572
Remote Config [candidate] (575.237 µs) : 0, 575
Telemetry [baseline] (7.821 ms) : 0, 7821
Telemetry [candidate] (7.88 ms) : 0, 7880
Flare Poller [baseline] (3.55 ms) : 0, 3550
Flare Poller [candidate] (3.622 ms) : 0, 3622
ProfilingAgent [baseline] (94.26 ms) : 0, 94260
ProfilingAgent [candidate] (94.171 ms) : 0, 94171
Profiling [baseline] (94.83 ms) : 0, 94830
Profiling [candidate] (94.744 ms) : 0, 94744
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071329
Total [baseline] (8.897 s) : 0, 8897211
Agent [candidate] (1.07 s) : 0, 1070000
Total [candidate] (8.869 s) : 0, 8869198
section iast
Agent [baseline] (1.227 s) : 0, 1227011
Total [baseline] (9.545 s) : 0, 9544828
Agent [candidate] (1.223 s) : 0, 1223010
Total [candidate] (9.576 s) : 0, 9575686
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent iast 1.227 s 155.682 ms (14.5%)
Total tracing 8.897 s -
Total iast 9.545 s 647.617 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.223 s 153.01 ms (14.3%)
Total tracing 8.869 s -
Total iast 9.576 s 706.488 ms (8.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.248 ms) : 0, 1248
crashtracking [candidate] (1.243 ms) : 0, 1243
BytebuddyAgent [baseline] (641.62 ms) : 0, 641620
BytebuddyAgent [candidate] (641.973 ms) : 0, 641973
AgentMeter [baseline] (29.896 ms) : 0, 29896
AgentMeter [candidate] (29.89 ms) : 0, 29890
GlobalTracer [baseline] (251.333 ms) : 0, 251333
GlobalTracer [candidate] (250.541 ms) : 0, 250541
AppSec [baseline] (32.448 ms) : 0, 32448
AppSec [candidate] (32.34 ms) : 0, 32340
Debugger [baseline] (60.185 ms) : 0, 60185
Debugger [candidate] (59.758 ms) : 0, 59758
Remote Config [baseline] (608.374 µs) : 0, 608
Remote Config [candidate] (610.296 µs) : 0, 610
Telemetry [baseline] (8.207 ms) : 0, 8207
Telemetry [candidate] (8.165 ms) : 0, 8165
Flare Poller [baseline] (9.307 ms) : 0, 9307
Flare Poller [candidate] (9.116 ms) : 0, 9116
section iast
crashtracking [baseline] (1.234 ms) : 0, 1234
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (802.82 ms) : 0, 802820
BytebuddyAgent [candidate] (800.642 ms) : 0, 800642
AgentMeter [baseline] (11.374 ms) : 0, 11374
AgentMeter [candidate] (11.387 ms) : 0, 11387
GlobalTracer [baseline] (239.901 ms) : 0, 239901
GlobalTracer [candidate] (239.398 ms) : 0, 239398
IAST [baseline] (26.895 ms) : 0, 26895
IAST [candidate] (25.803 ms) : 0, 25803
AppSec [baseline] (30.596 ms) : 0, 30596
AppSec [candidate] (31.73 ms) : 0, 31730
Debugger [baseline] (62.993 ms) : 0, 62993
Debugger [candidate] (58.576 ms) : 0, 58576
Remote Config [baseline] (551.003 µs) : 0, 551
Remote Config [candidate] (524.855 µs) : 0, 525
Telemetry [baseline] (11.013 ms) : 0, 11013
Telemetry [candidate] (13.831 ms) : 0, 13831
Flare Poller [baseline] (3.415 ms) : 0, 3415
Flare Poller [candidate] (3.425 ms) : 0, 3425
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/groovy-to-java-config
git_commit_date 1775834061 1776087091
git_commit_sha 5ab378f 8d727de
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~8d727dee32
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776089620 1776089620
ci_job_id 1589566351 1589566351
ci_pipeline_id 107365600 107365600
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-iio3xwcr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-iio3xwcr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-267.212µs; -137.485µs] or [-13.631%; -7.014%]		 unstable
[-1302.069µs; -520.393µs] or [-21.035%; -8.407%]		 unstable
[+55.583op/s; +523.417op/s] or [+3.167%; +29.820%]		 1.758ms 5.279ms 2044.781op/s 1.960ms 6.190ms 1755.281op/s
scenario:load:insecure-bank:iast:high_load better
[-255.445µs; -127.826µs] or [-9.243%; -4.625%]		 same
[-375.554µs; +28.241µs] or [-4.852%; +0.365%]		 unstable
[-92.216op/s; +216.904op/s] or [-7.019%; +16.509%]		 2.572ms 7.566ms 1376.156op/s 2.764ms 7.739ms 1313.812op/s
scenario:load:petclinic:code_origins:high_load better
[-1297.472µs; -375.855µs] or [-6.907%; -2.001%]		 unsure
[-2.076ms; -0.535ms] or [-6.890%; -1.776%]		 unstable
[-17.357op/s; +38.982op/s] or [-7.072%; +15.883%]		 17.947ms 28.822ms 256.250op/s 18.784ms 30.127ms 245.438op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.264 ms) : 1252, 1276
.   : milestone, 1264,
iast (3.488 ms) : 3438, 3537
.   : milestone, 3488,
iast_FULL (6.246 ms) : 6181, 6311
.   : milestone, 6246,
iast_GLOBAL (3.595 ms) : 3542, 3647
.   : milestone, 3595,
profiling (2.591 ms) : 2563, 2620
.   : milestone, 2591,
tracing (1.877 ms) : 1861, 1892
.   : milestone, 1877,
section candidate
no_agent (1.248 ms) : 1235, 1260
.   : milestone, 1248,
iast (3.326 ms) : 3280, 3372
.   : milestone, 3326,
iast_FULL (6.101 ms) : 6039, 6163
.   : milestone, 6101,
iast_GLOBAL (3.754 ms) : 3680, 3828
.   : milestone, 3754,
profiling (2.214 ms) : 2192, 2236
.   : milestone, 2214,
tracing (1.921 ms) : 1903, 1939
.   : milestone, 1921,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.264 ms [1.252 ms, 1.276 ms] -
iast 3.488 ms [3.438 ms, 3.537 ms] 2.223 ms (175.8%)
iast_FULL 6.246 ms [6.181 ms, 6.311 ms] 4.982 ms (394.0%)
iast_GLOBAL 3.595 ms [3.542 ms, 3.647 ms] 2.33 ms (184.3%)
profiling 2.591 ms [2.563 ms, 2.62 ms] 1.327 ms (104.9%)
tracing 1.877 ms [1.861 ms, 1.892 ms] 612.162 µs (48.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.248 ms [1.235 ms, 1.26 ms] -
iast 3.326 ms [3.28 ms, 3.372 ms] 2.078 ms (166.6%)
iast_FULL 6.101 ms [6.039 ms, 6.163 ms] 4.854 ms (389.0%)
iast_GLOBAL 3.754 ms [3.68 ms, 3.828 ms] 2.506 ms (200.9%)
profiling 2.214 ms [2.192 ms, 2.236 ms] 965.969 µs (77.4%)
tracing 1.921 ms [1.903 ms, 1.939 ms] 673.683 µs (54.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.584 ms) : 17408, 17761
.   : milestone, 17584,
appsec (19.084 ms) : 18890, 19278
.   : milestone, 19084,
code_origins (19.011 ms) : 18821, 19202
.   : milestone, 19011,
iast (18.404 ms) : 18223, 18586
.   : milestone, 18404,
profiling (18.672 ms) : 18484, 18859
.   : milestone, 18672,
tracing (17.816 ms) : 17641, 17992
.   : milestone, 17816,
section candidate
no_agent (17.604 ms) : 17430, 17777
.   : milestone, 17604,
appsec (19.205 ms) : 19011, 19399
.   : milestone, 19205,
code_origins (18.211 ms) : 18032, 18389
.   : milestone, 18211,
iast (18.388 ms) : 18201, 18576
.   : milestone, 18388,
profiling (18.265 ms) : 18085, 18445
.   : milestone, 18265,
tracing (18.333 ms) : 18154, 18513
.   : milestone, 18333,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.584 ms [17.408 ms, 17.761 ms] -
appsec 19.084 ms [18.89 ms, 19.278 ms] 1.499 ms (8.5%)
code_origins 19.011 ms [18.821 ms, 19.202 ms] 1.427 ms (8.1%)
iast 18.404 ms [18.223 ms, 18.586 ms] 820.128 µs (4.7%)
profiling 18.672 ms [18.484 ms, 18.859 ms] 1.088 ms (6.2%)
tracing 17.816 ms [17.641 ms, 17.992 ms] 232.124 µs (1.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.604 ms [17.43 ms, 17.777 ms] -
appsec 19.205 ms [19.011 ms, 19.399 ms] 1.601 ms (9.1%)
code_origins 18.211 ms [18.032 ms, 18.389 ms] 607.029 µs (3.4%)
iast 18.388 ms [18.201 ms, 18.576 ms] 784.762 µs (4.5%)
profiling 18.265 ms [18.085 ms, 18.445 ms] 661.521 µs (3.8%)
tracing 18.333 ms [18.154 ms, 18.513 ms] 729.534 µs (4.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/groovy-to-java-config
git_commit_date 1775834061 1776087091
git_commit_sha 5ab378f 8d727de
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~8d727dee32
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776089364 1776089364
ci_job_id 1589566353 1589566353
ci_pipeline_id 107365600 107365600
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-uzbjz43p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-uzbjz43p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.495 ms) : 1484, 1507
.   : milestone, 1495,
appsec (3.83 ms) : 3608, 4052
.   : milestone, 3830,
iast (2.274 ms) : 2205, 2344
.   : milestone, 2274,
iast_GLOBAL (2.321 ms) : 2252, 2391
.   : milestone, 2321,
profiling (2.122 ms) : 2066, 2178
.   : milestone, 2122,
tracing (2.094 ms) : 2040, 2148
.   : milestone, 2094,
section candidate
no_agent (1.494 ms) : 1483, 1506
.   : milestone, 1494,
appsec (3.814 ms) : 3591, 4036
.   : milestone, 3814,
iast (2.287 ms) : 2218, 2357
.   : milestone, 2287,
iast_GLOBAL (2.321 ms) : 2252, 2391
.   : milestone, 2321,
profiling (2.121 ms) : 2065, 2177
.   : milestone, 2121,
tracing (2.098 ms) : 2044, 2152
.   : milestone, 2098,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.495 ms [1.484 ms, 1.507 ms] -
appsec 3.83 ms [3.608 ms, 4.052 ms] 2.335 ms (156.1%)
iast 2.274 ms [2.205 ms, 2.344 ms] 778.873 µs (52.1%)
iast_GLOBAL 2.321 ms [2.252 ms, 2.391 ms] 826.071 µs (55.2%)
profiling 2.122 ms [2.066 ms, 2.178 ms] 626.524 µs (41.9%)
tracing 2.094 ms [2.04 ms, 2.148 ms] 598.897 µs (40.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.494 ms [1.483 ms, 1.506 ms] -
appsec 3.814 ms [3.591 ms, 4.036 ms] 2.319 ms (155.2%)
iast 2.287 ms [2.218 ms, 2.357 ms] 793.015 µs (53.1%)
iast_GLOBAL 2.321 ms [2.252 ms, 2.391 ms] 826.983 µs (55.3%)
profiling 2.121 ms [2.065 ms, 2.177 ms] 626.62 µs (41.9%)
tracing 2.098 ms [2.044 ms, 2.152 ms] 603.747 µs (40.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~8d727dee32, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.752 s) : 14752000, 14752000
.   : milestone, 14752000,
appsec (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
iast (18.505 s) : 18505000, 18505000
.   : milestone, 18505000,
iast_GLOBAL (18.053 s) : 18053000, 18053000
.   : milestone, 18053000,
profiling (14.717 s) : 14717000, 14717000
.   : milestone, 14717000,
tracing (15.146 s) : 15146000, 15146000
.   : milestone, 15146000,
section candidate
no_agent (15.005 s) : 15005000, 15005000
.   : milestone, 15005000,
appsec (14.596 s) : 14596000, 14596000
.   : milestone, 14596000,
iast (18.114 s) : 18114000, 18114000
.   : milestone, 18114000,
iast_GLOBAL (17.952 s) : 17952000, 17952000
.   : milestone, 17952000,
profiling (14.643 s) : 14643000, 14643000
.   : milestone, 14643000,
tracing (15.025 s) : 15025000, 15025000
.   : milestone, 15025000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.752 s [14.752 s, 14.752 s] -
appsec 14.872 s [14.872 s, 14.872 s] 120.0 ms (0.8%)
iast 18.505 s [18.505 s, 18.505 s] 3.753 s (25.4%)
iast_GLOBAL 18.053 s [18.053 s, 18.053 s] 3.301 s (22.4%)
profiling 14.717 s [14.717 s, 14.717 s] -35.0 ms (-0.2%)
tracing 15.146 s [15.146 s, 15.146 s] 394.0 ms (2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.005 s [15.005 s, 15.005 s] -
appsec 14.596 s [14.596 s, 14.596 s] -409.0 ms (-2.7%)
iast 18.114 s [18.114 s, 18.114 s] 3.109 s (20.7%)
iast_GLOBAL 17.952 s [17.952 s, 17.952 s] 2.947 s (19.6%)
profiling 14.643 s [14.643 s, 14.643 s] -362.0 ms (-2.4%)
tracing 15.025 s [15.025 s, 15.025 s] 20.0 ms (0.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: testing Testing tag: ai generated Largely based on code generated by an AI or LLM type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@PerfectSlayer