Skip to content

Test IastOverheadControlSpringBootSmokeTest.Test that all the vulnerabilities are detected marked as flaky. #9418

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
AlexeyKuznetsov-DD merged 1 commit into from
Aug 25, 2025
Merged

Test IastOverheadControlSpringBootSmokeTest.Test that all the vulnerabilities are detected marked as flaky. #9418

AlexeyKuznetsov-DD merged 1 commit into from
Aug 25, 2025

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Aug 25, 2025

What Does This Do

Test IastOverheadControlSpringBootSmokeTest.Test that all the vulnerabilities are detected marked as flaky.

Motivation

Green CI.

Additional Notes

Discussed with @jandro996 to mark it flaky for now.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review August 25, 2025 13:02
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested a review from a team as a code owner August 25, 2025 13:02
@github-actions
Copy link
Contributor

github-actions bot commented Aug 25, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Aug 25, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Aug 25, 2025
@pr-commenter
Copy link

pr-commenter bot commented Aug 25, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/all-vuluns-detected-marked-as-flaky
git_commit_date 1755892093 1756125775
git_commit_sha da2930a 7a425d5
release_version 1.53.0-SNAPSHOT~da2930a64d 1.53.0-SNAPSHOT~7a425d511c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756127554 1756127554
ci_job_id 1096427934 1096427934
ci_pipeline_id 74613619 74613619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7uli1bhu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7uli1bhu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048633
Total [baseline] (10.727 s) : 0, 10726997
Agent [candidate] (1.059 s) : 0, 1058668
Total [candidate] (10.713 s) : 0, 10713032
section appsec
Agent [baseline] (1.227 s) : 0, 1227032
Total [baseline] (10.903 s) : 0, 10902635
Agent [candidate] (1.225 s) : 0, 1225424
Total [candidate] (10.788 s) : 0, 10788359
section iast
Agent [baseline] (1.189 s) : 0, 1188744
Total [baseline] (11.022 s) : 0, 11021517
Agent [candidate] (1.18 s) : 0, 1180232
Total [candidate] (10.993 s) : 0, 10992858
section profiling
Agent [baseline] (1.209 s) : 0, 1209445
Total [baseline] (10.987 s) : 0, 10986603
Agent [candidate] (1.211 s) : 0, 1211442
Total [candidate] (10.913 s) : 0, 10913274
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.227 s 178.4 ms (17.0%)
Agent iast 1.189 s 140.111 ms (13.4%)
Agent profiling 1.209 s 160.812 ms (15.3%)
Total tracing 10.727 s -
Total appsec 10.903 s 175.638 ms (1.6%)
Total iast 11.022 s 294.52 ms (2.7%)
Total profiling 10.987 s 259.606 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.225 s 166.756 ms (15.8%)
Agent iast 1.18 s 121.564 ms (11.5%)
Agent profiling 1.211 s 152.774 ms (14.4%)
Total tracing 10.713 s -
Total appsec 10.788 s 75.327 ms (0.7%)
Total iast 10.993 s 279.825 ms (2.6%)
Total profiling 10.913 s 200.241 ms (1.9%) 
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (733.581 ms) : 0, 733581
BytebuddyAgent [candidate] (740.439 ms) : 0, 740439
GlobalTracer [baseline] (243.453 ms) : 0, 243453
GlobalTracer [candidate] (245.175 ms) : 0, 245175
AppSec [baseline] (30.124 ms) : 0, 30124
AppSec [candidate] (30.505 ms) : 0, 30505
Debugger [baseline] (6.092 ms) : 0, 6092
Debugger [candidate] (6.115 ms) : 0, 6115
Remote Config [baseline] (664.293 µs) : 0, 664
Remote Config [candidate] (672.391 µs) : 0, 672
Telemetry [baseline] (12.247 ms) : 0, 12247
Telemetry [candidate] (13.16 ms) : 0, 13160
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (756.816 ms) : 0, 756816
BytebuddyAgent [candidate] (756.929 ms) : 0, 756929
GlobalTracer [baseline] (236.775 ms) : 0, 236775
GlobalTracer [candidate] (235.968 ms) : 0, 235968
IAST [baseline] (23.684 ms) : 0, 23684
IAST [candidate] (23.685 ms) : 0, 23685
AppSec [baseline] (170.515 ms) : 0, 170515
AppSec [candidate] (168.881 ms) : 0, 168881
Debugger [baseline] (6.578 ms) : 0, 6578
Debugger [candidate] (6.595 ms) : 0, 6595
Remote Config [baseline] (628.044 µs) : 0, 628
Remote Config [candidate] (647.808 µs) : 0, 648
Telemetry [baseline] (9.349 ms) : 0, 9349
Telemetry [candidate] (10.092 ms) : 0, 10092
section iast
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (858.821 ms) : 0, 858821
BytebuddyAgent [candidate] (851.414 ms) : 0, 851414
GlobalTracer [baseline] (236.099 ms) : 0, 236099
GlobalTracer [candidate] (233.555 ms) : 0, 233555
IAST [baseline] (29.605 ms) : 0, 29605
IAST [candidate] (30.261 ms) : 0, 30261
AppSec [baseline] (26.249 ms) : 0, 26249
AppSec [candidate] (26.923 ms) : 0, 26923
Debugger [baseline] (6.552 ms) : 0, 6552
Debugger [candidate] (6.642 ms) : 0, 6642
Remote Config [baseline] (603.383 µs) : 0, 603
Remote Config [candidate] (601.05 µs) : 0, 601
Telemetry [baseline] (8.204 ms) : 0, 8204
Telemetry [candidate] (8.323 ms) : 0, 8323
section profiling
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (770.859 ms) : 0, 770859
BytebuddyAgent [candidate] (771.201 ms) : 0, 771201
GlobalTracer [baseline] (224.608 ms) : 0, 224608
GlobalTracer [candidate] (226.012 ms) : 0, 226012
AppSec [baseline] (30.376 ms) : 0, 30376
AppSec [candidate] (30.775 ms) : 0, 30775
Debugger [baseline] (6.322 ms) : 0, 6322
Debugger [candidate] (6.43 ms) : 0, 6430
Remote Config [baseline] (723.023 µs) : 0, 723
Remote Config [candidate] (720.984 µs) : 0, 721
Telemetry [baseline] (16.478 ms) : 0, 16478
Telemetry [candidate] (16.323 ms) : 0, 16323
ProfilingAgent [baseline] (108.51 ms) : 0, 108510
ProfilingAgent [candidate] (108.367 ms) : 0, 108367
Profiling [baseline] (109.164 ms) : 0, 109164
Profiling [candidate] (109.014 ms) : 0, 109014
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1051664
Total [baseline] (8.657 s) : 0, 8656849
Agent [candidate] (1.053 s) : 0, 1053070
Total [candidate] (8.648 s) : 0, 8648443
section iast
Agent [baseline] (1.186 s) : 0, 1185630
Total [baseline] (9.396 s) : 0, 9396417
Agent [candidate] (1.184 s) : 0, 1183694
Total [candidate] (9.371 s) : 0, 9371353
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.186 s 133.966 ms (12.7%)
Total tracing 8.657 s -
Total iast 9.396 s 739.568 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.184 s 130.625 ms (12.4%)
Total tracing 8.648 s -
Total iast 9.371 s 722.91 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (735.123 ms) : 0, 735123
BytebuddyAgent [candidate] (736.776 ms) : 0, 736776
GlobalTracer [baseline] (243.567 ms) : 0, 243567
GlobalTracer [candidate] (244.239 ms) : 0, 244239
AppSec [baseline] (30.133 ms) : 0, 30133
AppSec [candidate] (30.337 ms) : 0, 30337
Debugger [baseline] (6.081 ms) : 0, 6081
Debugger [candidate] (6.081 ms) : 0, 6081
Remote Config [baseline] (671.535 µs) : 0, 672
Remote Config [candidate] (672.134 µs) : 0, 672
Telemetry [baseline] (13.623 ms) : 0, 13623
Telemetry [candidate] (12.42 ms) : 0, 12420
section iast
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (854.76 ms) : 0, 854760
BytebuddyAgent [candidate] (853.819 ms) : 0, 853819
GlobalTracer [baseline] (234.032 ms) : 0, 234032
GlobalTracer [candidate] (234.129 ms) : 0, 234129
IAST [baseline] (30.977 ms) : 0, 30977
IAST [candidate] (27.927 ms) : 0, 27927
AppSec [baseline] (26.613 ms) : 0, 26613
AppSec [candidate] (28.764 ms) : 0, 28764
Debugger [baseline] (7.525 ms) : 0, 7525
Debugger [candidate] (7.51 ms) : 0, 7510
Remote Config [baseline] (672.782 µs) : 0, 673
Remote Config [candidate] (614.035 µs) : 0, 614
Telemetry [baseline] (8.511 ms) : 0, 8511
Telemetry [candidate] (8.431 ms) : 0, 8431
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/all-vuluns-detected-marked-as-flaky
git_commit_date 1755892093 1756125775
git_commit_sha da2930a 7a425d5
release_version 1.53.0-SNAPSHOT~da2930a64d 1.53.0-SNAPSHOT~7a425d511c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756127224 1756127224
ci_job_id 1096427935 1096427935
ci_pipeline_id 74613619 74613619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-onya71l6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-onya71l6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 12 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.445 ms) : 4395, 4495
.   : milestone, 4445,
iast (9.437 ms) : 9278, 9597
.   : milestone, 9437,
iast_FULL (14.135 ms) : 13853, 14417
.   : milestone, 14135,
iast_GLOBAL (10.264 ms) : 10085, 10444
.   : milestone, 10264,
profiling (8.767 ms) : 8626, 8907
.   : milestone, 8767,
tracing (7.429 ms) : 7323, 7535
.   : milestone, 7429,
section candidate
no_agent (4.447 ms) : 4397, 4497
.   : milestone, 4447,
iast (9.746 ms) : 9583, 9909
.   : milestone, 9746,
iast_FULL (13.78 ms) : 13504, 14057
.   : milestone, 13780,
iast_GLOBAL (10.195 ms) : 10017, 10373
.   : milestone, 10195,
profiling (8.818 ms) : 8683, 8953
.   : milestone, 8818,
tracing (7.367 ms) : 7266, 7469
.   : milestone, 7367,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.445 ms [4.395 ms, 4.495 ms] -
iast 9.437 ms [9.278 ms, 9.597 ms] 4.993 ms (112.3%)
iast_FULL 14.135 ms [13.853 ms, 14.417 ms] 9.69 ms (218.0%)
iast_GLOBAL 10.264 ms [10.085 ms, 10.444 ms] 5.82 ms (130.9%)
profiling 8.767 ms [8.626 ms, 8.907 ms] 4.322 ms (97.2%)
tracing 7.429 ms [7.323 ms, 7.535 ms] 2.984 ms (67.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.447 ms [4.397 ms, 4.497 ms] -
iast 9.746 ms [9.583 ms, 9.909 ms] 5.299 ms (119.2%)
iast_FULL 13.78 ms [13.504 ms, 14.057 ms] 9.333 ms (209.9%)
iast_GLOBAL 10.195 ms [10.017 ms, 10.373 ms] 5.748 ms (129.3%)
profiling 8.818 ms [8.683 ms, 8.953 ms] 4.371 ms (98.3%)
tracing 7.367 ms [7.266 ms, 7.469 ms] 2.92 ms (65.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.402 ms) : 38092, 38712
.   : milestone, 38402,
appsec (48.531 ms) : 48094, 48968
.   : milestone, 48531,
code_origins (44.57 ms) : 44176, 44965
.   : milestone, 44570,
iast (44.417 ms) : 44049, 44786
.   : milestone, 44417,
profiling (47.697 ms) : 47262, 48131
.   : milestone, 47697,
tracing (44.161 ms) : 43785, 44536
.   : milestone, 44161,
section candidate
no_agent (37.861 ms) : 37561, 38160
.   : milestone, 37861,
appsec (47.657 ms) : 47233, 48081
.   : milestone, 47657,
code_origins (44.93 ms) : 44544, 45316
.   : milestone, 44930,
iast (44.768 ms) : 44378, 45158
.   : milestone, 44768,
profiling (48.022 ms) : 47601, 48442
.   : milestone, 48022,
tracing (44.325 ms) : 43940, 44709
.   : milestone, 44325,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.402 ms [38.092 ms, 38.712 ms] -
appsec 48.531 ms [48.094 ms, 48.968 ms] 10.129 ms (26.4%)
code_origins 44.57 ms [44.176 ms, 44.965 ms] 6.168 ms (16.1%)
iast 44.417 ms [44.049 ms, 44.786 ms] 6.016 ms (15.7%)
profiling 47.697 ms [47.262 ms, 48.131 ms] 9.295 ms (24.2%)
tracing 44.161 ms [43.785 ms, 44.536 ms] 5.759 ms (15.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.861 ms [37.561 ms, 38.16 ms] -
appsec 47.657 ms [47.233 ms, 48.081 ms] 9.796 ms (25.9%)
code_origins 44.93 ms [44.544 ms, 45.316 ms] 7.07 ms (18.7%)
iast 44.768 ms [44.378 ms, 45.158 ms] 6.907 ms (18.2%)
profiling 48.022 ms [47.601 ms, 48.442 ms] 10.161 ms (26.8%)
tracing 44.325 ms [43.94 ms, 44.709 ms] 6.464 ms (17.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/all-vuluns-detected-marked-as-flaky
git_commit_date 1755892093 1756125775
git_commit_sha da2930a 7a425d5
release_version 1.53.0-SNAPSHOT~da2930a64d 1.53.0-SNAPSHOT~7a425d511c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1756127808 1756127808
ci_job_id 1096427936 1096427936
ci_pipeline_id 74613619 74613619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-oavmrv9o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-oavmrv9o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
appsec (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
iast (18.723 s) : 18723000, 18723000
.   : milestone, 18723000,
iast_GLOBAL (18.085 s) : 18085000, 18085000
.   : milestone, 18085000,
profiling (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
tracing (14.894 s) : 14894000, 14894000
.   : milestone, 14894000,
section candidate
no_agent (15.101 s) : 15101000, 15101000
.   : milestone, 15101000,
appsec (14.896 s) : 14896000, 14896000
.   : milestone, 14896000,
iast (18.4 s) : 18400000, 18400000
.   : milestone, 18400000,
iast_GLOBAL (18.121 s) : 18121000, 18121000
.   : milestone, 18121000,
profiling (15.832 s) : 15832000, 15832000
.   : milestone, 15832000,
tracing (15.045 s) : 15045000, 15045000
.   : milestone, 15045000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.926 s [14.926 s, 14.926 s] -
appsec 15.024 s [15.024 s, 15.024 s] 98.0 ms (0.7%)
iast 18.723 s [18.723 s, 18.723 s] 3.797 s (25.4%)
iast_GLOBAL 18.085 s [18.085 s, 18.085 s] 3.159 s (21.2%)
profiling 15.075 s [15.075 s, 15.075 s] 149.0 ms (1.0%)
tracing 14.894 s [14.894 s, 14.894 s] -32.0 ms (-0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.101 s [15.101 s, 15.101 s] -
appsec 14.896 s [14.896 s, 14.896 s] -205.0 ms (-1.4%)
iast 18.4 s [18.4 s, 18.4 s] 3.299 s (21.8%)
iast_GLOBAL 18.121 s [18.121 s, 18.121 s] 3.02 s (20.0%)
profiling 15.832 s [15.832 s, 15.832 s] 731.0 ms (4.8%)
tracing 15.045 s [15.045 s, 15.045 s] -56.0 ms (-0.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~7a425d511c, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1487
.   : milestone, 1475,
appsec (2.464 ms) : 2411, 2517
.   : milestone, 2464,
iast (2.203 ms) : 2141, 2266
.   : milestone, 2203,
iast_GLOBAL (2.235 ms) : 2172, 2298
.   : milestone, 2235,
profiling (2.067 ms) : 2015, 2119
.   : milestone, 2067,
tracing (2.016 ms) : 1967, 2065
.   : milestone, 2016,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.652 ms) : 3437, 3867
.   : milestone, 3652,
iast (2.194 ms) : 2131, 2256
.   : milestone, 2194,
iast_GLOBAL (2.235 ms) : 2172, 2298
.   : milestone, 2235,
profiling (2.049 ms) : 1999, 2100
.   : milestone, 2049,
tracing (2.017 ms) : 1969, 2066
.   : milestone, 2017,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.487 ms] -
appsec 2.464 ms [2.411 ms, 2.517 ms] 988.566 µs (67.0%)
iast 2.203 ms [2.141 ms, 2.266 ms] 728.378 µs (49.4%)
iast_GLOBAL 2.235 ms [2.172 ms, 2.298 ms] 760.185 µs (51.5%)
profiling 2.067 ms [2.015 ms, 2.119 ms] 591.674 µs (40.1%)
tracing 2.016 ms [1.967 ms, 2.065 ms] 540.885 µs (36.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.652 ms [3.437 ms, 3.867 ms] 2.175 ms (147.3%)
iast 2.194 ms [2.131 ms, 2.256 ms] 717.398 µs (48.6%)
iast_GLOBAL 2.235 ms [2.172 ms, 2.298 ms] 758.836 µs (51.4%)
profiling 2.049 ms [1.999 ms, 2.1 ms] 573.142 µs (38.8%)
tracing 2.017 ms [1.969 ms, 2.066 ms] 540.914 µs (36.6%)

jandro996
jandro996 approved these changes Aug 25, 2025
View reviewed changes
Copy link
Member

@jandro996 jandro996 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking care of this! I've also created a Jira ticket https://datadoghq.atlassian.net/browse/APPSEC-58728

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD enabled auto-merge (squash) August 25, 2025 13:50
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD merged commit 86326e4 into master Aug 25, 2025
667 of 673 checks passed
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the alexeyk/all-vuluns-detected-marked-as-flaky branch August 25, 2025 13:56
@github-actions github-actions bot added this to the 1.53.0 milestone Aug 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jandro996 jandro996 jandro996 approved these changes

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/asm-java

Assignees

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.53.0

Development

Successfully merging this pull request may close these issues.

3 participants

@AlexeyKuznetsov-DD @jandro996