Skip to content

Update system-tests commit #8762

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jandro996 merged 2 commits into from
May 6, 2025
Merged

Update system-tests commit #8762

jandro996 merged 2 commits into from
May 6, 2025

Conversation

@jandro996
Copy link
Member

@jandro996 jandro996 commented May 5, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jandro996 jandro996 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels May 5, 2025
@jandro996 jandro996 requested a review from a team as a code owner May 5, 2025 07:21
@jandro996 jandro996 requested a review from mcculls May 5, 2025 07:21
@pr-commenter
Copy link

pr-commenter bot commented May 5, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alejandro.gonzalez/update-system-tests-commit
git_commit_date 1746516330 1746516465
git_commit_sha 0e18e0e b33d0d7
release_version 1.49.0-SNAPSHOT~0e18e0e887 1.49.0-SNAPSHOT~b33d0d7a74
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746519484 1746519484
ci_job_id 924919162 924919162
ci_pipeline_id 64204866 64204866
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-1yhapm6c-project-304-concurrent-0-qe3ffmw7 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-1yhapm6c-project-304-concurrent-0-qe3ffmw7 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.009 s) : 0, 1008676
Total [baseline] (10.51 s) : 0, 10510022
Agent [candidate] (1.008 s) : 0, 1007597
Total [candidate] (10.514 s) : 0, 10513533
section appsec
Agent [baseline] (1.152 s) : 0, 1152419
Total [baseline] (10.693 s) : 0, 10693363
Agent [candidate] (1.151 s) : 0, 1151271
Total [candidate] (10.692 s) : 0, 10691859
section iast
Agent [baseline] (1.137 s) : 0, 1136905
Total [baseline] (10.817 s) : 0, 10817373
Agent [candidate] (1.154 s) : 0, 1154336
Total [candidate] (10.956 s) : 0, 10955507
section profiling
Agent [baseline] (1.267 s) : 0, 1267445
Total [baseline] (10.916 s) : 0, 10915721
Agent [candidate] (1.259 s) : 0, 1259482
Total [candidate] (10.863 s) : 0, 10863263
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.009 s -
Agent appsec 1.152 s 143.743 ms (14.3%)
Agent iast 1.137 s 128.229 ms (12.7%)
Agent profiling 1.267 s 258.769 ms (25.7%)
Total tracing 10.51 s -
Total appsec 10.693 s 183.342 ms (1.7%)
Total iast 10.817 s 307.351 ms (2.9%)
Total profiling 10.916 s 405.699 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.008 s -
Agent appsec 1.151 s 143.674 ms (14.3%)
Agent iast 1.154 s 146.739 ms (14.6%)
Agent profiling 1.259 s 251.886 ms (25.0%)
Total tracing 10.514 s -
Total appsec 10.692 s 178.327 ms (1.7%)
Total iast 10.956 s 441.975 ms (4.2%)
Total profiling 10.863 s 349.73 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.973 ms) : 0, 670973
BytebuddyAgent [candidate] (671.959 ms) : 0, 671959
GlobalTracer [baseline] (240.493 ms) : 0, 240493
GlobalTracer [candidate] (240.652 ms) : 0, 240652
AppSec [baseline] (54.776 ms) : 0, 54776
AppSec [candidate] (54.708 ms) : 0, 54708
Debugger [baseline] (6.138 ms) : 0, 6138
Debugger [candidate] (6.168 ms) : 0, 6168
Remote Config [baseline] (703.914 µs) : 0, 704
Remote Config [candidate] (718.868 µs) : 0, 719
Telemetry [baseline] (12.14 ms) : 0, 12140
Telemetry [candidate] (9.903 ms) : 0, 9903
section appsec
BytebuddyAgent [baseline] (690.65 ms) : 0, 690650
BytebuddyAgent [candidate] (689.017 ms) : 0, 689017
GlobalTracer [baseline] (237.028 ms) : 0, 237028
GlobalTracer [candidate] (237.753 ms) : 0, 237753
AppSec [baseline] (175.729 ms) : 0, 175729
AppSec [candidate] (176.227 ms) : 0, 176227
Debugger [baseline] (5.908 ms) : 0, 5908
Debugger [candidate] (5.888 ms) : 0, 5888
Remote Config [baseline] (642.623 µs) : 0, 643
Remote Config [candidate] (637.449 µs) : 0, 637
Telemetry [baseline] (8.189 ms) : 0, 8189
Telemetry [candidate] (7.413 ms) : 0, 7413
IAST [baseline] (21.766 ms) : 0, 21766
IAST [candidate] (21.967 ms) : 0, 21967
section iast
BytebuddyAgent [baseline] (789.708 ms) : 0, 789708
BytebuddyAgent [candidate] (802.531 ms) : 0, 802531
GlobalTracer [baseline] (230.455 ms) : 0, 230455
GlobalTracer [candidate] (233.247 ms) : 0, 233247
AppSec [baseline] (56.408 ms) : 0, 56408
AppSec [candidate] (56.953 ms) : 0, 56953
Debugger [baseline] (5.864 ms) : 0, 5864
Debugger [candidate] (5.991 ms) : 0, 5991
Remote Config [baseline] (582.079 µs) : 0, 582
Remote Config [candidate] (602.079 µs) : 0, 602
Telemetry [baseline] (7.819 ms) : 0, 7819
Telemetry [candidate] (8.054 ms) : 0, 8054
IAST [baseline] (22.712 ms) : 0, 22712
IAST [candidate] (23.199 ms) : 0, 23199
section profiling
ProfilingAgent [baseline] (96.159 ms) : 0, 96159
ProfilingAgent [candidate] (96.48 ms) : 0, 96480
BytebuddyAgent [baseline] (669.711 ms) : 0, 669711
BytebuddyAgent [candidate] (663.833 ms) : 0, 663833
GlobalTracer [baseline] (381.247 ms) : 0, 381247
GlobalTracer [candidate] (379.928 ms) : 0, 379928
AppSec [baseline] (54.652 ms) : 0, 54652
AppSec [candidate] (54.009 ms) : 0, 54009
Debugger [baseline] (6.079 ms) : 0, 6079
Debugger [candidate] (6.137 ms) : 0, 6137
Remote Config [baseline] (644.077 µs) : 0, 644
Remote Config [candidate] (654.837 µs) : 0, 655
Telemetry [baseline] (8.141 ms) : 0, 8141
Telemetry [candidate] (8.168 ms) : 0, 8168
Profiling [baseline] (96.183 ms) : 0, 96183
Profiling [candidate] (96.504 ms) : 0, 96504
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020961
Total [baseline] (8.683 s) : 0, 8683438
Agent [candidate] (1.016 s) : 0, 1015704
Total [candidate] (8.659 s) : 0, 8659098
section iast
Agent [baseline] (1.137 s) : 0, 1136656
Total [baseline] (9.199 s) : 0, 9198786
Agent [candidate] (1.14 s) : 0, 1140019
Total [candidate] (9.196 s) : 0, 9195750
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.138 s) : 0, 1137929
Total [baseline] (9.181 s) : 0, 9180936
Agent [candidate] (1.137 s) : 0, 1137270
Total [candidate] (9.182 s) : 0, 9181621
section iast_TELEMETRY_OFF
Agent [baseline] (1.132 s) : 0, 1131772
Total [baseline] (9.205 s) : 0, 9205210
Agent [candidate] (1.135 s) : 0, 1134556
Total [candidate] (9.188 s) : 0, 9187637
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent iast 1.137 s 115.695 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.138 s 116.968 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.132 s 110.811 ms (10.9%)
Total tracing 8.683 s -
Total iast 9.199 s 515.348 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.181 s 497.498 ms (5.7%)
Total iast_TELEMETRY_OFF 9.205 s 521.772 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.016 s -
Agent iast 1.14 s 124.315 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.137 s 121.566 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.135 s 118.852 ms (11.7%)
Total tracing 8.659 s -
Total iast 9.196 s 536.652 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.182 s 522.523 ms (6.0%)
Total iast_TELEMETRY_OFF 9.188 s 528.539 ms (6.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.358 ms) : 0, 681358
BytebuddyAgent [candidate] (675.314 ms) : 0, 675314
GlobalTracer [baseline] (242.747 ms) : 0, 242747
GlobalTracer [candidate] (241.243 ms) : 0, 241243
AppSec [baseline] (55.402 ms) : 0, 55402
AppSec [candidate] (54.727 ms) : 0, 54727
Debugger [baseline] (7.001 ms) : 0, 7001
Debugger [candidate] (7.982 ms) : 0, 7982
Remote Config [baseline] (711.712 µs) : 0, 712
Remote Config [candidate] (710.978 µs) : 0, 711
Telemetry [baseline] (9.958 ms) : 0, 9958
Telemetry [candidate] (12.197 ms) : 0, 12197
section iast
BytebuddyAgent [baseline] (789.49 ms) : 0, 789490
BytebuddyAgent [candidate] (791.193 ms) : 0, 791193
GlobalTracer [baseline] (230.328 ms) : 0, 230328
GlobalTracer [candidate] (230.781 ms) : 0, 230781
IAST [baseline] (22.764 ms) : 0, 22764
IAST [candidate] (22.988 ms) : 0, 22988
AppSec [baseline] (56.38 ms) : 0, 56380
AppSec [candidate] (57.034 ms) : 0, 57034
Debugger [baseline] (5.851 ms) : 0, 5851
Debugger [candidate] (5.922 ms) : 0, 5922
Remote Config [baseline] (593.165 µs) : 0, 593
Remote Config [candidate] (599.038 µs) : 0, 599
Telemetry [baseline] (7.843 ms) : 0, 7843
Telemetry [candidate] (7.888 ms) : 0, 7888
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (790.387 ms) : 0, 790387
BytebuddyAgent [candidate] (790.045 ms) : 0, 790045
GlobalTracer [baseline] (230.217 ms) : 0, 230217
GlobalTracer [candidate] (230.217 ms) : 0, 230217
IAST [baseline] (22.899 ms) : 0, 22899
IAST [candidate] (22.935 ms) : 0, 22935
AppSec [baseline] (56.584 ms) : 0, 56584
AppSec [candidate] (56.347 ms) : 0, 56347
Debugger [baseline] (5.917 ms) : 0, 5917
Debugger [candidate] (5.87 ms) : 0, 5870
Remote Config [baseline] (587.538 µs) : 0, 588
Remote Config [candidate] (587.374 µs) : 0, 587
Telemetry [baseline] (7.863 ms) : 0, 7863
Telemetry [candidate] (7.835 ms) : 0, 7835
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (785.669 ms) : 0, 785669
BytebuddyAgent [candidate] (787.339 ms) : 0, 787339
GlobalTracer [baseline] (230.061 ms) : 0, 230061
GlobalTracer [candidate] (230.497 ms) : 0, 230497
IAST [baseline] (22.305 ms) : 0, 22305
IAST [candidate] (22.358 ms) : 0, 22358
AppSec [baseline] (56.309 ms) : 0, 56309
AppSec [candidate] (56.794 ms) : 0, 56794
Debugger [baseline] (5.862 ms) : 0, 5862
Debugger [candidate] (5.887 ms) : 0, 5887
Remote Config [baseline] (588.857 µs) : 0, 589
Remote Config [candidate] (592.083 µs) : 0, 592
Telemetry [baseline] (7.668 ms) : 0, 7668
Telemetry [candidate] (7.739 ms) : 0, 7739
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-06T07:48:20 2025-05-06T07:56:07
git_branch master alejandro.gonzalez/update-system-tests-commit
git_commit_date 1746516330 1746516465
git_commit_sha 0e18e0e b33d0d7
release_version 1.49.0-SNAPSHOT~0e18e0e887 1.49.0-SNAPSHOT~b33d0d7a74
start_time 2025-05-06T07:48:06 2025-05-06T07:55:52
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746518565 1746518565
ci_job_id 924919164 924919164
ci_pipeline_id 64204866 64204866
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-mgrvxjgq-project-304-concurrent-0-oji4wy5i 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-mgrvxjgq-project-304-concurrent-0-oji4wy5i 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887
    dateFormat X
    axisFormat %s
section baseline
no_agent (381.229 µs) : 361, 401
.   : milestone, 381,
iast (519.806 µs) : 497, 543
.   : milestone, 520,
iast_FULL (743.455 µs) : 720, 767
.   : milestone, 743,
iast_GLOBAL (572.085 µs) : 549, 596
.   : milestone, 572,
iast_HARDCODED_SECRET_DISABLED (523.08 µs) : 501, 546
.   : milestone, 523,
iast_INACTIVE (467.746 µs) : 445, 490
.   : milestone, 468,
iast_TELEMETRY_OFF (520.631 µs) : 497, 544
.   : milestone, 521,
tracing (463.928 µs) : 442, 486
.   : milestone, 464,
section candidate
no_agent (378.466 µs) : 358, 398
.   : milestone, 378,
iast (526.111 µs) : 503, 549
.   : milestone, 526,
iast_FULL (745.578 µs) : 722, 769
.   : milestone, 746,
iast_GLOBAL (567.359 µs) : 544, 591
.   : milestone, 567,
iast_HARDCODED_SECRET_DISABLED (527.492 µs) : 505, 550
.   : milestone, 527,
iast_INACTIVE (467.766 µs) : 446, 489
.   : milestone, 468,
iast_TELEMETRY_OFF (511.05 µs) : 488, 534
.   : milestone, 511,
tracing (467.868 µs) : 446, 490
.   : milestone, 468,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.229 µs [361.449 µs, 401.008 µs] -
iast 519.806 µs [496.626 µs, 542.986 µs] 138.577 µs (36.4%)
iast_FULL 743.455 µs [720.168 µs, 766.742 µs] 362.226 µs (95.0%)
iast_GLOBAL 572.085 µs [548.65 µs, 595.521 µs] 190.857 µs (50.1%)
iast_HARDCODED_SECRET_DISABLED 523.08 µs [500.573 µs, 545.588 µs] 141.852 µs (37.2%)
iast_INACTIVE 467.746 µs [445.203 µs, 490.288 µs] 86.517 µs (22.7%)
iast_TELEMETRY_OFF 520.631 µs [497.388 µs, 543.874 µs] 139.402 µs (36.6%)
tracing 463.928 µs [442.083 µs, 485.773 µs] 82.7 µs (21.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.466 µs [358.465 µs, 398.467 µs] -
iast 526.111 µs [502.967 µs, 549.255 µs] 147.645 µs (39.0%)
iast_FULL 745.578 µs [722.031 µs, 769.124 µs] 367.112 µs (97.0%)
iast_GLOBAL 567.359 µs [543.87 µs, 590.847 µs] 188.893 µs (49.9%)
iast_HARDCODED_SECRET_DISABLED 527.492 µs [504.961 µs, 550.022 µs] 149.026 µs (39.4%)
iast_INACTIVE 467.766 µs [446.481 µs, 489.052 µs] 89.301 µs (23.6%)
iast_TELEMETRY_OFF 511.05 µs [488.121 µs, 533.98 µs] 132.585 µs (35.0%)
tracing 467.868 µs [445.793 µs, 489.944 µs] 89.403 µs (23.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.368 ms) : 1348, 1388
.   : milestone, 1368,
appsec (1.748 ms) : 1725, 1772
.   : milestone, 1748,
appsec_no_iast (1.72 ms) : 1696, 1744
.   : milestone, 1720,
code_origins (1.68 ms) : 1653, 1707
.   : milestone, 1680,
iast (1.536 ms) : 1512, 1561
.   : milestone, 1536,
profiling (1.54 ms) : 1516, 1564
.   : milestone, 1540,
tracing (1.498 ms) : 1473, 1523
.   : milestone, 1498,
section candidate
no_agent (1.365 ms) : 1346, 1384
.   : milestone, 1365,
appsec (1.731 ms) : 1707, 1754
.   : milestone, 1731,
appsec_no_iast (1.758 ms) : 1734, 1782
.   : milestone, 1758,
code_origins (1.682 ms) : 1655, 1708
.   : milestone, 1682,
iast (1.545 ms) : 1520, 1569
.   : milestone, 1545,
profiling (1.52 ms) : 1497, 1543
.   : milestone, 1520,
tracing (1.494 ms) : 1469, 1519
.   : milestone, 1494,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.368 ms [1.348 ms, 1.388 ms] -
appsec 1.748 ms [1.725 ms, 1.772 ms] 380.227 µs (27.8%)
appsec_no_iast 1.72 ms [1.696 ms, 1.744 ms] 352.291 µs (25.8%)
code_origins 1.68 ms [1.653 ms, 1.707 ms] 311.499 µs (22.8%)
iast 1.536 ms [1.512 ms, 1.561 ms] 167.976 µs (12.3%)
profiling 1.54 ms [1.516 ms, 1.564 ms] 172.085 µs (12.6%)
tracing 1.498 ms [1.473 ms, 1.523 ms] 129.645 µs (9.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.365 ms [1.346 ms, 1.384 ms] -
appsec 1.731 ms [1.707 ms, 1.754 ms] 365.676 µs (26.8%)
appsec_no_iast 1.758 ms [1.734 ms, 1.782 ms] 393.315 µs (28.8%)
code_origins 1.682 ms [1.655 ms, 1.708 ms] 316.65 µs (23.2%)
iast 1.545 ms [1.52 ms, 1.569 ms] 179.845 µs (13.2%)
profiling 1.52 ms [1.497 ms, 1.543 ms] 155.029 µs (11.4%)
tracing 1.494 ms [1.469 ms, 1.519 ms] 129.056 µs (9.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alejandro.gonzalez/update-system-tests-commit
git_commit_date 1746516330 1746516465
git_commit_sha 0e18e0e b33d0d7
release_version 1.49.0-SNAPSHOT~0e18e0e887 1.49.0-SNAPSHOT~b33d0d7a74
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1746519071 1746519071
ci_job_id 924919165 924919165
ci_pipeline_id 64204866 64204866
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-1yhapm6c-project-304-concurrent-1-bbh01qej 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-1yhapm6c-project-304-concurrent-1-bbh01qej 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.278 s) : 15278000, 15278000
.   : milestone, 15278000,
appsec (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
iast (18.866 s) : 18866000, 18866000
.   : milestone, 18866000,
iast_GLOBAL (18.194 s) : 18194000, 18194000
.   : milestone, 18194000,
profiling (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
tracing (14.924 s) : 14924000, 14924000
.   : milestone, 14924000,
section candidate
no_agent (15.311 s) : 15311000, 15311000
.   : milestone, 15311000,
appsec (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,
iast (19.261 s) : 19261000, 19261000
.   : milestone, 19261000,
iast_GLOBAL (18.31 s) : 18310000, 18310000
.   : milestone, 18310000,
profiling (15.033 s) : 15033000, 15033000
.   : milestone, 15033000,
tracing (15.276 s) : 15276000, 15276000
.   : milestone, 15276000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.278 s [15.278 s, 15.278 s] -
appsec 14.934 s [14.934 s, 14.934 s] -344.0 ms (-2.3%)
iast 18.866 s [18.866 s, 18.866 s] 3.588 s (23.5%)
iast_GLOBAL 18.194 s [18.194 s, 18.194 s] 2.916 s (19.1%)
profiling 15.049 s [15.049 s, 15.049 s] -229.0 ms (-1.5%)
tracing 14.924 s [14.924 s, 14.924 s] -354.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.311 s [15.311 s, 15.311 s] -
appsec 15.065 s [15.065 s, 15.065 s] -246.0 ms (-1.6%)
iast 19.261 s [19.261 s, 19.261 s] 3.95 s (25.8%)
iast_GLOBAL 18.31 s [18.31 s, 18.31 s] 2.999 s (19.6%)
profiling 15.033 s [15.033 s, 15.033 s] -278.0 ms (-1.8%)
tracing 15.276 s [15.276 s, 15.276 s] -35.0 ms (-0.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~b33d0d7a74, baseline=1.49.0-SNAPSHOT~0e18e0e887
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.404 ms) : 2355, 2453
.   : milestone, 2404,
iast (2.181 ms) : 2120, 2243
.   : milestone, 2181,
iast_GLOBAL (2.223 ms) : 2161, 2285
.   : milestone, 2223,
profiling (2.026 ms) : 1977, 2075
.   : milestone, 2026,
tracing (2.003 ms) : 1955, 2051
.   : milestone, 2003,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.402 ms) : 2353, 2451
.   : milestone, 2402,
iast (2.177 ms) : 2115, 2239
.   : milestone, 2177,
iast_GLOBAL (2.228 ms) : 2165, 2290
.   : milestone, 2228,
profiling (2.043 ms) : 1992, 2095
.   : milestone, 2043,
tracing (2.016 ms) : 1968, 2065
.   : milestone, 2016,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.404 ms [2.355 ms, 2.453 ms] 931.691 µs (63.3%)
iast 2.181 ms [2.12 ms, 2.243 ms] 709.332 µs (48.2%)
iast_GLOBAL 2.223 ms [2.161 ms, 2.285 ms] 750.999 µs (51.0%)
profiling 2.026 ms [1.977 ms, 2.075 ms] 553.927 µs (37.6%)
tracing 2.003 ms [1.955 ms, 2.051 ms] 530.74 µs (36.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 2.402 ms [2.353 ms, 2.451 ms] 928.911 µs (63.1%)
iast 2.177 ms [2.115 ms, 2.239 ms] 703.875 µs (47.8%)
iast_GLOBAL 2.228 ms [2.165 ms, 2.29 ms] 754.469 µs (51.2%)
profiling 2.043 ms [1.992 ms, 2.095 ms] 570.235 µs (38.7%)
tracing 2.016 ms [1.968 ms, 2.065 ms] 543.276 µs (36.9%)

@jandro996 jandro996 merged commit 19cd36d into master May 6, 2025
454 checks passed
@jandro996 jandro996 deleted the alejandro.gonzalez/update-system-tests-commit branch May 6, 2025 09:19
@github-actions github-actions bot added this to the 1.49.0 milestone May 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@amarziali amarziali amarziali approved these changes

@mcculls mcculls Awaiting requested review from mcculls mcculls was automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.49.0

Development

Successfully merging this pull request may close these issues.

4 participants

@jandro996 @PerfectSlayer @amarziali