Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update system-tests to 0f27f203c90bba8bce7b58e2b75ff9d7035169eb #7225

Merged
merged 1 commit into from
Jun 20, 2024
Merged

Update system-tests to 0f27f203c90bba8bce7b58e2b75ff9d7035169eb #7225

merged 1 commit into from
Jun 20, 2024
+1 −1

Conversation

smola
Copy link
Member

@smola smola commented Jun 20, 2024

What Does This Do

Motivation

Additional Notes

Jira ticket: [PROJ-IDENT]

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jun 20, 2024
@smola smola requested a review from a team as a code owner June 20, 2024 12:28
@pr-commenter
Copy link

pr-commenter bot commented Jun 20, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20240620
git_commit_date 1718873384 1718886483
git_commit_sha 01fd984 08a7cf8
release_version 1.36.0-SNAPSHOT~01fd984c16 1.36.0-SNAPSHOT~08a7cf8aa7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718889953 1718889953
ci_job_id 548865491 548865491
ci_pipeline_id 37165070 37165070
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065433
Total [baseline] (8.535 s) : 0, 8535467
Agent [candidate] (1.062 s) : 0, 1061862
Total [candidate] (8.551 s) : 0, 8551320
section iast
Agent [baseline] (1.169 s) : 0, 1168685
Total [baseline] (8.994 s) : 0, 8994229
Agent [candidate] (1.169 s) : 0, 1168648
Total [candidate] (8.992 s) : 0, 8991734
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.166 s) : 0, 1166349
Total [baseline] (8.978 s) : 0, 8978243
Agent [candidate] (1.169 s) : 0, 1168506
Total [candidate] (8.984 s) : 0, 8984035
section iast_TELEMETRY_OFF
Agent [baseline] (1.164 s) : 0, 1163773
Total [baseline] (8.998 s) : 0, 8997657
Agent [candidate] (1.172 s) : 0, 1171542
Total [candidate] (9.047 s) : 0, 9046692
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.169 s 103.251 ms (9.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.166 s 100.916 ms (9.5%)
Agent iast_TELEMETRY_OFF 1.164 s 98.34 ms (9.2%)
Total tracing 8.535 s -
Total iast 8.994 s 458.762 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 8.978 s 442.777 ms (5.2%)
Total iast_TELEMETRY_OFF 8.998 s 462.191 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.169 s 106.786 ms (10.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.169 s 106.644 ms (10.0%)
Agent iast_TELEMETRY_OFF 1.172 s 109.68 ms (10.3%)
Total tracing 8.551 s -
Total iast 8.992 s 440.414 ms (5.2%)
Total iast_HARDCODED_SECRET_DISABLED 8.984 s 432.715 ms (5.1%)
Total iast_TELEMETRY_OFF 9.047 s 495.372 ms (5.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.497 ms) : 0, 668497
BytebuddyAgent [candidate] (665.714 ms) : 0, 665714
GlobalTracer [baseline] (303.955 ms) : 0, 303955
GlobalTracer [candidate] (303.454 ms) : 0, 303454
AppSec [baseline] (50.186 ms) : 0, 50186
AppSec [candidate] (50.109 ms) : 0, 50109
Remote Config [baseline] (693.378 µs) : 0, 693
Remote Config [candidate] (684.096 µs) : 0, 684
Telemetry [baseline] (7.672 ms) : 0, 7672
Telemetry [candidate] (7.566 ms) : 0, 7566
section iast
BytebuddyAgent [baseline] (779.758 ms) : 0, 779758
BytebuddyAgent [candidate] (779.131 ms) : 0, 779131
GlobalTracer [baseline] (292.994 ms) : 0, 292994
GlobalTracer [candidate] (292.746 ms) : 0, 292746
AppSec [baseline] (47.114 ms) : 0, 47114
AppSec [candidate] (47.055 ms) : 0, 47055
IAST [baseline] (27.959 ms) : 0, 27959
IAST [candidate] (28.988 ms) : 0, 28988
Remote Config [baseline] (627.774 µs) : 0, 628
Remote Config [candidate] (587.957 µs) : 0, 588
Telemetry [baseline] (6.963 ms) : 0, 6963
Telemetry [candidate] (6.859 ms) : 0, 6859
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (778.436 ms) : 0, 778436
BytebuddyAgent [candidate] (778.345 ms) : 0, 778345
GlobalTracer [baseline] (292.925 ms) : 0, 292925
GlobalTracer [candidate] (293.53 ms) : 0, 293530
AppSec [baseline] (47.273 ms) : 0, 47273
AppSec [candidate] (47.095 ms) : 0, 47095
IAST [baseline] (25.993 ms) : 0, 25993
IAST [candidate] (28.544 ms) : 0, 28544
Remote Config [baseline] (630.773 µs) : 0, 631
Remote Config [candidate] (694.426 µs) : 0, 694
Telemetry [baseline] (7.796 ms) : 0, 7796
Telemetry [candidate] (6.946 ms) : 0, 6946
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (774.736 ms) : 0, 774736
BytebuddyAgent [candidate] (780.44 ms) : 0, 780440
GlobalTracer [baseline] (292.291 ms) : 0, 292291
GlobalTracer [candidate] (295.142 ms) : 0, 295142
AppSec [baseline] (47.263 ms) : 0, 47263
AppSec [candidate] (47.485 ms) : 0, 47485
IAST [baseline] (28.721 ms) : 0, 28721
IAST [candidate] (26.864 ms) : 0, 26864
Remote Config [baseline] (603.938 µs) : 0, 604
Remote Config [candidate] (593.097 µs) : 0, 593
Telemetry [baseline] (6.865 ms) : 0, 6865
Telemetry [candidate] (7.608 ms) : 0, 7608
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060641
Total [baseline] (10.424 s) : 0, 10424432
Agent [candidate] (1.063 s) : 0, 1062956
Total [candidate] (10.363 s) : 0, 10363163
section appsec
Agent [baseline] (1.181 s) : 0, 1180719
Total [baseline] (10.431 s) : 0, 10431294
Agent [candidate] (1.189 s) : 0, 1189209
Total [candidate] (10.498 s) : 0, 10497733
section iast
Agent [baseline] (1.172 s) : 0, 1172292
Total [baseline] (10.706 s) : 0, 10706429
Agent [candidate] (1.174 s) : 0, 1173893
Total [candidate] (10.729 s) : 0, 10728572
section profiling
Agent [baseline] (1.258 s) : 0, 1257925
Total [baseline] (10.575 s) : 0, 10575191
Agent [candidate] (1.269 s) : 0, 1269215
Total [candidate] (10.661 s) : 0, 10661404
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.181 s 120.078 ms (11.3%)
Agent iast 1.172 s 111.65 ms (10.5%)
Agent profiling 1.258 s 197.284 ms (18.6%)
Total tracing 10.424 s -
Total appsec 10.431 s 6.862 ms (0.1%)
Total iast 10.706 s 281.997 ms (2.7%)
Total profiling 10.575 s 150.759 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.189 s 126.253 ms (11.9%)
Agent iast 1.174 s 110.937 ms (10.4%)
Agent profiling 1.269 s 206.259 ms (19.4%)
Total tracing 10.363 s -
Total appsec 10.498 s 134.57 ms (1.3%)
Total iast 10.729 s 365.409 ms (3.5%)
Total profiling 10.661 s 298.241 ms (2.9%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.495 ms) : 0, 664495
BytebuddyAgent [candidate] (665.807 ms) : 0, 665807
GlobalTracer [baseline] (303.447 ms) : 0, 303447
GlobalTracer [candidate] (304.098 ms) : 0, 304098
AppSec [baseline] (50.027 ms) : 0, 50027
AppSec [candidate] (50.3 ms) : 0, 50300
Remote Config [baseline] (680.696 µs) : 0, 681
Remote Config [candidate] (683.497 µs) : 0, 683
Telemetry [baseline] (7.528 ms) : 0, 7528
Telemetry [candidate] (7.593 ms) : 0, 7593
section appsec
BytebuddyAgent [baseline] (674.738 ms) : 0, 674738
BytebuddyAgent [candidate] (680.335 ms) : 0, 680335
GlobalTracer [baseline] (296.693 ms) : 0, 296693
GlobalTracer [candidate] (299.091 ms) : 0, 299091
AppSec [baseline] (153.747 ms) : 0, 153747
AppSec [candidate] (154.336 ms) : 0, 154336
IAST [baseline] (21.588 ms) : 0, 21588
IAST [candidate] (21.828 ms) : 0, 21828
Remote Config [baseline] (631.31 µs) : 0, 631
Remote Config [candidate] (648.722 µs) : 0, 649
Telemetry [baseline] (9.669 ms) : 0, 9669
Telemetry [candidate] (9.231 ms) : 0, 9231
section iast
BytebuddyAgent [baseline] (780.65 ms) : 0, 780650
BytebuddyAgent [candidate] (784.139 ms) : 0, 784139
GlobalTracer [baseline] (294.137 ms) : 0, 294137
GlobalTracer [candidate] (294.097 ms) : 0, 294097
AppSec [baseline] (47.268 ms) : 0, 47268
AppSec [candidate] (47.134 ms) : 0, 47134
IAST [baseline] (29.274 ms) : 0, 29274
IAST [candidate] (26.784 ms) : 0, 26784
Remote Config [baseline] (717.537 µs) : 0, 718
Remote Config [candidate] (633.32 µs) : 0, 633
Telemetry [baseline] (6.97 ms) : 0, 6970
Telemetry [candidate] (7.719 ms) : 0, 7719
section profiling
BytebuddyAgent [baseline] (661.288 ms) : 0, 661288
BytebuddyAgent [candidate] (667.079 ms) : 0, 667079
GlobalTracer [baseline] (384.776 ms) : 0, 384776
GlobalTracer [candidate] (387.685 ms) : 0, 387685
AppSec [baseline] (51.447 ms) : 0, 51447
AppSec [candidate] (51.829 ms) : 0, 51829
Remote Config [baseline] (737.253 µs) : 0, 737
Remote Config [candidate] (724.238 µs) : 0, 724
Telemetry [baseline] (7.391 ms) : 0, 7391
Telemetry [candidate] (7.416 ms) : 0, 7416
ProfilingAgent [baseline] (95.441 ms) : 0, 95441
ProfilingAgent [candidate] (96.985 ms) : 0, 96985
Profiling [baseline] (95.465 ms) : 0, 95465
Profiling [candidate] (97.012 ms) : 0, 97012
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-20T12:55:48 2024-06-20T13:02:39
git_branch master smola/system-tests-20240620
git_commit_date 1718873384 1718886483
git_commit_sha 01fd984 08a7cf8
release_version 1.36.0-SNAPSHOT~01fd984c16 1.36.0-SNAPSHOT~08a7cf8aa7
start_time 2024-06-20T12:55:34 2024-06-20T13:02:25
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718888905 1718888905
ci_job_id 548865492 548865492
ci_pipeline_id 37165070 37165070
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1333, 1371
.   : milestone, 1352,
appsec (1.702 ms) : 1677, 1727
.   : milestone, 1702,
appsec_no_iast (1.719 ms) : 1694, 1744
.   : milestone, 1719,
iast (1.496 ms) : 1473, 1518
.   : milestone, 1496,
profiling (1.498 ms) : 1473, 1522
.   : milestone, 1498,
tracing (1.484 ms) : 1460, 1508
.   : milestone, 1484,
section candidate
no_agent (1.35 ms) : 1331, 1369
.   : milestone, 1350,
appsec (1.746 ms) : 1722, 1770
.   : milestone, 1746,
appsec_no_iast (1.737 ms) : 1712, 1762
.   : milestone, 1737,
iast (1.481 ms) : 1459, 1503
.   : milestone, 1481,
profiling (1.493 ms) : 1469, 1517
.   : milestone, 1493,
tracing (1.472 ms) : 1447, 1497
.   : milestone, 1472,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.333 ms, 1.371 ms] -
appsec 1.702 ms [1.677 ms, 1.727 ms] 350.244 µs (25.9%)
appsec_no_iast 1.719 ms [1.694 ms, 1.744 ms] 366.877 µs (27.1%)
iast 1.496 ms [1.473 ms, 1.518 ms] 144.015 µs (10.7%)
profiling 1.498 ms [1.473 ms, 1.522 ms] 145.933 µs (10.8%)
tracing 1.484 ms [1.46 ms, 1.508 ms] 131.845 µs (9.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.331 ms, 1.369 ms] -
appsec 1.746 ms [1.722 ms, 1.77 ms] 395.741 µs (29.3%)
appsec_no_iast 1.737 ms [1.712 ms, 1.762 ms] 386.7 µs (28.6%)
iast 1.481 ms [1.459 ms, 1.503 ms] 131.241 µs (9.7%)
profiling 1.493 ms [1.469 ms, 1.517 ms] 142.481 µs (10.6%)
tracing 1.472 ms [1.447 ms, 1.497 ms] 121.952 µs (9.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (373.29 µs) : 354, 393
.   : milestone, 373,
iast (486.377 µs) : 465, 508
.   : milestone, 486,
iast_FULL (559.797 µs) : 539, 581
.   : milestone, 560,
iast_GLOBAL (516.012 µs) : 494, 538
.   : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (479.617 µs) : 459, 500
.   : milestone, 480,
iast_INACTIVE (451.67 µs) : 431, 472
.   : milestone, 452,
iast_TELEMETRY_OFF (472.698 µs) : 451, 494
.   : milestone, 473,
tracing (446.779 µs) : 426, 468
.   : milestone, 447,
section candidate
no_agent (370.34 µs) : 350, 390
.   : milestone, 370,
iast (486.217 µs) : 464, 508
.   : milestone, 486,
iast_FULL (550.314 µs) : 529, 571
.   : milestone, 550,
iast_GLOBAL (514.225 µs) : 493, 536
.   : milestone, 514,
iast_HARDCODED_SECRET_DISABLED (489.45 µs) : 468, 511
.   : milestone, 489,
iast_INACTIVE (458.602 µs) : 437, 480
.   : milestone, 459,
iast_TELEMETRY_OFF (470.26 µs) : 449, 491
.   : milestone, 470,
tracing (443.994 µs) : 423, 465
.   : milestone, 444,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.29 µs [353.793 µs, 392.788 µs] -
iast 486.377 µs [464.978 µs, 507.776 µs] 113.087 µs (30.3%)
iast_FULL 559.797 µs [538.769 µs, 580.825 µs] 186.507 µs (50.0%)
iast_GLOBAL 516.012 µs [493.533 µs, 538.491 µs] 142.722 µs (38.2%)
iast_HARDCODED_SECRET_DISABLED 479.617 µs [458.848 µs, 500.387 µs] 106.327 µs (28.5%)
iast_INACTIVE 451.67 µs [430.909 µs, 472.432 µs] 78.38 µs (21.0%)
iast_TELEMETRY_OFF 472.698 µs [451.448 µs, 493.948 µs] 99.408 µs (26.6%)
tracing 446.779 µs [426.009 µs, 467.549 µs] 73.489 µs (19.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.34 µs [350.492 µs, 390.187 µs] -
iast 486.217 µs [464.429 µs, 508.004 µs] 115.877 µs (31.3%)
iast_FULL 550.314 µs [529.142 µs, 571.486 µs] 179.974 µs (48.6%)
iast_GLOBAL 514.225 µs [492.854 µs, 535.595 µs] 143.885 µs (38.9%)
iast_HARDCODED_SECRET_DISABLED 489.45 µs [468.017 µs, 510.882 µs] 119.11 µs (32.2%)
iast_INACTIVE 458.602 µs [437.37 µs, 479.833 µs] 88.262 µs (23.8%)
iast_TELEMETRY_OFF 470.26 µs [449.419 µs, 491.102 µs] 99.921 µs (27.0%)
tracing 443.994 µs [423.342 µs, 464.645 µs] 73.654 µs (19.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20240620
git_commit_date 1718873384 1718886483
git_commit_sha 01fd984 08a7cf8
release_version 1.36.0-SNAPSHOT~01fd984c16 1.36.0-SNAPSHOT~08a7cf8aa7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718889405 1718889405
ci_job_id 548865493 548865493
ci_pipeline_id 37165070 37165070
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
appsec (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
iast (18.56 s) : 18560000, 18560000
.   : milestone, 18560000,
iast_GLOBAL (17.984 s) : 17984000, 17984000
.   : milestone, 17984000,
profiling (15.331 s) : 15331000, 15331000
.   : milestone, 15331000,
tracing (15.146 s) : 15146000, 15146000
.   : milestone, 15146000,
section candidate
no_agent (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
appsec (15.126 s) : 15126000, 15126000
.   : milestone, 15126000,
iast (18.755 s) : 18755000, 18755000
.   : milestone, 18755000,
iast_GLOBAL (17.766 s) : 17766000, 17766000
.   : milestone, 17766000,
profiling (15.787 s) : 15787000, 15787000
.   : milestone, 15787000,
tracing (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.089 s [15.089 s, 15.089 s] -
appsec 14.926 s [14.926 s, 14.926 s] -163.0 ms (-1.1%)
iast 18.56 s [18.56 s, 18.56 s] 3.471 s (23.0%)
iast_GLOBAL 17.984 s [17.984 s, 17.984 s] 2.895 s (19.2%)
profiling 15.331 s [15.331 s, 15.331 s] 242.0 ms (1.6%)
tracing 15.146 s [15.146 s, 15.146 s] 57.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.029 s [15.029 s, 15.029 s] -
appsec 15.126 s [15.126 s, 15.126 s] 97.0 ms (0.6%)
iast 18.755 s [18.755 s, 18.755 s] 3.726 s (24.8%)
iast_GLOBAL 17.766 s [17.766 s, 17.766 s] 2.737 s (18.2%)
profiling 15.787 s [15.787 s, 15.787 s] 758.0 ms (5.0%)
tracing 14.94 s [14.94 s, 14.94 s] -89.0 ms (-0.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~08a7cf8aa7, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.456 ms) : 1445, 1467
.   : milestone, 1456,
appsec (2.217 ms) : 2182, 2252
.   : milestone, 2217,
iast (1.967 ms) : 1926, 2008
.   : milestone, 1967,
iast_GLOBAL (1.996 ms) : 1955, 2037
.   : milestone, 1996,
profiling (1.854 ms) : 1821, 1888
.   : milestone, 1854,
tracing (1.83 ms) : 1798, 1862
.   : milestone, 1830,
section candidate
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.202 ms) : 2168, 2235
.   : milestone, 2202,
iast (1.966 ms) : 1925, 2008
.   : milestone, 1966,
iast_GLOBAL (2.003 ms) : 1962, 2045
.   : milestone, 2003,
profiling (2.328 ms) : 2145, 2510
.   : milestone, 2328,
tracing (1.832 ms) : 1801, 1864
.   : milestone, 1832,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.456 ms [1.445 ms, 1.467 ms] -
appsec 2.217 ms [2.182 ms, 2.252 ms] 761.157 µs (52.3%)
iast 1.967 ms [1.926 ms, 2.008 ms] 511.114 µs (35.1%)
iast_GLOBAL 1.996 ms [1.955 ms, 2.037 ms] 539.692 µs (37.1%)
profiling 1.854 ms [1.821 ms, 1.888 ms] 398.3 µs (27.4%)
tracing 1.83 ms [1.798 ms, 1.862 ms] 373.838 µs (25.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.202 ms [2.168 ms, 2.235 ms] 740.018 µs (50.6%)
iast 1.966 ms [1.925 ms, 2.008 ms] 504.454 µs (34.5%)
iast_GLOBAL 2.003 ms [1.962 ms, 2.045 ms] 541.745 µs (37.1%)
profiling 2.328 ms [2.145 ms, 2.51 ms] 866.071 µs (59.3%)
tracing 1.832 ms [1.801 ms, 1.864 ms] 370.812 µs (25.4%)

@smola smola merged commit 496f0ca into master Jun 20, 2024
84 checks passed
@smola smola deleted the smola/system-tests-20240620 branch June 20, 2024 14:46
@github-actions github-actions bot added this to the 1.36.0 milestone Jun 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@am312 am312 Awaiting requested review from am312 am312 is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.36.0
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@smola @PerfectSlayer