Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add logs to tainted map 'garbage-collected entries are purged' flaky test #7240

Merged
merged 2 commits into from
Jun 27, 2024
Merged

Add logs to tainted map 'garbage-collected entries are purged' flaky test #7240

merged 2 commits into from
Jun 27, 2024

Conversation

manuel-alvarez-alvarez
Copy link
Contributor

What Does This Do

Add logs to the tainted map garbage-collected entries are purged test in order to understand why it might flake under JDK 21.

Motivation

The test has been observed to fail with no reason in some builds: example

Additional Notes

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez added tag: flaky test Flaky tests comp: asm iast Application Security Management (IAST) labels Jun 25, 2024
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested a review from a team as a code owner June 25, 2024 15:59
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/iast-tainted-map-test-flaky branch from 59a9244 to ad96bf3 Compare June 25, 2024 16:00
@pr-commenter
Copy link

pr-commenter bot commented Jun 25, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/iast-tainted-map-test-flaky
git_commit_date 1719381320 1719388955
git_commit_sha 04cda74 8ccc7f3
release_version 1.36.0-SNAPSHOT~04cda746be 1.36.0-SNAPSHOT~8ccc7f3ed7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719392064 1719392064
ci_job_id 553308853 553308853
ci_pipeline_id 37563466 37563466
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1075126
Total [baseline] (10.414 s) : 0, 10414300
Agent [candidate] (1.061 s) : 0, 1060655
Total [candidate] (10.291 s) : 0, 10290849
section appsec
Agent [baseline] (1.189 s) : 0, 1188755
Total [baseline] (10.488 s) : 0, 10488273
Agent [candidate] (1.188 s) : 0, 1188262
Total [candidate] (10.462 s) : 0, 10462074
section iast
Agent [baseline] (1.17 s) : 0, 1169520
Total [baseline] (10.723 s) : 0, 10722922
Agent [candidate] (1.172 s) : 0, 1171537
Total [candidate] (10.659 s) : 0, 10658787
section profiling
Agent [baseline] (1.271 s) : 0, 1270984
Total [baseline] (10.642 s) : 0, 10642153
Agent [candidate] (1.265 s) : 0, 1264659
Total [candidate] (10.608 s) : 0, 10607546
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent appsec 1.189 s 113.629 ms (10.6%)
Agent iast 1.17 s 94.394 ms (8.8%)
Agent profiling 1.271 s 195.858 ms (18.2%)
Total tracing 10.414 s -
Total appsec 10.488 s 73.973 ms (0.7%)
Total iast 10.723 s 308.622 ms (3.0%)
Total profiling 10.642 s 227.853 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.188 s 127.607 ms (12.0%)
Agent iast 1.172 s 110.882 ms (10.5%)
Agent profiling 1.265 s 204.004 ms (19.2%)
Total tracing 10.291 s -
Total appsec 10.462 s 171.225 ms (1.7%)
Total iast 10.659 s 367.938 ms (3.6%)
Total profiling 10.608 s 316.697 ms (3.1%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (674.043 ms) : 0, 674043
BytebuddyAgent [candidate] (665.02 ms) : 0, 665020
GlobalTracer [baseline] (307.117 ms) : 0, 307117
GlobalTracer [candidate] (303.006 ms) : 0, 303006
AppSec [baseline] (50.653 ms) : 0, 50653
AppSec [candidate] (50.157 ms) : 0, 50157
Remote Config [baseline] (708.003 µs) : 0, 708
Remote Config [candidate] (678.915 µs) : 0, 679
Telemetry [baseline] (7.69 ms) : 0, 7690
Telemetry [candidate] (7.508 ms) : 0, 7508
section appsec
BytebuddyAgent [baseline] (680.634 ms) : 0, 680634
BytebuddyAgent [candidate] (680.333 ms) : 0, 680333
GlobalTracer [baseline] (299.157 ms) : 0, 299157
GlobalTracer [candidate] (299.014 ms) : 0, 299014
AppSec [baseline] (154.869 ms) : 0, 154869
AppSec [candidate] (154.477 ms) : 0, 154477
Remote Config [baseline] (648.638 µs) : 0, 649
Remote Config [candidate] (643.754 µs) : 0, 644
Telemetry [baseline] (8.484 ms) : 0, 8484
Telemetry [candidate] (8.151 ms) : 0, 8151
IAST [baseline] (20.478 ms) : 0, 20478
IAST [candidate] (21.912 ms) : 0, 21912
section iast
BytebuddyAgent [baseline] (778.879 ms) : 0, 778879
BytebuddyAgent [candidate] (781.679 ms) : 0, 781679
GlobalTracer [baseline] (293.629 ms) : 0, 293629
GlobalTracer [candidate] (294.071 ms) : 0, 294071
AppSec [baseline] (47.043 ms) : 0, 47043
AppSec [candidate] (47.303 ms) : 0, 47303
Remote Config [baseline] (624.254 µs) : 0, 624
Remote Config [candidate] (605.898 µs) : 0, 606
Telemetry [baseline] (6.88 ms) : 0, 6880
Telemetry [candidate] (6.969 ms) : 0, 6969
IAST [baseline] (29.201 ms) : 0, 29201
IAST [candidate] (27.561 ms) : 0, 27561
section profiling
ProfilingAgent [baseline] (96.808 ms) : 0, 96808
ProfilingAgent [candidate] (96.533 ms) : 0, 96533
BytebuddyAgent [baseline] (667.994 ms) : 0, 667994
BytebuddyAgent [candidate] (663.86 ms) : 0, 663860
GlobalTracer [baseline] (389.336 ms) : 0, 389336
GlobalTracer [candidate] (387.176 ms) : 0, 387176
AppSec [baseline] (51.26 ms) : 0, 51260
AppSec [candidate] (51.782 ms) : 0, 51782
Remote Config [baseline] (756.713 µs) : 0, 757
Remote Config [candidate] (742.203 µs) : 0, 742
Telemetry [baseline] (7.434 ms) : 0, 7434
Telemetry [candidate] (7.381 ms) : 0, 7381
Profiling [baseline] (96.833 ms) : 0, 96833
Profiling [candidate] (96.557 ms) : 0, 96557
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061280
Total [baseline] (8.532 s) : 0, 8532340
Agent [candidate] (1.06 s) : 0, 1060400
Total [candidate] (8.552 s) : 0, 8552409
section iast
Agent [baseline] (1.194 s) : 0, 1193917
Total [baseline] (9.059 s) : 0, 9058548
Agent [candidate] (1.171 s) : 0, 1170635
Total [candidate] (9.005 s) : 0, 9005439
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.169 s) : 0, 1169139
Total [baseline] (8.995 s) : 0, 8994903
Agent [candidate] (1.17 s) : 0, 1169601
Total [candidate] (8.971 s) : 0, 8971215
section iast_TELEMETRY_OFF
Agent [baseline] (1.167 s) : 0, 1166875
Total [baseline] (8.981 s) : 0, 8981409
Agent [candidate] (1.167 s) : 0, 1167282
Total [candidate] (9.035 s) : 0, 9034735
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.194 s 132.637 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.169 s 107.859 ms (10.2%)
Agent iast_TELEMETRY_OFF 1.167 s 105.595 ms (9.9%)
Total tracing 8.532 s -
Total iast 9.059 s 526.208 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 8.995 s 462.563 ms (5.4%)
Total iast_TELEMETRY_OFF 8.981 s 449.07 ms (5.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.171 s 110.235 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.17 s 109.201 ms (10.3%)
Agent iast_TELEMETRY_OFF 1.167 s 106.882 ms (10.1%)
Total tracing 8.552 s -
Total iast 9.005 s 453.03 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.971 s 418.806 ms (4.9%)
Total iast_TELEMETRY_OFF 9.035 s 482.326 ms (5.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.86 ms) : 0, 664860
BytebuddyAgent [candidate] (664.609 ms) : 0, 664609
GlobalTracer [baseline] (303.619 ms) : 0, 303619
GlobalTracer [candidate] (303.223 ms) : 0, 303223
AppSec [baseline] (50.186 ms) : 0, 50186
AppSec [candidate] (50.02 ms) : 0, 50020
Remote Config [baseline] (684.708 µs) : 0, 685
Remote Config [candidate] (689.899 µs) : 0, 690
Telemetry [baseline] (7.564 ms) : 0, 7564
Telemetry [candidate] (7.542 ms) : 0, 7542
section iast
BytebuddyAgent [baseline] (796.571 ms) : 0, 796571
BytebuddyAgent [candidate] (780.051 ms) : 0, 780051
GlobalTracer [baseline] (298.777 ms) : 0, 298777
GlobalTracer [candidate] (294.071 ms) : 0, 294071
AppSec [baseline] (48.005 ms) : 0, 48005
AppSec [candidate] (47.048 ms) : 0, 47048
IAST [baseline] (28.594 ms) : 0, 28594
IAST [candidate] (28.766 ms) : 0, 28766
Remote Config [baseline] (629.793 µs) : 0, 630
Remote Config [candidate] (609.705 µs) : 0, 610
Telemetry [baseline] (7.81 ms) : 0, 7810
Telemetry [candidate] (6.807 ms) : 0, 6807
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.101 ms) : 0, 780101
BytebuddyAgent [candidate] (779.848 ms) : 0, 779848
GlobalTracer [baseline] (293.854 ms) : 0, 293854
GlobalTracer [candidate] (293.333 ms) : 0, 293333
AppSec [baseline] (47.341 ms) : 0, 47341
AppSec [candidate] (47.186 ms) : 0, 47186
IAST [baseline] (26.908 ms) : 0, 26908
IAST [candidate] (27.528 ms) : 0, 27528
Remote Config [baseline] (634.188 µs) : 0, 634
Remote Config [candidate] (651.738 µs) : 0, 652
Telemetry [baseline] (6.979 ms) : 0, 6979
Telemetry [candidate] (7.708 ms) : 0, 7708
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.28 ms) : 0, 777280
BytebuddyAgent [candidate] (777.925 ms) : 0, 777925
GlobalTracer [baseline] (293.779 ms) : 0, 293779
GlobalTracer [candidate] (293.529 ms) : 0, 293529
AppSec [baseline] (47.059 ms) : 0, 47059
AppSec [candidate] (47.177 ms) : 0, 47177
IAST [baseline] (27.167 ms) : 0, 27167
IAST [candidate] (26.38 ms) : 0, 26380
Remote Config [baseline] (607.836 µs) : 0, 608
Remote Config [candidate] (596.241 µs) : 0, 596
Telemetry [baseline] (7.676 ms) : 0, 7676
Telemetry [candidate] (8.306 ms) : 0, 8306
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-26T08:27:19 2024-06-26T08:34:11
git_branch master malvarez/iast-tainted-map-test-flaky
git_commit_date 1719381320 1719388955
git_commit_sha 04cda74 8ccc7f3
release_version 1.36.0-SNAPSHOT~04cda746be 1.36.0-SNAPSHOT~8ccc7f3ed7
start_time 2024-06-26T08:27:05 2024-06-26T08:33:57
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719391197 1719391197
ci_job_id 553308854 553308854
ci_pipeline_id 37563466 37563466
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be
    dateFormat X
    axisFormat %s
section baseline
no_agent (370.191 µs) : 350, 390
.   : milestone, 370,
iast (489.266 µs) : 468, 511
.   : milestone, 489,
iast_FULL (558.968 µs) : 538, 580
.   : milestone, 559,
iast_GLOBAL (519.445 µs) : 497, 542
.   : milestone, 519,
iast_HARDCODED_SECRET_DISABLED (485.657 µs) : 464, 507
.   : milestone, 486,
iast_INACTIVE (455.329 µs) : 434, 476
.   : milestone, 455,
iast_TELEMETRY_OFF (475.497 µs) : 454, 497
.   : milestone, 475,
tracing (443.966 µs) : 424, 464
.   : milestone, 444,
section candidate
no_agent (374.165 µs) : 355, 394
.   : milestone, 374,
iast (492.854 µs) : 471, 515
.   : milestone, 493,
iast_FULL (556.159 µs) : 535, 577
.   : milestone, 556,
iast_GLOBAL (511.739 µs) : 491, 533
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (489.11 µs) : 468, 511
.   : milestone, 489,
iast_INACTIVE (455.444 µs) : 435, 476
.   : milestone, 455,
iast_TELEMETRY_OFF (477.253 µs) : 456, 499
.   : milestone, 477,
tracing (448.811 µs) : 428, 470
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.191 µs [350.245 µs, 390.137 µs] -
iast 489.266 µs [468.023 µs, 510.508 µs] 119.074 µs (32.2%)
iast_FULL 558.968 µs [537.914 µs, 580.022 µs] 188.776 µs (51.0%)
iast_GLOBAL 519.445 µs [497.032 µs, 541.859 µs] 149.254 µs (40.3%)
iast_HARDCODED_SECRET_DISABLED 485.657 µs [464.463 µs, 506.85 µs] 115.466 µs (31.2%)
iast_INACTIVE 455.329 µs [434.177 µs, 476.481 µs] 85.138 µs (23.0%)
iast_TELEMETRY_OFF 475.497 µs [454.037 µs, 496.956 µs] 105.306 µs (28.4%)
tracing 443.966 µs [423.547 µs, 464.384 µs] 73.774 µs (19.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.165 µs [354.508 µs, 393.821 µs] -
iast 492.854 µs [471.021 µs, 514.687 µs] 118.689 µs (31.7%)
iast_FULL 556.159 µs [535.153 µs, 577.164 µs] 181.994 µs (48.6%)
iast_GLOBAL 511.739 µs [490.687 µs, 532.791 µs] 137.574 µs (36.8%)
iast_HARDCODED_SECRET_DISABLED 489.11 µs [467.612 µs, 510.608 µs] 114.945 µs (30.7%)
iast_INACTIVE 455.444 µs [434.672 µs, 476.216 µs] 81.28 µs (21.7%)
iast_TELEMETRY_OFF 477.253 µs [455.775 µs, 498.731 µs] 103.088 µs (27.6%)
tracing 448.811 µs [427.937 µs, 469.686 µs] 74.647 µs (20.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.346 ms) : 1326, 1367
.   : milestone, 1346,
appsec (1.729 ms) : 1705, 1754
.   : milestone, 1729,
appsec_no_iast (1.723 ms) : 1698, 1748
.   : milestone, 1723,
iast (1.51 ms) : 1488, 1533
.   : milestone, 1510,
profiling (1.553 ms) : 1528, 1579
.   : milestone, 1553,
tracing (1.465 ms) : 1441, 1490
.   : milestone, 1465,
section candidate
no_agent (1.363 ms) : 1342, 1383
.   : milestone, 1363,
appsec (1.729 ms) : 1706, 1753
.   : milestone, 1729,
appsec_no_iast (1.742 ms) : 1718, 1766
.   : milestone, 1742,
iast (1.51 ms) : 1487, 1533
.   : milestone, 1510,
profiling (1.499 ms) : 1474, 1524
.   : milestone, 1499,
tracing (1.458 ms) : 1433, 1483
.   : milestone, 1458,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.346 ms [1.326 ms, 1.367 ms] -
appsec 1.729 ms [1.705 ms, 1.754 ms] 383.099 µs (28.5%)
appsec_no_iast 1.723 ms [1.698 ms, 1.748 ms] 376.759 µs (28.0%)
iast 1.51 ms [1.488 ms, 1.533 ms] 164.288 µs (12.2%)
profiling 1.553 ms [1.528 ms, 1.579 ms] 207.275 µs (15.4%)
tracing 1.465 ms [1.441 ms, 1.49 ms] 119.094 µs (8.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.363 ms [1.342 ms, 1.383 ms] -
appsec 1.729 ms [1.706 ms, 1.753 ms] 366.564 µs (26.9%)
appsec_no_iast 1.742 ms [1.718 ms, 1.766 ms] 379.343 µs (27.8%)
iast 1.51 ms [1.487 ms, 1.533 ms] 147.479 µs (10.8%)
profiling 1.499 ms [1.474 ms, 1.524 ms] 136.203 µs (10.0%)
tracing 1.458 ms [1.433 ms, 1.483 ms] 95.173 µs (7.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/iast-tainted-map-test-flaky
git_commit_date 1719381320 1719388955
git_commit_sha 04cda74 8ccc7f3
release_version 1.36.0-SNAPSHOT~04cda746be 1.36.0-SNAPSHOT~8ccc7f3ed7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1719391704 1719391704
ci_job_id 553308855 553308855
ci_pipeline_id 37563466 37563466
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.459 ms) : 1447, 1470
.   : milestone, 1459,
appsec (2.2 ms) : 2166, 2233
.   : milestone, 2200,
iast (1.964 ms) : 1924, 2005
.   : milestone, 1964,
iast_GLOBAL (2.011 ms) : 1969, 2053
.   : milestone, 2011,
profiling (1.842 ms) : 1808, 1877
.   : milestone, 1842,
tracing (1.827 ms) : 1795, 1859
.   : milestone, 1827,
section candidate
no_agent (1.459 ms) : 1448, 1471
.   : milestone, 1459,
appsec (2.213 ms) : 2178, 2247
.   : milestone, 2213,
iast (1.968 ms) : 1927, 2010
.   : milestone, 1968,
iast_GLOBAL (1.998 ms) : 1957, 2038
.   : milestone, 1998,
profiling (1.85 ms) : 1816, 1883
.   : milestone, 1850,
tracing (1.826 ms) : 1794, 1858
.   : milestone, 1826,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.459 ms [1.447 ms, 1.47 ms] -
appsec 2.2 ms [2.166 ms, 2.233 ms] 740.954 µs (50.8%)
iast 1.964 ms [1.924 ms, 2.005 ms] 505.696 µs (34.7%)
iast_GLOBAL 2.011 ms [1.969 ms, 2.053 ms] 552.104 µs (37.8%)
profiling 1.842 ms [1.808 ms, 1.877 ms] 383.632 µs (26.3%)
tracing 1.827 ms [1.795 ms, 1.859 ms] 367.953 µs (25.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.459 ms [1.448 ms, 1.471 ms] -
appsec 2.213 ms [2.178 ms, 2.247 ms] 753.518 µs (51.6%)
iast 1.968 ms [1.927 ms, 2.01 ms] 509.04 µs (34.9%)
iast_GLOBAL 1.998 ms [1.957 ms, 2.038 ms] 538.538 µs (36.9%)
profiling 1.85 ms [1.816 ms, 1.883 ms] 390.409 µs (26.8%)
tracing 1.826 ms [1.794 ms, 1.858 ms] 366.925 µs (25.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~8ccc7f3ed7, baseline=1.36.0-SNAPSHOT~04cda746be
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.55 s) : 15550000, 15550000
.   : milestone, 15550000,
appsec (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
iast (18.98 s) : 18980000, 18980000
.   : milestone, 18980000,
iast_GLOBAL (17.894 s) : 17894000, 17894000
.   : milestone, 17894000,
profiling (15.594 s) : 15594000, 15594000
.   : milestone, 15594000,
tracing (14.807 s) : 14807000, 14807000
.   : milestone, 14807000,
section candidate
no_agent (15.019 s) : 15019000, 15019000
.   : milestone, 15019000,
appsec (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
iast (18.99 s) : 18990000, 18990000
.   : milestone, 18990000,
iast_GLOBAL (17.813 s) : 17813000, 17813000
.   : milestone, 17813000,
profiling (14.795 s) : 14795000, 14795000
.   : milestone, 14795000,
tracing (15.048 s) : 15048000, 15048000
.   : milestone, 15048000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.55 s [15.55 s, 15.55 s] -
appsec 14.976 s [14.976 s, 14.976 s] -574.0 ms (-3.7%)
iast 18.98 s [18.98 s, 18.98 s] 3.43 s (22.1%)
iast_GLOBAL 17.894 s [17.894 s, 17.894 s] 2.344 s (15.1%)
profiling 15.594 s [15.594 s, 15.594 s] 44.0 ms (0.3%)
tracing 14.807 s [14.807 s, 14.807 s] -743.0 ms (-4.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.019 s [15.019 s, 15.019 s] -
appsec 14.96 s [14.96 s, 14.96 s] -59.0 ms (-0.4%)
iast 18.99 s [18.99 s, 18.99 s] 3.971 s (26.4%)
iast_GLOBAL 17.813 s [17.813 s, 17.813 s] 2.794 s (18.6%)
profiling 14.795 s [14.795 s, 14.795 s] -224.0 ms (-1.5%)
tracing 15.048 s [15.048 s, 15.048 s] 29.0 ms (0.2%)

@PerfectSlayer PerfectSlayer added the tag: no release notes Changes to exclude from release notes label Jun 26, 2024
@manuel-alvarez-alvarez manuel-alvarez-alvarez merged commit 9f9d372 into master Jun 27, 2024
82 checks passed
@manuel-alvarez-alvarez manuel-alvarez-alvarez deleted the malvarez/iast-tainted-map-test-flaky branch June 27, 2024 09:30
@github-actions github-actions bot added this to the 1.36.0 milestone Jun 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/asm-java

@jandro996 jandro996 Awaiting requested review from jandro996 jandro996 is a code owner automatically assigned from DataDog/asm-java

Assignees
No one assigned
Labels
comp: asm iast Application Security Management (IAST) tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.36.0
Development

Successfully merging this pull request may close these issues.
2 participants
@manuel-alvarez-alvarez @PerfectSlayer