Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create commmon backend-mock module to use in smoke tests #7080

Merged
merged 1 commit into from
May 29, 2024
Merged

Create commmon backend-mock module to use in smoke tests #7080

merged 1 commit into from
May 29, 2024

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented May 28, 2024 •
edited by jira bot
Loading

What Does This Do

Moves test fixtures that mock Datadog backend to a separate module.

Motivation

With the implementation of agentless log submission, there will be more smoke test modules that will benefit from using the mock backend.

Additional Notes

The CI Visibility subprojects contains some text fixtures that are used by Maven and Gradle instrumentations smoke tests.
These test fixtures contain logic that allows to start a mock Datadog backend.

Jira ticket: CIVIS-10104

@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes labels May 28, 2024
@pr-commenter
Copy link

pr-commenter bot commented May 28, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/mock-backend
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1716900254 1716900254
ci_job_id 524219142 524219142
ci_pipeline_id 35223418 35223418
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1716890250 1716890250
git_commit_sha ac3ca09 ac3ca09
module Agent Agent
parent None None
release_version 1.35.0-SNAPSHOT~ac3ca0988f 1.35.0-SNAPSHOT~ac3ca0988f
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058656
Total [baseline] (10.395 s) : 0, 10394609
Agent [candidate] (1.058 s) : 0, 1058119
Total [candidate] (10.32 s) : 0, 10320347
section appsec
Agent [baseline] (1.179 s) : 0, 1178753
Total [baseline] (10.546 s) : 0, 10545902
Agent [candidate] (1.175 s) : 0, 1174854
Total [candidate] (10.504 s) : 0, 10504339
section iast
Agent [baseline] (1.183 s) : 0, 1183485
Total [baseline] (10.792 s) : 0, 10791608
Agent [candidate] (1.184 s) : 0, 1184094
Total [candidate] (10.77 s) : 0, 10769848
section profiling
Agent [baseline] (1.261 s) : 0, 1260675
Total [baseline] (10.575 s) : 0, 10574632
Agent [candidate] (1.266 s) : 0, 1266397
Total [candidate] (10.692 s) : 0, 10691789
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.179 s 120.097 ms (11.3%)
Agent iast 1.183 s 124.829 ms (11.8%)
Agent profiling 1.261 s 202.019 ms (19.1%)
Total tracing 10.395 s -
Total appsec 10.546 s 151.293 ms (1.5%)
Total iast 10.792 s 396.999 ms (3.8%)
Total profiling 10.575 s 180.023 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.175 s 116.734 ms (11.0%)
Agent iast 1.184 s 125.975 ms (11.9%)
Agent profiling 1.266 s 208.278 ms (19.7%)
Total tracing 10.32 s -
Total appsec 10.504 s 183.991 ms (1.8%)
Total iast 10.77 s 449.501 ms (4.4%)
Total profiling 10.692 s 371.441 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (652.812 ms) : 0, 652812
BytebuddyAgent [candidate] (652.993 ms) : 0, 652993
GlobalTracer [baseline] (313.253 ms) : 0, 313253
GlobalTracer [candidate] (312.723 ms) : 0, 312723
AppSec [baseline] (49.796 ms) : 0, 49796
AppSec [candidate] (49.816 ms) : 0, 49816
Remote Config [baseline] (667.376 µs) : 0, 667
Remote Config [candidate] (664.627 µs) : 0, 665
Telemetry [baseline] (7.679 ms) : 0, 7679
Telemetry [candidate] (7.542 ms) : 0, 7542
section appsec
BytebuddyAgent [baseline] (676.689 ms) : 0, 676689
BytebuddyAgent [candidate] (674.883 ms) : 0, 674883
GlobalTracer [baseline] (296.39 ms) : 0, 296390
GlobalTracer [candidate] (295.664 ms) : 0, 295664
AppSec [baseline] (152.834 ms) : 0, 152834
AppSec [candidate] (152.753 ms) : 0, 152753
Remote Config [baseline] (630.943 µs) : 0, 631
Remote Config [candidate] (633.412 µs) : 0, 633
Telemetry [baseline] (8.378 ms) : 0, 8378
Telemetry [candidate] (7.194 ms) : 0, 7194
IAST [baseline] (18.738 ms) : 0, 18738
IAST [candidate] (18.751 ms) : 0, 18751
section iast
BytebuddyAgent [baseline] (776.58 ms) : 0, 776580
BytebuddyAgent [candidate] (776.871 ms) : 0, 776871
GlobalTracer [baseline] (292.148 ms) : 0, 292148
GlobalTracer [candidate] (292.138 ms) : 0, 292138
AppSec [baseline] (49.581 ms) : 0, 49581
AppSec [candidate] (49.719 ms) : 0, 49719
Remote Config [baseline] (618.48 µs) : 0, 618
Remote Config [candidate] (595.112 µs) : 0, 595
Telemetry [baseline] (6.692 ms) : 0, 6692
Telemetry [candidate] (6.582 ms) : 0, 6582
IAST [baseline] (23.579 ms) : 0, 23579
IAST [candidate] (23.787 ms) : 0, 23787
section profiling
BytebuddyAgent [baseline] (661.066 ms) : 0, 661066
BytebuddyAgent [candidate] (666.385 ms) : 0, 666385
GlobalTracer [baseline] (387.418 ms) : 0, 387418
GlobalTracer [candidate] (387.116 ms) : 0, 387116
AppSec [baseline] (50.914 ms) : 0, 50914
AppSec [candidate] (50.935 ms) : 0, 50935
Remote Config [baseline] (902.682 µs) : 0, 903
Remote Config [candidate] (778.044 µs) : 0, 778
Telemetry [baseline] (7.564 ms) : 0, 7564
Telemetry [candidate] (7.532 ms) : 0, 7532
ProfilingAgent [baseline] (96.385 ms) : 0, 96385
ProfilingAgent [candidate] (96.885 ms) : 0, 96885
Profiling [baseline] (96.409 ms) : 0, 96409
Profiling [candidate] (96.91 ms) : 0, 96910
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053107
Total [baseline] (8.533 s) : 0, 8533348
Agent [candidate] (1.056 s) : 0, 1055874
Total [candidate] (8.557 s) : 0, 8557429
section iast
Agent [baseline] (1.188 s) : 0, 1188058
Total [baseline] (9.033 s) : 0, 9033184
Agent [candidate] (1.187 s) : 0, 1186725
Total [candidate] (9.011 s) : 0, 9010557
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.183 s) : 0, 1183254
Total [baseline] (9.01 s) : 0, 9010061
Agent [candidate] (1.184 s) : 0, 1184495
Total [candidate] (8.974 s) : 0, 8973836
section iast_TELEMETRY_OFF
Agent [baseline] (1.182 s) : 0, 1182037
Total [baseline] (9.006 s) : 0, 9005601
Agent [candidate] (1.19 s) : 0, 1190475
Total [candidate] (9.024 s) : 0, 9024231
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.188 s 134.951 ms (12.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.183 s 130.147 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.182 s 128.93 ms (12.2%)
Total tracing 8.533 s -
Total iast 9.033 s 499.836 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.01 s 476.713 ms (5.6%)
Total iast_TELEMETRY_OFF 9.006 s 472.253 ms (5.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.187 s 130.851 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.184 s 128.621 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.19 s 134.601 ms (12.7%)
Total tracing 8.557 s -
Total iast 9.011 s 453.129 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.974 s 416.407 ms (4.9%)
Total iast_TELEMETRY_OFF 9.024 s 466.803 ms (5.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (649.575 ms) : 0, 649575
BytebuddyAgent [candidate] (651.624 ms) : 0, 651624
GlobalTracer [baseline] (311.882 ms) : 0, 311882
GlobalTracer [candidate] (311.95 ms) : 0, 311950
AppSec [baseline] (49.369 ms) : 0, 49369
AppSec [candidate] (49.763 ms) : 0, 49763
Remote Config [baseline] (660.196 µs) : 0, 660
Remote Config [candidate] (660.719 µs) : 0, 661
Telemetry [baseline] (7.513 ms) : 0, 7513
Telemetry [candidate] (7.588 ms) : 0, 7588
section iast
BytebuddyAgent [baseline] (777.788 ms) : 0, 777788
BytebuddyAgent [candidate] (778.279 ms) : 0, 778279
GlobalTracer [baseline] (292.836 ms) : 0, 292836
GlobalTracer [candidate] (292.856 ms) : 0, 292856
AppSec [baseline] (47.753 ms) : 0, 47753
AppSec [candidate] (48.549 ms) : 0, 48549
Remote Config [baseline] (606.611 µs) : 0, 607
Remote Config [candidate] (598.846 µs) : 0, 599
Telemetry [baseline] (8.146 ms) : 0, 8146
Telemetry [candidate] (8.093 ms) : 0, 8093
IAST [baseline] (26.525 ms) : 0, 26525
IAST [candidate] (23.835 ms) : 0, 23835
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (774.957 ms) : 0, 774957
BytebuddyAgent [candidate] (775.684 ms) : 0, 775684
GlobalTracer [baseline] (291.904 ms) : 0, 291904
GlobalTracer [candidate] (292.323 ms) : 0, 292323
AppSec [baseline] (50.403 ms) : 0, 50403
AppSec [candidate] (47.706 ms) : 0, 47706
Remote Config [baseline] (598.62 µs) : 0, 599
Remote Config [candidate] (585.961 µs) : 0, 586
Telemetry [baseline] (8.082 ms) : 0, 8082
Telemetry [candidate] (8.697 ms) : 0, 8697
IAST [baseline] (22.996 ms) : 0, 22996
IAST [candidate] (25.248 ms) : 0, 25248
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (774.063 ms) : 0, 774063
BytebuddyAgent [candidate] (779.929 ms) : 0, 779929
GlobalTracer [baseline] (292.103 ms) : 0, 292103
GlobalTracer [candidate] (294.64 ms) : 0, 294640
AppSec [baseline] (52.67 ms) : 0, 52670
AppSec [candidate] (48.891 ms) : 0, 48891
Remote Config [baseline] (616.186 µs) : 0, 616
Remote Config [candidate] (643.843 µs) : 0, 644
Telemetry [baseline] (6.434 ms) : 0, 6434
Telemetry [candidate] (8.002 ms) : 0, 8002
IAST [baseline] (21.739 ms) : 0, 21739
IAST [candidate] (23.692 ms) : 0, 23692
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-05-28T12:16:57 2024-05-28T12:23:44
git_branch master nikita-tkachenko/mock-backend
start_time 2024-05-28T12:16:44 2024-05-28T12:23:31
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1716899369 1716899369
ci_job_id 524219143 524219143
ci_pipeline_id 35223418 35223418
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1716890250 1716890250
git_commit_sha ac3ca09 ac3ca09
release_version 1.35.0-SNAPSHOT~ac3ca0988f 1.35.0-SNAPSHOT~ac3ca0988f
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.346 ms) : 1326, 1365
.   : milestone, 1346,
appsec (1.696 ms) : 1672, 1721
.   : milestone, 1696,
appsec_no_iast (1.726 ms) : 1701, 1751
.   : milestone, 1726,
iast (1.475 ms) : 1452, 1497
.   : milestone, 1475,
profiling (1.504 ms) : 1478, 1529
.   : milestone, 1504,
tracing (1.475 ms) : 1451, 1499
.   : milestone, 1475,
section candidate
no_agent (1.332 ms) : 1312, 1352
.   : milestone, 1332,
appsec (1.722 ms) : 1698, 1746
.   : milestone, 1722,
appsec_no_iast (1.719 ms) : 1695, 1743
.   : milestone, 1719,
iast (1.483 ms) : 1460, 1506
.   : milestone, 1483,
profiling (1.527 ms) : 1501, 1552
.   : milestone, 1527,
tracing (1.449 ms) : 1426, 1472
.   : milestone, 1449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.346 ms [1.326 ms, 1.365 ms] -
appsec 1.696 ms [1.672 ms, 1.721 ms] 350.38 µs (26.0%)
appsec_no_iast 1.726 ms [1.701 ms, 1.751 ms] 379.962 µs (28.2%)
iast 1.475 ms [1.452 ms, 1.497 ms] 128.962 µs (9.6%)
profiling 1.504 ms [1.478 ms, 1.529 ms] 158.054 µs (11.7%)
tracing 1.475 ms [1.451 ms, 1.499 ms] 129.196 µs (9.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.332 ms [1.312 ms, 1.352 ms] -
appsec 1.722 ms [1.698 ms, 1.746 ms] 389.702 µs (29.3%)
appsec_no_iast 1.719 ms [1.695 ms, 1.743 ms] 387.043 µs (29.1%)
iast 1.483 ms [1.46 ms, 1.506 ms] 150.524 µs (11.3%)
profiling 1.527 ms [1.501 ms, 1.552 ms] 194.662 µs (14.6%)
tracing 1.449 ms [1.426 ms, 1.472 ms] 116.981 µs (8.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f
    dateFormat X
    axisFormat %s
section baseline
no_agent (366.946 µs) : 347, 387
.   : milestone, 367,
iast (472.574 µs) : 451, 494
.   : milestone, 473,
iast_FULL (548.896 µs) : 528, 570
.   : milestone, 549,
iast_GLOBAL (504.908 µs) : 483, 527
.   : milestone, 505,
iast_HARDCODED_SECRET_DISABLED (477.374 µs) : 456, 498
.   : milestone, 477,
iast_INACTIVE (454.139 µs) : 433, 476
.   : milestone, 454,
iast_TELEMETRY_OFF (469.5 µs) : 447, 492
.   : milestone, 470,
tracing (442.567 µs) : 422, 464
.   : milestone, 443,
section candidate
no_agent (364.249 µs) : 345, 384
.   : milestone, 364,
iast (478.366 µs) : 457, 499
.   : milestone, 478,
iast_FULL (543.866 µs) : 523, 565
.   : milestone, 544,
iast_GLOBAL (500.114 µs) : 478, 522
.   : milestone, 500,
iast_HARDCODED_SECRET_DISABLED (475.466 µs) : 455, 496
.   : milestone, 475,
iast_INACTIVE (459.773 µs) : 437, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (468.61 µs) : 446, 491
.   : milestone, 469,
tracing (435.399 µs) : 415, 456
.   : milestone, 435,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.946 µs [346.57 µs, 387.322 µs] -
iast 472.574 µs [451.266 µs, 493.881 µs] 105.628 µs (28.8%)
iast_FULL 548.896 µs [527.736 µs, 570.056 µs] 181.95 µs (49.6%)
iast_GLOBAL 504.908 µs [483.136 µs, 526.68 µs] 137.962 µs (37.6%)
iast_HARDCODED_SECRET_DISABLED 477.374 µs [456.451 µs, 498.298 µs] 110.428 µs (30.1%)
iast_INACTIVE 454.139 µs [432.742 µs, 475.536 µs] 87.193 µs (23.8%)
iast_TELEMETRY_OFF 469.5 µs [447.459 µs, 491.541 µs] 102.554 µs (27.9%)
tracing 442.567 µs [421.624 µs, 463.51 µs] 75.621 µs (20.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.249 µs [344.787 µs, 383.712 µs] -
iast 478.366 µs [457.337 µs, 499.394 µs] 114.116 µs (31.3%)
iast_FULL 543.866 µs [522.569 µs, 565.163 µs] 179.617 µs (49.3%)
iast_GLOBAL 500.114 µs [477.93 µs, 522.297 µs] 135.864 µs (37.3%)
iast_HARDCODED_SECRET_DISABLED 475.466 µs [454.611 µs, 496.322 µs] 111.217 µs (30.5%)
iast_INACTIVE 459.773 µs [437.403 µs, 482.142 µs] 95.523 µs (26.2%)
iast_TELEMETRY_OFF 468.61 µs [446.085 µs, 491.134 µs] 104.36 µs (28.7%)
tracing 435.399 µs [415.028 µs, 455.77 µs] 71.15 µs (19.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/mock-backend
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1716900024 1716900024
ci_job_id 524219144 524219144
ci_pipeline_id 35223418 35223418
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1716890250 1716890250
git_commit_sha ac3ca09 ac3ca09
release_version 1.35.0-SNAPSHOT~ac3ca0988f 1.35.0-SNAPSHOT~ac3ca0988f
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.022 s) : 15022000, 15022000
.   : milestone, 15022000,
appsec (15.164 s) : 15164000, 15164000
.   : milestone, 15164000,
iast (18.71 s) : 18710000, 18710000
.   : milestone, 18710000,
iast_GLOBAL (17.698 s) : 17698000, 17698000
.   : milestone, 17698000,
profiling (15.503 s) : 15503000, 15503000
.   : milestone, 15503000,
tracing (15.216 s) : 15216000, 15216000
.   : milestone, 15216000,
section candidate
no_agent (15.329 s) : 15329000, 15329000
.   : milestone, 15329000,
appsec (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
iast (18.884 s) : 18884000, 18884000
.   : milestone, 18884000,
iast_GLOBAL (17.978 s) : 17978000, 17978000
.   : milestone, 17978000,
profiling (14.683 s) : 14683000, 14683000
.   : milestone, 14683000,
tracing (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.022 s [15.022 s, 15.022 s] -
appsec 15.164 s [15.164 s, 15.164 s] 142.0 ms (0.9%)
iast 18.71 s [18.71 s, 18.71 s] 3.688 s (24.6%)
iast_GLOBAL 17.698 s [17.698 s, 17.698 s] 2.676 s (17.8%)
profiling 15.503 s [15.503 s, 15.503 s] 481.0 ms (3.2%)
tracing 15.216 s [15.216 s, 15.216 s] 194.0 ms (1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.329 s [15.329 s, 15.329 s] -
appsec 14.919 s [14.919 s, 14.919 s] -410.0 ms (-2.7%)
iast 18.884 s [18.884 s, 18.884 s] 3.555 s (23.2%)
iast_GLOBAL 17.978 s [17.978 s, 17.978 s] 2.649 s (17.3%)
profiling 14.683 s [14.683 s, 14.683 s] -646.0 ms (-4.2%)
tracing 15.149 s [15.149 s, 15.149 s] -180.0 ms (-1.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.35.0-SNAPSHOT~ac3ca0988f, baseline=1.35.0-SNAPSHOT~ac3ca0988f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.466 ms) : 1454, 1477
.   : milestone, 1466,
appsec (2.197 ms) : 2164, 2231
.   : milestone, 2197,
iast (1.954 ms) : 1913, 1994
.   : milestone, 1954,
iast_GLOBAL (1.993 ms) : 1952, 2033
.   : milestone, 1993,
profiling (1.851 ms) : 1818, 1884
.   : milestone, 1851,
tracing (1.834 ms) : 1802, 1867
.   : milestone, 1834,
section candidate
no_agent (1.465 ms) : 1453, 1476
.   : milestone, 1465,
appsec (2.201 ms) : 2167, 2234
.   : milestone, 2201,
iast (1.97 ms) : 1929, 2011
.   : milestone, 1970,
iast_GLOBAL (1.987 ms) : 1946, 2028
.   : milestone, 1987,
profiling (1.833 ms) : 1800, 1867
.   : milestone, 1833,
tracing (1.832 ms) : 1800, 1864
.   : milestone, 1832,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.454 ms, 1.477 ms] -
appsec 2.197 ms [2.164 ms, 2.231 ms] 731.515 µs (49.9%)
iast 1.954 ms [1.913 ms, 1.994 ms] 488.019 µs (33.3%)
iast_GLOBAL 1.993 ms [1.952 ms, 2.033 ms] 527.211 µs (36.0%)
profiling 1.851 ms [1.818 ms, 1.884 ms] 385.642 µs (26.3%)
tracing 1.834 ms [1.802 ms, 1.867 ms] 368.823 µs (25.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.453 ms, 1.476 ms] -
appsec 2.201 ms [2.167 ms, 2.234 ms] 736.178 µs (50.3%)
iast 1.97 ms [1.929 ms, 2.011 ms] 505.042 µs (34.5%)
iast_GLOBAL 1.987 ms [1.946 ms, 2.028 ms] 522.273 µs (35.7%)
profiling 1.833 ms [1.8 ms, 1.867 ms] 368.64 µs (25.2%)
tracing 1.832 ms [1.8 ms, 1.864 ms] 366.847 µs (25.0%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review May 28, 2024 13:55
@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 485d869 into master May 29, 2024
84 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/mock-backend branch May 29, 2024 08:54
@github-actions github-actions bot added this to the 1.35.0 milestone May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@anmarchenko anmarchenko anmarchenko approved these changes

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-java

@am312 am312 Awaiting requested review from am312 am312 is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.35.0
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@nikita-tkachenko-datadog @anmarchenko