Skip to content

Add some Dacapo benchmarks to be run on PRs#6911

Merged
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/dacapo-benchmarks
Apr 17, 2024
Merged

Add some Dacapo benchmarks to be run on PRs#6911
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/dacapo-benchmarks

Conversation

@manuel-alvarez-alvarez
Copy link
Copy Markdown
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Apr 15, 2024 •
edited
Loading

What Does This Do

Add some benchmarks from the Dacapo benchmarking suite in order to test the tracer

Motivation

Operations with plenty of string manipulation calls are specially harmful for IAST, these new benchmarks (e.g. biojava) simulates hostile envs for IAST to validate performance improvements.

Additional Notes

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez added the comp: tooling Build & Tooling label Apr 15, 2024
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Apr 15, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/dacapo-benchmarks
git_commit_date 1713275901 1713284844
git_commit_sha 733e306 beea515
release_version 1.33.0-SNAPSHOT~733e306ccf 1.33.0-SNAPSHOT~beea51554d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1713287401 1713287401
ci_job_id 488222494 488222494
ci_pipeline_id 32225243 32225243
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1082906
Total [baseline] (8.547 s) : 0, 8546702
Agent [candidate] (1.074 s) : 0, 1073787
Total [candidate] (8.55 s) : 0, 8549545
section iast
Agent [baseline] (1.208 s) : 0, 1207989
Total [baseline] (9.0 s) : 0, 9000367
Agent [candidate] (1.197 s) : 0, 1197175
Total [candidate] (9.007 s) : 0, 9007453
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.195 s) : 0, 1195278
Total [baseline] (9.035 s) : 0, 9035480
Agent [candidate] (1.198 s) : 0, 1198327
Total [candidate] (8.994 s) : 0, 8994114
section iast_TELEMETRY_OFF
Agent [baseline] (1.197 s) : 0, 1196981
Total [baseline] (8.996 s) : 0, 8996459
Agent [candidate] (1.211 s) : 0, 1210648
Total [candidate] (9.055 s) : 0, 9055278
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.208 s 125.083 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.195 s 112.371 ms (10.4%)
Agent iast_TELEMETRY_OFF 1.197 s 114.074 ms (10.5%)
Total tracing 8.547 s -
Total iast 9.0 s 453.666 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.035 s 488.778 ms (5.7%)
Total iast_TELEMETRY_OFF 8.996 s 449.757 ms (5.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.197 s 123.387 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.198 s 124.54 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.211 s 136.86 ms (12.7%)
Total tracing 8.55 s -
Total iast 9.007 s 457.908 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 8.994 s 444.568 ms (5.2%)
Total iast_TELEMETRY_OFF 9.055 s 505.732 ms (5.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (678.051 ms) : 0, 678051
BytebuddyAgent [candidate] (672.227 ms) : 0, 672227
GlobalTracer [baseline] (311.858 ms) : 0, 311858
GlobalTracer [candidate] (309.281 ms) : 0, 309281
AppSec [baseline] (50.052 ms) : 0, 50052
AppSec [candidate] (49.682 ms) : 0, 49682
Remote Config [baseline] (662.373 µs) : 0, 662
Remote Config [candidate] (658.624 µs) : 0, 659
Telemetry [baseline] (7.602 ms) : 0, 7602
Telemetry [candidate] (7.654 ms) : 0, 7654
section iast
BytebuddyAgent [baseline] (801.087 ms) : 0, 801087
BytebuddyAgent [candidate] (793.206 ms) : 0, 793206
GlobalTracer [baseline] (290.249 ms) : 0, 290249
GlobalTracer [candidate] (287.807 ms) : 0, 287807
AppSec [baseline] (50.984 ms) : 0, 50984
AppSec [candidate] (49.392 ms) : 0, 49392
Remote Config [baseline] (573.914 µs) : 0, 574
Remote Config [candidate] (575.728 µs) : 0, 576
Telemetry [baseline] (6.661 ms) : 0, 6661
Telemetry [candidate] (7.314 ms) : 0, 7314
IAST [baseline] (23.728 ms) : 0, 23728
IAST [candidate] (24.553 ms) : 0, 24553
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (791.745 ms) : 0, 791745
BytebuddyAgent [candidate] (793.572 ms) : 0, 793572
GlobalTracer [baseline] (287.217 ms) : 0, 287217
GlobalTracer [candidate] (288.002 ms) : 0, 288002
AppSec [baseline] (50.84 ms) : 0, 50840
AppSec [candidate] (49.759 ms) : 0, 49759
Remote Config [baseline] (578.468 µs) : 0, 578
Remote Config [candidate] (587.582 µs) : 0, 588
Telemetry [baseline] (6.664 ms) : 0, 6664
Telemetry [candidate] (6.583 ms) : 0, 6583
IAST [baseline] (23.93 ms) : 0, 23930
IAST [candidate] (25.459 ms) : 0, 25459
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (793.208 ms) : 0, 793208
BytebuddyAgent [candidate] (801.953 ms) : 0, 801953
GlobalTracer [baseline] (288.211 ms) : 0, 288211
GlobalTracer [candidate] (291.73 ms) : 0, 291730
AppSec [baseline] (49.316 ms) : 0, 49316
AppSec [candidate] (50.858 ms) : 0, 50858
Remote Config [baseline] (574.081 µs) : 0, 574
Remote Config [candidate] (577.563 µs) : 0, 578
Telemetry [baseline] (7.361 ms) : 0, 7361
Telemetry [candidate] (6.588 ms) : 0, 6588
IAST [baseline] (23.961 ms) : 0, 23961
IAST [candidate] (24.098 ms) : 0, 24098
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1074018
Total [baseline] (10.358 s) : 0, 10358354
Agent [candidate] (1.075 s) : 0, 1075017
Total [candidate] (10.467 s) : 0, 10466560
section appsec
Agent [baseline] (1.194 s) : 0, 1194403
Total [baseline] (10.527 s) : 0, 10527361
Agent [candidate] (1.187 s) : 0, 1186670
Total [candidate] (10.503 s) : 0, 10503357
section iast
Agent [baseline] (1.206 s) : 0, 1206406
Total [baseline] (10.731 s) : 0, 10731360
Agent [candidate] (1.197 s) : 0, 1197292
Total [candidate] (10.705 s) : 0, 10704657
section profiling
Agent [baseline] (1.266 s) : 0, 1265755
Total [baseline] (10.66 s) : 0, 10659884
Agent [candidate] (1.267 s) : 0, 1266936
Total [candidate] (10.634 s) : 0, 10634022
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.194 s 120.385 ms (11.2%)
Agent iast 1.206 s 132.388 ms (12.3%)
Agent profiling 1.266 s 191.736 ms (17.9%)
Total tracing 10.358 s -
Total appsec 10.527 s 169.007 ms (1.6%)
Total iast 10.731 s 373.006 ms (3.6%)
Total profiling 10.66 s 301.53 ms (2.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent appsec 1.187 s 111.653 ms (10.4%)
Agent iast 1.197 s 122.275 ms (11.4%)
Agent profiling 1.267 s 191.919 ms (17.9%)
Total tracing 10.467 s -
Total appsec 10.503 s 36.797 ms (0.4%)
Total iast 10.705 s 238.097 ms (2.3%)
Total profiling 10.634 s 167.462 ms (1.6%) 
gantt
    title petclinic - break down per module: candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.708 ms) : 0, 672708
BytebuddyAgent [candidate] (673.751 ms) : 0, 673751
GlobalTracer [baseline] (309.007 ms) : 0, 309007
GlobalTracer [candidate] (309.025 ms) : 0, 309025
AppSec [baseline] (49.676 ms) : 0, 49676
AppSec [candidate] (49.649 ms) : 0, 49649
Remote Config [baseline] (659.221 µs) : 0, 659
Remote Config [candidate] (657.776 µs) : 0, 658
Telemetry [baseline] (7.62 ms) : 0, 7620
Telemetry [candidate] (7.533 ms) : 0, 7533
section appsec
BytebuddyAgent [baseline] (699.802 ms) : 0, 699802
BytebuddyAgent [candidate] (694.611 ms) : 0, 694611
GlobalTracer [baseline] (292.49 ms) : 0, 292490
GlobalTracer [candidate] (290.924 ms) : 0, 290924
AppSec [baseline] (149.908 ms) : 0, 149908
AppSec [candidate] (149.458 ms) : 0, 149458
Remote Config [baseline] (623.276 µs) : 0, 623
Remote Config [candidate] (616.405 µs) : 0, 616
Telemetry [baseline] (7.233 ms) : 0, 7233
Telemetry [candidate] (7.152 ms) : 0, 7152
IAST [baseline] (19.257 ms) : 0, 19257
IAST [candidate] (18.918 ms) : 0, 18918
section iast
BytebuddyAgent [baseline] (799.777 ms) : 0, 799777
BytebuddyAgent [candidate] (793.866 ms) : 0, 793866
GlobalTracer [baseline] (289.592 ms) : 0, 289592
GlobalTracer [candidate] (287.945 ms) : 0, 287945
AppSec [baseline] (48.942 ms) : 0, 48942
AppSec [candidate] (50.974 ms) : 0, 50974
Remote Config [baseline] (573.324 µs) : 0, 573
Remote Config [candidate] (566.114 µs) : 0, 566
Telemetry [baseline] (8.873 ms) : 0, 8873
Telemetry [candidate] (7.375 ms) : 0, 7375
IAST [baseline] (24.054 ms) : 0, 24054
IAST [candidate] (22.176 ms) : 0, 22176
section profiling
BytebuddyAgent [baseline] (676.268 ms) : 0, 676268
BytebuddyAgent [candidate] (676.92 ms) : 0, 676920
GlobalTracer [baseline] (378.912 ms) : 0, 378912
GlobalTracer [candidate] (379.659 ms) : 0, 379659
AppSec [baseline] (50.248 ms) : 0, 50248
AppSec [candidate] (50.111 ms) : 0, 50111
Remote Config [baseline] (726.344 µs) : 0, 726
Remote Config [candidate] (724.681 µs) : 0, 725
Telemetry [baseline] (7.42 ms) : 0, 7420
Telemetry [candidate] (7.407 ms) : 0, 7407
ProfilingAgent [baseline] (96.015 ms) : 0, 96015
ProfilingAgent [candidate] (95.819 ms) : 0, 95819
Profiling [baseline] (96.039 ms) : 0, 96039
Profiling [candidate] (95.843 ms) : 0, 95843
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-04-16T16:39:13 2024-04-16T16:46:03
git_branch master malvarez/dacapo-benchmarks
git_commit_date 1713275901 1713284844
git_commit_sha 733e306 beea515
release_version 1.33.0-SNAPSHOT~733e306ccf 1.33.0-SNAPSHOT~beea51554d
start_time 2024-04-16T16:39:00 2024-04-16T16:45:50
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1713286308 1713286308
ci_job_id 488222495 488222495
ci_pipeline_id 32225243 32225243
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.331 ms) : 1312, 1349
.   : milestone, 1331,
appsec (1.725 ms) : 1700, 1750
.   : milestone, 1725,
appsec_no_iast (1.715 ms) : 1690, 1740
.   : milestone, 1715,
iast (1.48 ms) : 1457, 1502
.   : milestone, 1480,
profiling (1.529 ms) : 1503, 1556
.   : milestone, 1529,
tracing (1.465 ms) : 1440, 1489
.   : milestone, 1465,
section candidate
no_agent (1.343 ms) : 1324, 1362
.   : milestone, 1343,
appsec (1.731 ms) : 1707, 1756
.   : milestone, 1731,
appsec_no_iast (1.708 ms) : 1683, 1733
.   : milestone, 1708,
iast (1.488 ms) : 1466, 1510
.   : milestone, 1488,
profiling (1.522 ms) : 1497, 1548
.   : milestone, 1522,
tracing (1.488 ms) : 1464, 1512
.   : milestone, 1488,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.331 ms [1.312 ms, 1.349 ms] -
appsec 1.725 ms [1.7 ms, 1.75 ms] 393.917 µs (29.6%)
appsec_no_iast 1.715 ms [1.69 ms, 1.74 ms] 384.121 µs (28.9%)
iast 1.48 ms [1.457 ms, 1.502 ms] 148.728 µs (11.2%)
profiling 1.529 ms [1.503 ms, 1.556 ms] 198.553 µs (14.9%)
tracing 1.465 ms [1.44 ms, 1.489 ms] 133.76 µs (10.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.343 ms [1.324 ms, 1.362 ms] -
appsec 1.731 ms [1.707 ms, 1.756 ms] 388.375 µs (28.9%)
appsec_no_iast 1.708 ms [1.683 ms, 1.733 ms] 364.866 µs (27.2%)
iast 1.488 ms [1.466 ms, 1.51 ms] 145.039 µs (10.8%)
profiling 1.522 ms [1.497 ms, 1.548 ms] 179.344 µs (13.4%)
tracing 1.488 ms [1.464 ms, 1.512 ms] 145.273 µs (10.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf
    dateFormat X
    axisFormat %s
section baseline
no_agent (363.414 µs) : 344, 383
.   : milestone, 363,
iast (483.306 µs) : 461, 505
.   : milestone, 483,
iast_FULL (540.035 µs) : 519, 561
.   : milestone, 540,
iast_GLOBAL (506.279 µs) : 483, 529
.   : milestone, 506,
iast_HARDCODED_SECRET_DISABLED (475.232 µs) : 454, 496
.   : milestone, 475,
iast_INACTIVE (449.135 µs) : 427, 471
.   : milestone, 449,
iast_TELEMETRY_OFF (475.841 µs) : 455, 497
.   : milestone, 476,
tracing (436.806 µs) : 417, 457
.   : milestone, 437,
section candidate
no_agent (368.862 µs) : 349, 388
.   : milestone, 369,
iast (476.898 µs) : 455, 499
.   : milestone, 477,
iast_FULL (542.522 µs) : 522, 563
.   : milestone, 543,
iast_GLOBAL (501.038 µs) : 479, 523
.   : milestone, 501,
iast_HARDCODED_SECRET_DISABLED (480.359 µs) : 460, 501
.   : milestone, 480,
iast_INACTIVE (442.621 µs) : 422, 463
.   : milestone, 443,
iast_TELEMETRY_OFF (476.729 µs) : 456, 498
.   : milestone, 477,
tracing (444.696 µs) : 424, 466
.   : milestone, 445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 363.414 µs [343.614 µs, 383.213 µs] -
iast 483.306 µs [461.36 µs, 505.251 µs] 119.892 µs (33.0%)
iast_FULL 540.035 µs [519.28 µs, 560.79 µs] 176.621 µs (48.6%)
iast_GLOBAL 506.279 µs [483.391 µs, 529.166 µs] 142.865 µs (39.3%)
iast_HARDCODED_SECRET_DISABLED 475.232 µs [454.22 µs, 496.243 µs] 111.818 µs (30.8%)
iast_INACTIVE 449.135 µs [427.15 µs, 471.12 µs] 85.722 µs (23.6%)
iast_TELEMETRY_OFF 475.841 µs [455.018 µs, 496.664 µs] 112.427 µs (30.9%)
tracing 436.806 µs [416.701 µs, 456.911 µs] 73.393 µs (20.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.862 µs [349.404 µs, 388.32 µs] -
iast 476.898 µs [455.174 µs, 498.622 µs] 108.036 µs (29.3%)
iast_FULL 542.522 µs [521.578 µs, 563.467 µs] 173.661 µs (47.1%)
iast_GLOBAL 501.038 µs [479.156 µs, 522.92 µs] 132.176 µs (35.8%)
iast_HARDCODED_SECRET_DISABLED 480.359 µs [459.763 µs, 500.956 µs] 111.498 µs (30.2%)
iast_INACTIVE 442.621 µs [421.983 µs, 463.259 µs] 73.76 µs (20.0%)
iast_TELEMETRY_OFF 476.729 µs [455.885 µs, 497.573 µs] 107.867 µs (29.2%)
tracing 444.696 µs [423.606 µs, 465.787 µs] 75.835 µs (20.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/dacapo-benchmarks
git_commit_date 1713275901 1713284844
git_commit_sha 733e306 beea515
release_version 1.33.0-SNAPSHOT~733e306ccf 1.33.0-SNAPSHOT~beea51554d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1713286896 1713286896
ci_job_id 488222496 488222496
ci_pipeline_id 32225243 32225243
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.152 s) : 15152000, 15152000
.   : milestone, 15152000,
appsec (15.199 s) : 15199000, 15199000
.   : milestone, 15199000,
iast (18.681 s) : 18681000, 18681000
.   : milestone, 18681000,
iast_GLOBAL (17.767 s) : 17767000, 17767000
.   : milestone, 17767000,
profiling (15.26 s) : 15260000, 15260000
.   : milestone, 15260000,
tracing (15.099 s) : 15099000, 15099000
.   : milestone, 15099000,
section candidate
no_agent (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
appsec (14.75 s) : 14750000, 14750000
.   : milestone, 14750000,
iast (18.586 s) : 18586000, 18586000
.   : milestone, 18586000,
iast_GLOBAL (17.934 s) : 17934000, 17934000
.   : milestone, 17934000,
profiling (15.231 s) : 15231000, 15231000
.   : milestone, 15231000,
tracing (14.988 s) : 14988000, 14988000
.   : milestone, 14988000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.152 s [15.152 s, 15.152 s] -
appsec 15.199 s [15.199 s, 15.199 s] 47.0 ms (0.3%)
iast 18.681 s [18.681 s, 18.681 s] 3.529 s (23.3%)
iast_GLOBAL 17.767 s [17.767 s, 17.767 s] 2.615 s (17.3%)
profiling 15.26 s [15.26 s, 15.26 s] 108.0 ms (0.7%)
tracing 15.099 s [15.099 s, 15.099 s] -53.0 ms (-0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.036 s [15.036 s, 15.036 s] -
appsec 14.75 s [14.75 s, 14.75 s] -286.0 ms (-1.9%)
iast 18.586 s [18.586 s, 18.586 s] 3.55 s (23.6%)
iast_GLOBAL 17.934 s [17.934 s, 17.934 s] 2.898 s (19.3%)
profiling 15.231 s [15.231 s, 15.231 s] 195.0 ms (1.3%)
tracing 14.988 s [14.988 s, 14.988 s] -48.0 ms (-0.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.33.0-SNAPSHOT~beea51554d, baseline=1.33.0-SNAPSHOT~733e306ccf
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.457 ms) : 1446, 1469
.   : milestone, 1457,
appsec (2.19 ms) : 2157, 2224
.   : milestone, 2190,
iast (1.863 ms) : 1829, 1897
.   : milestone, 1863,
iast_GLOBAL (1.915 ms) : 1880, 1950
.   : milestone, 1915,
profiling (1.842 ms) : 1809, 1875
.   : milestone, 1842,
tracing (1.825 ms) : 1794, 1857
.   : milestone, 1825,
section candidate
no_agent (1.453 ms) : 1441, 1464
.   : milestone, 1453,
appsec (2.192 ms) : 2158, 2226
.   : milestone, 2192,
iast (1.871 ms) : 1836, 1905
.   : milestone, 1871,
iast_GLOBAL (1.91 ms) : 1875, 1945
.   : milestone, 1910,
profiling (1.839 ms) : 1806, 1873
.   : milestone, 1839,
tracing (1.814 ms) : 1783, 1845
.   : milestone, 1814,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.457 ms [1.446 ms, 1.469 ms] -
appsec 2.19 ms [2.157 ms, 2.224 ms] 733.163 µs (50.3%)
iast 1.863 ms [1.829 ms, 1.897 ms] 405.79 µs (27.8%)
iast_GLOBAL 1.915 ms [1.88 ms, 1.95 ms] 458.314 µs (31.5%)
profiling 1.842 ms [1.809 ms, 1.875 ms] 384.767 µs (26.4%)
tracing 1.825 ms [1.794 ms, 1.857 ms] 368.369 µs (25.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.453 ms [1.441 ms, 1.464 ms] -
appsec 2.192 ms [2.158 ms, 2.226 ms] 739.442 µs (50.9%)
iast 1.871 ms [1.836 ms, 1.905 ms] 417.897 µs (28.8%)
iast_GLOBAL 1.91 ms [1.875 ms, 1.945 ms] 457.615 µs (31.5%)
profiling 1.839 ms [1.806 ms, 1.873 ms] 386.506 µs (26.6%)
tracing 1.814 ms [1.783 ms, 1.845 ms] 361.605 µs (24.9%)

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/dacapo-benchmarks branch 5 times, most recently from b94807f to 0f8d1ca Compare April 16, 2024 07:33
@manuel-alvarez-alvarez manuel-alvarez-alvarez marked this pull request as ready for review April 16, 2024 07:37
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested a review from a team as a code owner April 16, 2024 07:37
@manuel-alvarez-alvarez manuel-alvarez-alvarez changed the base branch from master to malvarez/separate-benchmarks-jobs April 16, 2024 10:06
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/separate-benchmarks-jobs branch from e179e7d to 6c6188e Compare April 16, 2024 10:52
Base automatically changed from malvarez/separate-benchmarks-jobs to master April 16, 2024 11:33
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/dacapo-benchmarks branch 2 times, most recently from 625d2ad to 7268a19 Compare April 16, 2024 16:27
@manuel-alvarez-alvarez manuel-alvarez-alvarez merged commit 34e7066 into master Apr 17, 2024
@manuel-alvarez-alvarez manuel-alvarez-alvarez deleted the malvarez/dacapo-benchmarks branch April 17, 2024 07:17
@github-actions github-actions Bot added this to the 1.33.0 milestone Apr 17, 2024
@nikita-tkachenko-datadog nikita-tkachenko-datadog added the tag: no release notes Changes to exclude from release notes label Apr 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jandro996 jandro996 jandro996 approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

@nayeem-kamal nayeem-kamal Awaiting requested review from nayeem-kamal nayeem-kamal is a code owner automatically assigned from DataDog/apm-java

@smola smola Awaiting requested review from smola

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.33.0

Development

Successfully merging this pull request may close these issues.

3 participants

@manuel-alvarez-alvarez @jandro996 @nikita-tkachenko-datadog