Skip to content

Mark flaky LogProbeIntegrationTest #10080

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jpbempel merged 1 commit into from
Dec 4, 2025
Merged

Mark flaky LogProbeIntegrationTest #10080

jpbempel merged 1 commit into from
Dec 4, 2025

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Dec 4, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel jpbempel requested a review from a team as a code owner December 4, 2025 09:17
@jpbempel jpbempel removed the request for review from a team December 4, 2025 09:17
@jpbempel jpbempel added the type: bug Bug report and fix label Dec 4, 2025
@jpbempel jpbempel requested a review from evanchooly December 4, 2025 09:17
@jpbempel jpbempel added tag: no release notes Changes to exclude from release notes comp: debugger Dynamic Instrumentation labels Dec 4, 2025
@pr-commenter
Copy link

pr-commenter bot commented Dec 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/mark-flaky
git_commit_date 1764811148 1764839742
git_commit_sha c426f8c cfb22d6
release_version 1.57.0-SNAPSHOT~c426f8c01f 1.57.0-SNAPSHOT~cfb22d6192
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764841616 1764841616
ci_job_id 1269692231 1269692231
ci_pipeline_id 84857892 84857892
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gdnn5r2g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gdnn5r2g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 53 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Telemetry worse
[+209.999µs; +399.904µs] or [+2.711%; +5.162%]		 8.052ms 7.747ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068858
Total [baseline] (8.719 s) : 0, 8718951
Agent [candidate] (1.051 s) : 0, 1051381
Total [candidate] (8.688 s) : 0, 8688187
section iast
Agent [baseline] (1.19 s) : 0, 1190322
Total [baseline] (9.322 s) : 0, 9322011
Agent [candidate] (1.194 s) : 0, 1194201
Total [candidate] (9.337 s) : 0, 9337151
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.19 s 121.464 ms (11.4%)
Total tracing 8.719 s -
Total iast 9.322 s 603.06 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.194 s 142.821 ms (13.6%)
Total tracing 8.688 s -
Total iast 9.337 s 648.964 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.503 ms) : 0, 1503
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (719.176 ms) : 0, 719176
BytebuddyAgent [candidate] (706.92 ms) : 0, 706920
GlobalTracer [baseline] (252.583 ms) : 0, 252583
GlobalTracer [candidate] (248.809 ms) : 0, 248809
AppSec [baseline] (32.753 ms) : 0, 32753
AppSec [candidate] (32.014 ms) : 0, 32014
Debugger [baseline] (6.631 ms) : 0, 6631
Debugger [candidate] (6.432 ms) : 0, 6432
Remote Config [baseline] (691.85 µs) : 0, 692
Remote Config [candidate] (684.86 µs) : 0, 685
Telemetry [baseline] (14.675 ms) : 0, 14675
Telemetry [candidate] (15.307 ms) : 0, 15307
Flare Poller [baseline] (5.666 ms) : 0, 5666
Flare Poller [candidate] (4.934 ms) : 0, 4934
section iast
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (830.708 ms) : 0, 830708
BytebuddyAgent [candidate] (832.123 ms) : 0, 832123
GlobalTracer [baseline] (237.398 ms) : 0, 237398
GlobalTracer [candidate] (238.306 ms) : 0, 238306
AppSec [baseline] (25.985 ms) : 0, 25985
AppSec [candidate] (31.241 ms) : 0, 31241
Debugger [baseline] (5.972 ms) : 0, 5972
Debugger [candidate] (6.022 ms) : 0, 6022
Remote Config [baseline] (604.75 µs) : 0, 605
Remote Config [candidate] (607.94 µs) : 0, 608
Telemetry [baseline] (7.747 ms) : 0, 7747
Telemetry [candidate] (8.052 ms) : 0, 8052
Flare Poller [baseline] (10.679 ms) : 0, 10679
Flare Poller [candidate] (10.992 ms) : 0, 10992
IAST [baseline] (34.93 ms) : 0, 34930
IAST [candidate] (30.378 ms) : 0, 30378
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055190
Total [baseline] (10.791 s) : 0, 10791431
Agent [candidate] (1.053 s) : 0, 1052797
Total [candidate] (10.786 s) : 0, 10785510
section appsec
Agent [baseline] (1.23 s) : 0, 1230438
Total [baseline] (10.952 s) : 0, 10951554
Agent [candidate] (1.233 s) : 0, 1232659
Total [candidate] (10.905 s) : 0, 10904562
section iast
Agent [baseline] (1.199 s) : 0, 1199222
Total [baseline] (11.095 s) : 0, 11095422
Agent [candidate] (1.196 s) : 0, 1196277
Total [candidate] (11.177 s) : 0, 11176715
section profiling
Agent [baseline] (1.197 s) : 0, 1196588
Total [baseline] (10.917 s) : 0, 10916828
Agent [candidate] (1.198 s) : 0, 1197678
Total [candidate] (10.823 s) : 0, 10823469
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.23 s 175.248 ms (16.6%)
Agent iast 1.199 s 144.032 ms (13.6%)
Agent profiling 1.197 s 141.398 ms (13.4%)
Total tracing 10.791 s -
Total appsec 10.952 s 160.123 ms (1.5%)
Total iast 11.095 s 303.991 ms (2.8%)
Total profiling 10.917 s 125.396 ms (1.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.233 s 179.863 ms (17.1%)
Agent iast 1.196 s 143.48 ms (13.6%)
Agent profiling 1.198 s 144.881 ms (13.8%)
Total tracing 10.786 s -
Total appsec 10.905 s 119.052 ms (1.1%)
Total iast 11.177 s 391.205 ms (3.6%)
Total profiling 10.823 s 37.959 ms (0.4%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.483 ms) : 0, 1483
BytebuddyAgent [baseline] (709.816 ms) : 0, 709816
BytebuddyAgent [candidate] (708.116 ms) : 0, 708116
GlobalTracer [baseline] (249.454 ms) : 0, 249454
GlobalTracer [candidate] (248.757 ms) : 0, 248757
AppSec [baseline] (32.039 ms) : 0, 32039
AppSec [candidate] (32.122 ms) : 0, 32122
Debugger [baseline] (6.438 ms) : 0, 6438
Debugger [candidate] (6.381 ms) : 0, 6381
Remote Config [baseline] (677.739 µs) : 0, 678
Remote Config [candidate] (675.942 µs) : 0, 676
Telemetry [baseline] (15.44 ms) : 0, 15440
Telemetry [candidate] (14.803 ms) : 0, 14803
Flare Poller [baseline] (4.936 ms) : 0, 4936
Flare Poller [candidate] (5.571 ms) : 0, 5571
section appsec
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.501 ms) : 0, 1501
BytebuddyAgent [baseline] (733.396 ms) : 0, 733396
BytebuddyAgent [candidate] (734.64 ms) : 0, 734640
GlobalTracer [baseline] (241.718 ms) : 0, 241718
GlobalTracer [candidate] (242.386 ms) : 0, 242386
AppSec [baseline] (174.882 ms) : 0, 174882
AppSec [candidate] (175.154 ms) : 0, 175154
Debugger [baseline] (6.286 ms) : 0, 6286
Debugger [candidate] (6.279 ms) : 0, 6279
Remote Config [baseline] (683.647 µs) : 0, 684
Remote Config [candidate] (704.026 µs) : 0, 704
Telemetry [baseline] (8.08 ms) : 0, 8080
Telemetry [candidate] (8.13 ms) : 0, 8130
Flare Poller [baseline] (4.042 ms) : 0, 4042
Flare Poller [candidate] (4.006 ms) : 0, 4006
IAST [baseline] (24.841 ms) : 0, 24841
IAST [candidate] (24.867 ms) : 0, 24867
section iast
crashtracking [baseline] (1.487 ms) : 0, 1487
crashtracking [candidate] (1.491 ms) : 0, 1491
BytebuddyAgent [baseline] (837.88 ms) : 0, 837880
BytebuddyAgent [candidate] (835.1 ms) : 0, 835100
GlobalTracer [baseline] (238.011 ms) : 0, 238011
GlobalTracer [candidate] (238.499 ms) : 0, 238499
AppSec [baseline] (29.595 ms) : 0, 29595
AppSec [candidate] (27.66 ms) : 0, 27660
Debugger [baseline] (6.027 ms) : 0, 6027
Debugger [candidate] (6.057 ms) : 0, 6057
Remote Config [baseline] (599.454 µs) : 0, 599
Remote Config [candidate] (611.348 µs) : 0, 611
Telemetry [baseline] (7.937 ms) : 0, 7937
Telemetry [candidate] (7.819 ms) : 0, 7819
Flare Poller [baseline] (10.812 ms) : 0, 10812
Flare Poller [candidate] (10.667 ms) : 0, 10667
IAST [baseline] (31.808 ms) : 0, 31808
IAST [candidate] (33.504 ms) : 0, 33504
section profiling
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (733.355 ms) : 0, 733355
BytebuddyAgent [candidate] (734.683 ms) : 0, 734683
GlobalTracer [baseline] (221.695 ms) : 0, 221695
GlobalTracer [candidate] (221.183 ms) : 0, 221183
AppSec [baseline] (32.146 ms) : 0, 32146
AppSec [candidate] (32.011 ms) : 0, 32011
Debugger [baseline] (6.732 ms) : 0, 6732
Debugger [candidate] (6.841 ms) : 0, 6841
Remote Config [baseline] (668.445 µs) : 0, 668
Remote Config [candidate] (699.973 µs) : 0, 700
Telemetry [baseline] (16.408 ms) : 0, 16408
Telemetry [candidate] (16.335 ms) : 0, 16335
Flare Poller [baseline] (4.13 ms) : 0, 4130
Flare Poller [candidate] (4.127 ms) : 0, 4127
ProfilingAgent [baseline] (110.737 ms) : 0, 110737
ProfilingAgent [candidate] (110.691 ms) : 0, 110691
Profiling [baseline] (111.387 ms) : 0, 111387
Profiling [candidate] (111.318 ms) : 0, 111318
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/mark-flaky
git_commit_date 1764811148 1764839742
git_commit_sha c426f8c cfb22d6
release_version 1.57.0-SNAPSHOT~c426f8c01f 1.57.0-SNAPSHOT~cfb22d6192
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764842299 1764842299
ci_job_id 1269692232 1269692232
ci_pipeline_id 84857892 84857892
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-l76v1v9u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-l76v1v9u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:iast:high_load better
[-1.592ms; -0.795ms] or [-8.638%; -4.313%]		 same
[-1277.161µs; +100.020µs] or [-4.324%; +0.339%]		 unstable
[-14.005op/s; +41.005op/s] or [-5.580%; +16.337%]		 17.239ms 28.947ms 264.500op/s 18.433ms 29.536ms 251.000op/s
scenario:load:petclinic:profiling:high_load better
[-1.534ms; -0.571ms] or [-7.912%; -2.945%]		 unsure
[-2.161ms; -0.516ms] or [-7.001%; -1.671%]		 unstable
[-12.682op/s; +39.682op/s] or [-5.343%; +16.717%]		 18.341ms 29.530ms 250.875op/s 19.394ms 30.868ms 237.375op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.266 ms) : 18083, 18450
.   : milestone, 18266,
appsec (18.615 ms) : 18426, 18804
.   : milestone, 18615,
code_origins (17.451 ms) : 17276, 17627
.   : milestone, 17451,
iast (18.592 ms) : 18404, 18780
.   : milestone, 18592,
profiling (19.663 ms) : 19462, 19864
.   : milestone, 19663,
tracing (17.81 ms) : 17633, 17987
.   : milestone, 17810,
section candidate
no_agent (18.06 ms) : 17875, 18244
.   : milestone, 18060,
appsec (18.722 ms) : 18530, 18914
.   : milestone, 18722,
code_origins (17.461 ms) : 17291, 17631
.   : milestone, 17461,
iast (17.641 ms) : 17462, 17820
.   : milestone, 17641,
profiling (18.605 ms) : 18423, 18786
.   : milestone, 18605,
tracing (17.736 ms) : 17559, 17914
.   : milestone, 17736,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.266 ms [18.083 ms, 18.45 ms] -
appsec 18.615 ms [18.426 ms, 18.804 ms] 348.54 µs (1.9%)
code_origins 17.451 ms [17.276 ms, 17.627 ms] -814.926 µs (-4.5%)
iast 18.592 ms [18.404 ms, 18.78 ms] 325.607 µs (1.8%)
profiling 19.663 ms [19.462 ms, 19.864 ms] 1.397 ms (7.6%)
tracing 17.81 ms [17.633 ms, 17.987 ms] -456.163 µs (-2.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.06 ms [17.875 ms, 18.244 ms] -
appsec 18.722 ms [18.53 ms, 18.914 ms] 662.15 µs (3.7%)
code_origins 17.461 ms [17.291 ms, 17.631 ms] -598.991 µs (-3.3%)
iast 17.641 ms [17.462 ms, 17.82 ms] -418.868 µs (-2.3%)
profiling 18.605 ms [18.423 ms, 18.786 ms] 544.638 µs (3.0%)
tracing 17.736 ms [17.559 ms, 17.914 ms] -323.429 µs (-1.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.222 ms) : 1210, 1234
.   : milestone, 1222,
iast (3.138 ms) : 3094, 3182
.   : milestone, 3138,
iast_FULL (5.899 ms) : 5839, 5958
.   : milestone, 5899,
iast_GLOBAL (3.663 ms) : 3597, 3728
.   : milestone, 3663,
profiling (2.112 ms) : 2093, 2130
.   : milestone, 2112,
tracing (1.765 ms) : 1751, 1779
.   : milestone, 1765,
section candidate
no_agent (1.218 ms) : 1206, 1230
.   : milestone, 1218,
iast (3.186 ms) : 3140, 3233
.   : milestone, 3186,
iast_FULL (5.917 ms) : 5857, 5976
.   : milestone, 5917,
iast_GLOBAL (3.604 ms) : 3552, 3656
.   : milestone, 3604,
profiling (1.987 ms) : 1969, 2005
.   : milestone, 1987,
tracing (1.883 ms) : 1867, 1900
.   : milestone, 1883,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.222 ms [1.21 ms, 1.234 ms] -
iast 3.138 ms [3.094 ms, 3.182 ms] 1.916 ms (156.8%)
iast_FULL 5.899 ms [5.839 ms, 5.958 ms] 4.677 ms (382.7%)
iast_GLOBAL 3.663 ms [3.597 ms, 3.728 ms] 2.441 ms (199.7%)
profiling 2.112 ms [2.093 ms, 2.13 ms] 889.61 µs (72.8%)
tracing 1.765 ms [1.751 ms, 1.779 ms] 543.173 µs (44.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.218 ms [1.206 ms, 1.23 ms] -
iast 3.186 ms [3.14 ms, 3.233 ms] 1.968 ms (161.6%)
iast_FULL 5.917 ms [5.857 ms, 5.976 ms] 4.698 ms (385.7%)
iast_GLOBAL 3.604 ms [3.552 ms, 3.656 ms] 2.386 ms (195.8%)
profiling 1.987 ms [1.969 ms, 2.005 ms] 769.012 µs (63.1%)
tracing 1.883 ms [1.867 ms, 1.9 ms] 665.032 µs (54.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/mark-flaky
git_commit_date 1764811148 1764839742
git_commit_sha c426f8c cfb22d6
release_version 1.57.0-SNAPSHOT~c426f8c01f 1.57.0-SNAPSHOT~cfb22d6192
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1764841967 1764841967
ci_job_id 1269692233 1269692233
ci_pipeline_id 84857892 84857892
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-t5pd6xcm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-t5pd6xcm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.456 ms) : 2404, 2507
.   : milestone, 2456,
iast (2.206 ms) : 2142, 2271
.   : milestone, 2206,
iast_GLOBAL (2.254 ms) : 2189, 2320
.   : milestone, 2254,
profiling (2.489 ms) : 2325, 2654
.   : milestone, 2489,
tracing (2.034 ms) : 1983, 2084
.   : milestone, 2034,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.445 ms) : 2394, 2497
.   : milestone, 2445,
iast (2.208 ms) : 2144, 2273
.   : milestone, 2208,
iast_GLOBAL (2.261 ms) : 2197, 2326
.   : milestone, 2261,
profiling (2.054 ms) : 2001, 2106
.   : milestone, 2054,
tracing (2.045 ms) : 1994, 2096
.   : milestone, 2045,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.456 ms [2.404 ms, 2.507 ms] 987.076 µs (67.2%)
iast 2.206 ms [2.142 ms, 2.271 ms] 737.868 µs (50.2%)
iast_GLOBAL 2.254 ms [2.189 ms, 2.32 ms] 785.667 µs (53.5%)
profiling 2.489 ms [2.325 ms, 2.654 ms] 1.021 ms (69.5%)
tracing 2.034 ms [1.983 ms, 2.084 ms] 565.114 µs (38.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.445 ms [2.394 ms, 2.497 ms] 974.973 µs (66.3%)
iast 2.208 ms [2.144 ms, 2.273 ms] 737.908 µs (50.2%)
iast_GLOBAL 2.261 ms [2.197 ms, 2.326 ms] 790.971 µs (53.8%)
profiling 2.054 ms [2.001 ms, 2.106 ms] 583.101 µs (39.7%)
tracing 2.045 ms [1.994 ms, 2.096 ms] 574.612 µs (39.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~cfb22d6192, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.278 s) : 15278000, 15278000
.   : milestone, 15278000,
appsec (14.59 s) : 14590000, 14590000
.   : milestone, 14590000,
iast (18.346 s) : 18346000, 18346000
.   : milestone, 18346000,
iast_GLOBAL (18.032 s) : 18032000, 18032000
.   : milestone, 18032000,
profiling (14.633 s) : 14633000, 14633000
.   : milestone, 14633000,
tracing (14.521 s) : 14521000, 14521000
.   : milestone, 14521000,
section candidate
no_agent (15.672 s) : 15672000, 15672000
.   : milestone, 15672000,
appsec (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
iast (18.27 s) : 18270000, 18270000
.   : milestone, 18270000,
iast_GLOBAL (17.914 s) : 17914000, 17914000
.   : milestone, 17914000,
profiling (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
tracing (14.754 s) : 14754000, 14754000
.   : milestone, 14754000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.278 s [15.278 s, 15.278 s] -
appsec 14.59 s [14.59 s, 14.59 s] -688.0 ms (-4.5%)
iast 18.346 s [18.346 s, 18.346 s] 3.068 s (20.1%)
iast_GLOBAL 18.032 s [18.032 s, 18.032 s] 2.754 s (18.0%)
profiling 14.633 s [14.633 s, 14.633 s] -645.0 ms (-4.2%)
tracing 14.521 s [14.521 s, 14.521 s] -757.0 ms (-5.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.672 s [15.672 s, 15.672 s] -
appsec 15.029 s [15.029 s, 15.029 s] -643.0 ms (-4.1%)
iast 18.27 s [18.27 s, 18.27 s] 2.598 s (16.6%)
iast_GLOBAL 17.914 s [17.914 s, 17.914 s] 2.242 s (14.3%)
profiling 15.029 s [15.029 s, 15.029 s] -643.0 ms (-4.1%)
tracing 14.754 s [14.754 s, 14.754 s] -918.0 ms (-5.9%)

@jpbempel jpbempel merged commit 6b0cd83 into master Dec 4, 2025
544 of 546 checks passed
@jpbempel jpbempel deleted the jpbempel/mark-flaky branch December 4, 2025 13:21
@github-actions github-actions bot added this to the 1.57.0 milestone Dec 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@evanchooly evanchooly Awaiting requested review from evanchooly evanchooly is a code owner automatically assigned from DataDog/debugger-java

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jpbempel @AlexeyKuznetsov-DD