Mark Spark integration test as flaky by PerfectSlayer · Pull Request #6958 · DataDog/dd-trace-java

PerfectSlayer · 2024-04-26T15:27:44Z

What Does This Do

This PR marks Spark integration test as flaky.

Motivation

See #6957

Additional Notes

Jira ticket: DJM-206

See #6957

paul-laffon-dd

Thanks for looking into this. Created DJM-206 on our side to address it in the future

Are you aware of a way we could get notified if one of our test starts to be flaky in the CI ? (as we totally missed this one)

PerfectSlayer · 2024-04-26T15:55:37Z

Are you aware of a way we could get notified if one of our test starts to be flaky in the CI ? (as we totally missed this one)

There is a dashboard where you can get all the flaky tests but I would usually post them in the project slack channel on a weekly basis (this one is planned for next week 😉)

I updated the JIRA ticket in the PR description. Thanks for having a look at! 🤝

pr-commenter · 2024-04-26T16:11:26Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/ci-flaky-integration-spark
git_commit_date	1714138507	1714145154
git_commit_sha	`a481d0b`	`72e983b`
release_version	1.34.0-SNAPSHOT~a481d0b8c2	1.34.0-SNAPSHOT~72e983bd69

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1714147726	1714147726
ci_job_id	498498172	498498172
ci_pipeline_id	33030263	33030263
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1088760
Total [baseline] (10.429 s) : 0, 10429454
Agent [candidate] (1.082 s) : 0, 1082094
Total [candidate] (10.363 s) : 0, 10363306
section appsec
Agent [baseline] (1.192 s) : 0, 1191905
Total [baseline] (10.51 s) : 0, 10509971
Agent [candidate] (1.192 s) : 0, 1191607
Total [candidate] (10.52 s) : 0, 10520166
section iast
Agent [baseline] (1.198 s) : 0, 1198357
Total [baseline] (10.701 s) : 0, 10700896
Agent [candidate] (1.197 s) : 0, 1196958
Total [candidate] (10.706 s) : 0, 10705728
section profiling
Agent [baseline] (1.273 s) : 0, 1272631
Total [baseline] (10.579 s) : 0, 10579021
Agent [candidate] (1.269 s) : 0, 1269093
Total [candidate] (10.614 s) : 0, 10613752

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.089 s	-
Agent	appsec	1.192 s	103.145 ms (9.5%)
Agent	iast	1.198 s	109.596 ms (10.1%)
Agent	profiling	1.273 s	183.871 ms (16.9%)
Total	tracing	10.429 s	-
Total	appsec	10.51 s	80.517 ms (0.8%)
Total	iast	10.701 s	271.441 ms (2.6%)
Total	profiling	10.579 s	149.567 ms (1.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.082 s	-
Agent	appsec	1.192 s	109.513 ms (10.1%)
Agent	iast	1.197 s	114.864 ms (10.6%)
Agent	profiling	1.269 s	186.999 ms (17.3%)
Total	tracing	10.363 s	-
Total	appsec	10.52 s	156.861 ms (1.5%)
Total	iast	10.706 s	342.423 ms (3.3%)
Total	profiling	10.614 s	250.447 ms (2.4%)

gantt
    title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.524 ms) : 0, 682524
BytebuddyAgent [candidate] (677.974 ms) : 0, 677974
GlobalTracer [baseline] (313.283 ms) : 0, 313283
GlobalTracer [candidate] (311.656 ms) : 0, 311656
AppSec [baseline] (49.785 ms) : 0, 49785
AppSec [candidate] (49.579 ms) : 0, 49579
Remote Config [baseline] (665.763 µs) : 0, 666
Remote Config [candidate] (667.482 µs) : 0, 667
Telemetry [baseline] (7.62 ms) : 0, 7620
Telemetry [candidate] (7.571 ms) : 0, 7571
section appsec
BytebuddyAgent [baseline] (697.404 ms) : 0, 697404
BytebuddyAgent [candidate] (696.615 ms) : 0, 696615
GlobalTracer [baseline] (292.133 ms) : 0, 292133
GlobalTracer [candidate] (291.955 ms) : 0, 291955
AppSec [baseline] (149.167 ms) : 0, 149167
AppSec [candidate] (149.747 ms) : 0, 149747
Remote Config [baseline] (621.397 µs) : 0, 621
Remote Config [candidate] (624.627 µs) : 0, 625
Telemetry [baseline] (8.444 ms) : 0, 8444
Telemetry [candidate] (8.529 ms) : 0, 8529
IAST [baseline] (19.24 ms) : 0, 19240
IAST [candidate] (19.263 ms) : 0, 19263
section iast
BytebuddyAgent [baseline] (793.576 ms) : 0, 793576
BytebuddyAgent [candidate] (792.281 ms) : 0, 792281
GlobalTracer [baseline] (287.862 ms) : 0, 287862
GlobalTracer [candidate] (287.5 ms) : 0, 287500
AppSec [baseline] (48.08 ms) : 0, 48080
AppSec [candidate] (50.99 ms) : 0, 50990
Remote Config [baseline] (574.223 µs) : 0, 574
Remote Config [candidate] (573.874 µs) : 0, 574
Telemetry [baseline] (8.883 ms) : 0, 8883
Telemetry [candidate] (7.378 ms) : 0, 7378
IAST [baseline] (25.003 ms) : 0, 25003
IAST [candidate] (23.766 ms) : 0, 23766
section profiling
ProfilingAgent [baseline] (95.426 ms) : 0, 95426
ProfilingAgent [candidate] (96.572 ms) : 0, 96572
BytebuddyAgent [baseline] (680.197 ms) : 0, 680197
BytebuddyAgent [candidate] (677.146 ms) : 0, 677146
GlobalTracer [baseline] (381.751 ms) : 0, 381751
GlobalTracer [candidate] (380.764 ms) : 0, 380764
AppSec [baseline] (50.413 ms) : 0, 50413
AppSec [candidate] (50.112 ms) : 0, 50112
Remote Config [baseline] (707.049 µs) : 0, 707
Remote Config [candidate] (698.433 µs) : 0, 698
Telemetry [baseline] (7.519 ms) : 0, 7519
Telemetry [candidate] (7.461 ms) : 0, 7461
Profiling [baseline] (95.45 ms) : 0, 95450
Profiling [candidate] (96.596 ms) : 0, 96596

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.082 s) : 0, 1081759
Total [baseline] (8.546 s) : 0, 8545694
Agent [candidate] (1.075 s) : 0, 1074558
Total [candidate] (8.535 s) : 0, 8534808
section iast
Agent [baseline] (1.208 s) : 0, 1208111
Total [baseline] (8.999 s) : 0, 8999457
Agent [candidate] (1.197 s) : 0, 1196803
Total [candidate] (9.035 s) : 0, 9035160
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.198 s) : 0, 1197772
Total [baseline] (8.972 s) : 0, 8972066
Agent [candidate] (1.206 s) : 0, 1205696
Total [candidate] (8.979 s) : 0, 8978826
section iast_TELEMETRY_OFF
Agent [baseline] (1.197 s) : 0, 1196736
Total [baseline] (9.027 s) : 0, 9026739
Agent [candidate] (1.208 s) : 0, 1208079
Total [candidate] (9.018 s) : 0, 9018191

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.082 s	-
Agent	iast	1.208 s	126.351 ms (11.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.198 s	116.012 ms (10.7%)
Agent	iast_TELEMETRY_OFF	1.197 s	114.977 ms (10.6%)
Total	tracing	8.546 s	-
Total	iast	8.999 s	453.763 ms (5.3%)
Total	iast_HARDCODED_SECRET_DISABLED	8.972 s	426.372 ms (5.0%)
Total	iast_TELEMETRY_OFF	9.027 s	481.045 ms (5.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.075 s	-
Agent	iast	1.197 s	122.245 ms (11.4%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.206 s	131.138 ms (12.2%)
Agent	iast_TELEMETRY_OFF	1.208 s	133.521 ms (12.4%)
Total	tracing	8.535 s	-
Total	iast	9.035 s	500.352 ms (5.9%)
Total	iast_HARDCODED_SECRET_DISABLED	8.979 s	444.018 ms (5.2%)
Total	iast_TELEMETRY_OFF	9.018 s	483.382 ms (5.7%)

gantt
    title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (677.248 ms) : 0, 677248
BytebuddyAgent [candidate] (672.778 ms) : 0, 672778
GlobalTracer [baseline] (312.027 ms) : 0, 312027
GlobalTracer [candidate] (309.614 ms) : 0, 309614
AppSec [baseline] (49.637 ms) : 0, 49637
AppSec [candidate] (49.508 ms) : 0, 49508
Remote Config [baseline] (663.583 µs) : 0, 664
Remote Config [candidate] (658.577 µs) : 0, 659
Telemetry [baseline] (7.592 ms) : 0, 7592
Telemetry [candidate] (7.606 ms) : 0, 7606
section iast
BytebuddyAgent [baseline] (800.89 ms) : 0, 800890
BytebuddyAgent [candidate] (792.523 ms) : 0, 792523
GlobalTracer [baseline] (289.457 ms) : 0, 289457
GlobalTracer [candidate] (287.667 ms) : 0, 287667
AppSec [baseline] (50.078 ms) : 0, 50078
AppSec [candidate] (49.389 ms) : 0, 49389
IAST [baseline] (25.137 ms) : 0, 25137
IAST [candidate] (25.648 ms) : 0, 25648
Remote Config [baseline] (579.089 µs) : 0, 579
Remote Config [candidate] (568.831 µs) : 0, 569
Telemetry [baseline] (7.345 ms) : 0, 7345
Telemetry [candidate] (6.586 ms) : 0, 6586
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (793.032 ms) : 0, 793032
BytebuddyAgent [candidate] (798.552 ms) : 0, 798552
GlobalTracer [baseline] (287.706 ms) : 0, 287706
GlobalTracer [candidate] (289.814 ms) : 0, 289814
AppSec [baseline] (49.576 ms) : 0, 49576
AppSec [candidate] (51.046 ms) : 0, 51046
IAST [baseline] (24.266 ms) : 0, 24266
IAST [candidate] (23.508 ms) : 0, 23508
Remote Config [baseline] (580.152 µs) : 0, 580
Remote Config [candidate] (590.875 µs) : 0, 591
Telemetry [baseline] (8.161 ms) : 0, 8161
Telemetry [candidate] (7.562 ms) : 0, 7562
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (792.433 ms) : 0, 792433
BytebuddyAgent [candidate] (798.424 ms) : 0, 798424
GlobalTracer [baseline] (288.179 ms) : 0, 288179
GlobalTracer [candidate] (291.978 ms) : 0, 291978
AppSec [baseline] (49.377 ms) : 0, 49377
AppSec [candidate] (50.134 ms) : 0, 50134
IAST [baseline] (25.172 ms) : 0, 25172
IAST [candidate] (25.61 ms) : 0, 25610
Remote Config [baseline] (576.856 µs) : 0, 577
Remote Config [candidate] (592.702 µs) : 0, 593
Telemetry [baseline] (6.564 ms) : 0, 6564
Telemetry [candidate] (6.66 ms) : 0, 6660

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-04-26T15:39:32	2024-04-26T15:46:25
git_branch	master	bbujon/ci-flaky-integration-spark
git_commit_date	1714138507	1714145154
git_commit_sha	`a481d0b`	`72e983b`
release_version	1.34.0-SNAPSHOT~a481d0b8c2	1.34.0-SNAPSHOT~72e983bd69
start_time	2024-04-26T15:39:18	2024-04-26T15:46:11

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1714146730	1714146730
ci_job_id	498498173	498498173
ci_pipeline_id	33030263	33030263
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.441 µs) : 353, 392
.   : milestone, 372,
iast (484.752 µs) : 464, 506
.   : milestone, 485,
iast_FULL (553.903 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (517.105 µs) : 494, 540
.   : milestone, 517,
iast_HARDCODED_SECRET_DISABLED (477.252 µs) : 455, 499
.   : milestone, 477,
iast_INACTIVE (459.048 µs) : 437, 481
.   : milestone, 459,
iast_TELEMETRY_OFF (473.903 µs) : 453, 495
.   : milestone, 474,
tracing (452.75 µs) : 432, 473
.   : milestone, 453,
section candidate
no_agent (376.461 µs) : 357, 396
.   : milestone, 376,
iast (481.626 µs) : 460, 503
.   : milestone, 482,
iast_FULL (548.249 µs) : 528, 569
.   : milestone, 548,
iast_GLOBAL (508.391 µs) : 486, 530
.   : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (482.196 µs) : 461, 504
.   : milestone, 482,
iast_INACTIVE (458.412 µs) : 437, 480
.   : milestone, 458,
iast_TELEMETRY_OFF (473.522 µs) : 453, 494
.   : milestone, 474,
tracing (454.558 µs) : 433, 476
.   : milestone, 455,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	372.441 µs [352.731 µs, 392.15 µs]	-
iast	484.752 µs [463.5 µs, 506.004 µs]	112.312 µs (30.2%)
iast_FULL	553.903 µs [532.951 µs, 574.855 µs]	181.463 µs (48.7%)
iast_GLOBAL	517.105 µs [494.44 µs, 539.77 µs]	144.664 µs (38.8%)
iast_HARDCODED_SECRET_DISABLED	477.252 µs [455.482 µs, 499.022 µs]	104.812 µs (28.1%)
iast_INACTIVE	459.048 µs [437.25 µs, 480.847 µs]	86.608 µs (23.3%)
iast_TELEMETRY_OFF	473.903 µs [452.837 µs, 494.968 µs]	101.462 µs (27.2%)
tracing	452.75 µs [432.094 µs, 473.405 µs]	80.309 µs (21.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	376.461 µs [357.057 µs, 395.866 µs]	-
iast	481.626 µs [459.774 µs, 503.477 µs]	105.165 µs (27.9%)
iast_FULL	548.249 µs [527.795 µs, 568.703 µs]	171.788 µs (45.6%)
iast_GLOBAL	508.391 µs [486.373 µs, 530.409 µs]	131.93 µs (35.0%)
iast_HARDCODED_SECRET_DISABLED	482.196 µs [460.653 µs, 503.738 µs]	105.734 µs (28.1%)
iast_INACTIVE	458.412 µs [436.831 µs, 479.993 µs]	81.951 µs (21.8%)
iast_TELEMETRY_OFF	473.522 µs [452.902 µs, 494.143 µs]	97.061 µs (25.8%)
tracing	454.558 µs [432.816 µs, 476.301 µs]	78.097 µs (20.7%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.353 ms) : 1333, 1372
.   : milestone, 1353,
appsec (1.745 ms) : 1721, 1769
.   : milestone, 1745,
appsec_no_iast (1.738 ms) : 1714, 1762
.   : milestone, 1738,
iast (1.525 ms) : 1502, 1549
.   : milestone, 1525,
profiling (1.529 ms) : 1504, 1555
.   : milestone, 1529,
tracing (1.502 ms) : 1478, 1526
.   : milestone, 1502,
section candidate
no_agent (1.351 ms) : 1331, 1372
.   : milestone, 1351,
appsec (1.715 ms) : 1689, 1740
.   : milestone, 1715,
appsec_no_iast (1.728 ms) : 1704, 1753
.   : milestone, 1728,
iast (1.491 ms) : 1468, 1514
.   : milestone, 1491,
profiling (1.512 ms) : 1488, 1537
.   : milestone, 1512,
tracing (1.496 ms) : 1472, 1520
.   : milestone, 1496,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.353 ms [1.333 ms, 1.372 ms]	-
appsec	1.745 ms [1.721 ms, 1.769 ms]	391.978 µs (29.0%)
appsec_no_iast	1.738 ms [1.714 ms, 1.762 ms]	385.349 µs (28.5%)
iast	1.525 ms [1.502 ms, 1.549 ms]	172.776 µs (12.8%)
profiling	1.529 ms [1.504 ms, 1.555 ms]	176.691 µs (13.1%)
tracing	1.502 ms [1.478 ms, 1.526 ms]	149.083 µs (11.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.351 ms [1.331 ms, 1.372 ms]	-
appsec	1.715 ms [1.689 ms, 1.74 ms]	363.631 µs (26.9%)
appsec_no_iast	1.728 ms [1.704 ms, 1.753 ms]	377.092 µs (27.9%)
iast	1.491 ms [1.468 ms, 1.514 ms]	139.857 µs (10.4%)
profiling	1.512 ms [1.488 ms, 1.537 ms]	161.298 µs (11.9%)
tracing	1.496 ms [1.472 ms, 1.52 ms]	145.224 µs (10.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/ci-flaky-integration-spark
git_commit_date	1714138507	1714145154
git_commit_sha	`a481d0b`	`72e983b`
release_version	1.34.0-SNAPSHOT~a481d0b8c2	1.34.0-SNAPSHOT~72e983bd69

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1714147234	1714147234
ci_job_id	498498175	498498175
ci_pipeline_id	33030263	33030263
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.378 s) : 15378000, 15378000
.   : milestone, 15378000,
appsec (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
iast (19.057 s) : 19057000, 19057000
.   : milestone, 19057000,
iast_GLOBAL (17.853 s) : 17853000, 17853000
.   : milestone, 17853000,
profiling (15.194 s) : 15194000, 15194000
.   : milestone, 15194000,
tracing (14.982 s) : 14982000, 14982000
.   : milestone, 14982000,
section candidate
no_agent (14.897 s) : 14897000, 14897000
.   : milestone, 14897000,
appsec (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
iast (18.71 s) : 18710000, 18710000
.   : milestone, 18710000,
iast_GLOBAL (18.055 s) : 18055000, 18055000
.   : milestone, 18055000,
profiling (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,
tracing (15.229 s) : 15229000, 15229000
.   : milestone, 15229000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.378 s [15.378 s, 15.378 s]	-
appsec	15.008 s [15.008 s, 15.008 s]	-370.0 ms (-2.4%)
iast	19.057 s [19.057 s, 19.057 s]	3.679 s (23.9%)
iast_GLOBAL	17.853 s [17.853 s, 17.853 s]	2.475 s (16.1%)
profiling	15.194 s [15.194 s, 15.194 s]	-184.0 ms (-1.2%)
tracing	14.982 s [14.982 s, 14.982 s]	-396.0 ms (-2.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.897 s [14.897 s, 14.897 s]	-
appsec	14.948 s [14.948 s, 14.948 s]	51.0 ms (0.3%)
iast	18.71 s [18.71 s, 18.71 s]	3.813 s (25.6%)
iast_GLOBAL	18.055 s [18.055 s, 18.055 s]	3.158 s (21.2%)
profiling	15.087 s [15.087 s, 15.087 s]	190.0 ms (1.3%)
tracing	15.229 s [15.229 s, 15.229 s]	332.0 ms (2.2%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~72e983bd69, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (2.197 ms) : 2164, 2231
.   : milestone, 2197,
iast (1.877 ms) : 1842, 1912
.   : milestone, 1877,
iast_GLOBAL (1.921 ms) : 1886, 1956
.   : milestone, 1921,
profiling (1.859 ms) : 1826, 1891
.   : milestone, 1859,
tracing (1.841 ms) : 1808, 1873
.   : milestone, 1841,
section candidate
no_agent (1.46 ms) : 1449, 1471
.   : milestone, 1460,
appsec (2.204 ms) : 2169, 2238
.   : milestone, 2204,
iast (1.898 ms) : 1862, 1934
.   : milestone, 1898,
iast_GLOBAL (1.912 ms) : 1878, 1947
.   : milestone, 1912,
profiling (1.835 ms) : 1801, 1868
.   : milestone, 1835,
tracing (1.83 ms) : 1797, 1862
.   : milestone, 1830,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.455 ms, 1.478 ms]	-
appsec	2.197 ms [2.164 ms, 2.231 ms]	730.62 µs (49.8%)
iast	1.877 ms [1.842 ms, 1.912 ms]	410.009 µs (28.0%)
iast_GLOBAL	1.921 ms [1.886 ms, 1.956 ms]	454.213 µs (31.0%)
profiling	1.859 ms [1.826 ms, 1.891 ms]	391.812 µs (26.7%)
tracing	1.841 ms [1.808 ms, 1.873 ms]	374.141 µs (25.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.46 ms [1.449 ms, 1.471 ms]	-
appsec	2.204 ms [2.169 ms, 2.238 ms]	743.788 µs (50.9%)
iast	1.898 ms [1.862 ms, 1.934 ms]	437.917 µs (30.0%)
iast_GLOBAL	1.912 ms [1.878 ms, 1.947 ms]	452.413 µs (31.0%)
profiling	1.835 ms [1.801 ms, 1.868 ms]	374.813 µs (25.7%)
tracing	1.83 ms [1.797 ms, 1.862 ms]	369.628 µs (25.3%)

chore: Mark test as flaky

72e983b

See #6957

PerfectSlayer added tag: flaky test Flaky tests tag: flaky test/disabled Disabled flaky tests inst: apache spark Apache Spark instrumentation labels Apr 26, 2024

PerfectSlayer requested a review from a team as a code owner April 26, 2024 15:27

paul-laffon-dd approved these changes Apr 26, 2024

View reviewed changes

PerfectSlayer merged commit 6bb68c4 into master Apr 29, 2024

PerfectSlayer deleted the bbujon/ci-flaky-integration-spark branch April 29, 2024 07:08

github-actions bot added this to the 1.34.0 milestone Apr 29, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Mark Spark integration test as flaky#6958

Mark Spark integration test as flaky#6958
PerfectSlayer merged 1 commit intomasterfrom
bbujon/ci-flaky-integration-spark

PerfectSlayer commented Apr 26, 2024 •

edited by atlassian bot

Loading

Uh oh!

paul-laffon-dd left a comment

Uh oh!

PerfectSlayer commented Apr 26, 2024 •

edited

Loading

Uh oh!

pr-commenter bot commented Apr 26, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

PerfectSlayer commented Apr 26, 2024 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Uh oh!

paul-laffon-dd left a comment

Choose a reason for hiding this comment

Uh oh!

PerfectSlayer commented Apr 26, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Apr 26, 2024

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

PerfectSlayer commented Apr 26, 2024 •

edited by atlassian bot

Loading

PerfectSlayer commented Apr 26, 2024 •

edited

Loading