Flaky test report: committed-code failures on 2026-04-26

[andrross]

Flaky test report: committed-code failures on 2026-04-26

Overview

5 test failures were detected across 3 Timer/main builds in the past 24 hours, covering 4 distinct tests.

Summary Table

#	Test	Builds Affected (all-time)	First Seen	Reproduced Locally?
1	SmokeTestMultiNodeClientYamlTestSuiteIT (string profiler via global ordinals)	49	2024-03-26	No
2	InternalDistributionBwcSetupPluginFuncTest.builds distribution from branches via archives assemble	33	2025-10-23	Yes
3	InternalDistributionBwcSetupPluginFuncTest.bwc distribution archives can be resolved as bwc project artifact	21	2025-10-23	Yes
4	WarmIndexSegmentReplicationIT.testRealtimeTermVectorRequestsSuccessful	14	2025-03-17	No
5	SimpleSearchIT.testIndexOnlyFloatField (concurrent segment search)	6	2026-04-17	No

Detailed Findings

1. SmokeTestMultiNodeClientYamlTestSuiteIT — string profiler via global ordinals

• Recent build: #75130
• Seed: 41033A35F25879DD
• Reproduced locally: No — test passed with the same seed
• First seen: 2024-03-26
• Total unique builds affected: 49
• Monthly pattern:
  • 2024: Mar(1), Apr(1), Jun(2), Jul(2), Aug(5), Sep(2), Oct(4), Dec(2)
  • 2025: Jan(1), Feb(1), Apr(2), Jun(2), Jul(1), Aug(3), Sep(4), Oct(5), Nov(1), Dec(2)
  • 2026: Jan(2), Feb(1), Mar(3), Apr(2)
• Pattern: Stable, low-frequency flake. Has been failing consistently at 1-5 builds/month for over 2 years. No trend of improvement or worsening.

2. InternalDistributionBwcSetupPluginFuncTest — builds distribution from branches via archives assemble

• Recent build: #75114
• Seed: N/A (Gradle functional test, not randomized)
• Reproduced locally: Yes — all methods in this test class fail deterministically with UnexpectedBuildFailure
• First seen: 2025-10-23
• Total unique builds affected: 33
• Monthly pattern: Oct-2025(15), Nov(2), Dec(6), Jan-2026(2), Feb(5), Mar(2), Apr(1)
• Pattern: Started with a burst in Oct 2025, then settled to a steady flake rate. The failure reproduces locally, suggesting it may be an environment-sensitive issue in the Gradle test kit setup rather than a timing flake.

3. InternalDistributionBwcSetupPluginFuncTest — bwc distribution archives can be resolved as bwc project artifact

• Recent build: #75114
• Seed: N/A (Gradle functional test, not randomized)
• Reproduced locally: Yes — same as above, fails deterministically
• First seen: 2025-10-23
• Total unique builds affected: 21
• Pattern: Same root cause as Bump com.diffplug.spotless from 5.6.1 to 6.2.1 #2 above. Always co-occurs with the other BwcSetup test failures.

4. WarmIndexSegmentReplicationIT.testRealtimeTermVectorRequestsSuccessful

• Recent build: #75130
• Seed: 41033A35F25879DD
• Reproduced locally: No — test passed with the same seed
• First seen: 2025-03-17
• Total unique builds affected: 14
• Monthly pattern: Mar-2025(1), Jul(2), Aug(1), Sep(1), Oct(1), Nov(1), Dec(2), Jan-2026(2), Mar(2), Apr(1)
• Pattern: Stable, low-frequency flake at ~1-2 builds/month. Likely a race condition in segment replication that doesn't reproduce outside CI.

5. SimpleSearchIT.testIndexOnlyFloatField (concurrent segment search enabled)

• Recent build: #75132
• Seed: 9C443CA4A155D3FF
• Reproduced locally: No — test passed with the same seed
• First seen: 2026-04-17
• Total unique builds affected: 6
• Monthly pattern: Apr-2026(6) — all failures in the current month
• Pattern: New and worsening. This test only started failing 9 days ago and has already hit 6 builds. This is the most concerning test on this list as it appears to be a recent regression.