Flaky test report: committed-code failures on 2026-06-18
Window: 24h ending 2026-06-18T10:19 UTC (i.e. roughly 2026-06-17T10:00 UTC → 2026-06-18T10:00 UTC).
Source: OpenSearch metrics cluster (gradle-check-* indices), filtered to Timer builds on main and Post Merge Action builds whose title starts with push trigger main. PR builds excluded.
Builds in window with at least one committed-code test failure: 6
| Build |
Started (UTC) |
Ref |
Trigger |
# failed test cases |
| 80721 |
2026-06-17T14:55Z |
main |
Timer |
1 |
| 80736 |
2026-06-17T18:35Z |
517db149c10 |
Post Merge |
1 |
| 80737 |
2026-06-17T18:55Z |
main |
Timer |
14 |
| 80746 |
2026-06-17T20:55Z |
main |
Timer |
1 |
| 80775 |
2026-06-18T04:40Z |
c68d7513fe9 |
Post Merge |
1 |
| 80790 |
2026-06-18T08:55Z |
main |
Timer |
2 |
Distinct failing tests: 19
Summary table
Sorted by total unique builds historically affected (across all build types). The build link is the most recent build in the 24h window where the test failed.
Per-test detail
Each item below covers a distinct failing test. "Pattern" classifies the most recent month vs. the prior history of monthly unique-build counts (worsening = ≥1.5× the historical mean, improving = ≤0.5×, stable = in between).
1. ConcurrentSeqNoVersioningIT.testSeqNoCASLinearizability
- Recent failing build: gradle-check #80790 — appeared in 1 build(s) in the 24h window: [80790]
- Full test name:
org.opensearch.versioning.ConcurrentSeqNoVersioningIT.testSeqNoCASLinearizability
- First seen failing (any build type): 2024-10-03
- Last seen failing: 2026-06-18
- Total unique builds historically affected: 141
- Total failure docs (all builds, all build types): 141
- Recent monthly unique-build counts (≤12 months): … 2025-07: 4, 2025-08: 4, 2025-09: 2, 2025-10: 6, 2025-11: 5, 2025-12: 4, 2026-01: 3, 2026-02: 10, 2026-03: 3, 2026-04: 35, 2026-05: 25, 2026-06: 16
- Pattern: worsening (last month 16 vs. historical mean 6.6)
- Local reproduction (seed
66AE0538828AEFAA): Did not reproduce. 1 attempt with seed 66AE0538828AEFAA passed in ~11s.
2. GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotAndRestore
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotAndRestore
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 17
- Total failure docs (all builds, all build types): 20
- Recent monthly unique-build counts (≤12 months): … 2024-07: 1, 2024-08: 1, 2025-02: 1, 2025-07: 1, 2025-09: 2, 2025-10: 1, 2025-11: 1, 2026-02: 1, 2026-03: 1, 2026-04: 2, 2026-05: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.2)
- Local reproduction (seed
C55443102101FA8): Could not run: gcs-fixture composeBuild requires docker buildx >= 0.17.0, dev desktop has older version.
3. WarmIndexSegmentReplicationIT.testRestartPrimaryAndReplicaWithDocuments
- Recent failing build: gradle-check #80790 — appeared in 2 build(s) in the 24h window: [80775, 80790]
- Full test name:
org.opensearch.indices.replication.WarmIndexSegmentReplicationIT.testRestartPrimaryAndReplicaWithDocuments
- First seen failing (any build type): 2025-09-23
- Last seen failing: 2026-06-18
- Total unique builds historically affected: 16
- Total failure docs (all builds, all build types): 16
- Recent monthly unique-build counts (≤12 months): 2025-09: 1, 2025-11: 3, 2025-12: 2, 2026-01: 1, 2026-02: 2, 2026-04: 2, 2026-05: 1, 2026-06: 4
- Pattern: worsening (last month 4 vs. historical mean 1.7)
- Local reproduction (seed
66AE0538828AEFAA): Did not reproduce. 1 attempt with seed 66AE0538828AEFAA passed in ~8s.
4. GoogleCloudStorageBlobStoreRepositoryTests.testRequestStats
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testRequestStats
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 14
- Total failure docs (all builds, all build types): 23
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-07: 1, 2024-08: 2, 2024-09: 1, 2024-11: 1, 2025-01: 1, 2025-02: 1, 2025-08: 1, 2026-03: 1, 2026-04: 1, 2026-05: 1, 2026-06: 2
- Pattern: worsening (last month 2 vs. historical mean 1.1)
- Local reproduction (seed
C55443102101FA8): Could not run: gcs-fixture composeBuild requires docker buildx >= 0.17.0, dev desktop has older version.
5. GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotWithLargeSegmentFiles
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotWithLargeSegmentFiles
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 11
- Total failure docs (all builds, all build types): 20
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-07: 1, 2024-08: 1, 2024-09: 1, 2024-11: 1, 2025-02: 1, 2025-08: 1, 2026-03: 2, 2026-06: 2
- Pattern: worsening (last month 2 vs. historical mean 1.1)
- Local reproduction (seed
C55443102101FA8): Could not run: gcs-fixture composeBuild requires docker buildx >= 0.17.0, dev desktop has older version.
6. NodeJoinLeftIT.testClusterStabilityWhenDisconnectDuringSlowNodeLeftTask
- Recent failing build: gradle-check #80736 — appeared in 1 build(s) in the 24h window: [80736]
- Full test name:
org.opensearch.cluster.coordination.NodeJoinLeftIT.testClusterStabilityWhenDisconnectDuringSlowNodeLeftTask
- First seen failing (any build type): 2025-06-09
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 11
- Total failure docs (all builds, all build types): 11
- Recent monthly unique-build counts (≤12 months): 2025-06: 2, 2025-08: 2, 2025-10: 1, 2025-11: 2, 2026-03: 2, 2026-04: 1, 2026-06: 1
- Pattern: stable (last month 1 vs. historical mean 1.7)
- Local reproduction (seed
7E6611AC2B4A4A2C): Did not reproduce. 1 attempt with seed 7E6611AC2B4A4A2C passed in ~29s.
7. GoogleCloudStorageBlobStoreRepositoryTests.testMultipleSnapshotAndRollback
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testMultipleSnapshotAndRollback
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 10
- Total failure docs (all builds, all build types): 16
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-07: 1, 2024-08: 2, 2024-11: 1, 2025-02: 1, 2026-05: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.2)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
8. GoogleCloudStorageBlobStoreRepositoryTests.testIndicesDeletedFromRepository
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testIndicesDeletedFromRepository
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 9
- Total failure docs (all builds, all build types): 12
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-07: 1, 2024-08: 1, 2024-11: 1, 2025-02: 1, 2026-03: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
9. GoogleCloudStorageBlobStoreRepositoryTests.testReadRange
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testReadRange
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 9
- Total failure docs (all builds, all build types): 12
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2024-11: 1, 2025-02: 1, 2025-08: 1, 2026-03: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
10. GoogleCloudStorageBlobStoreRepositoryTests.testWriteReadLarge
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testWriteReadLarge
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 9
- Total failure docs (all builds, all build types): 12
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2024-11: 1, 2025-02: 1, 2025-08: 1, 2026-03: 1, 2026-05: 1, 2026-06: 2
- Pattern: worsening (last month 2 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
11. GoogleCloudStorageBlobStoreRepositoryTests.testContainerCreationAndDeletion
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testContainerCreationAndDeletion
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 9
- Total failure docs (all builds, all build types): 9
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2024-11: 1, 2025-02: 1, 2026-03: 1, 2026-05: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
12. GoogleCloudStorageBlobStoreRepositoryTests.testDeleteBlobs
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testDeleteBlobs
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 9
- Total failure docs (all builds, all build types): 9
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2024-11: 1, 2025-02: 1, 2026-03: 1, 2026-04: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
13. GoogleCloudStorageBlobStoreRepositoryTests.testReadNonExistingPath
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testReadNonExistingPath
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 9
- Total failure docs (all builds, all build types): 9
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2024-11: 1, 2025-02: 1, 2026-03: 1, 2026-04: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
14. GoogleCloudStorageBlobStoreRepositoryTests.testDeleteSingleItem
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testDeleteSingleItem
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 8
- Total failure docs (all builds, all build types): 8
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2024-11: 1, 2025-02: 1, 2026-03: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
15. GoogleCloudStorageBlobStoreRepositoryTests.testWriteRead
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testWriteRead
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 7
- Total failure docs (all builds, all build types): 7
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2025-02: 1, 2026-03: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
16. GoogleCloudStorageBlobStoreRepositoryTests.testList
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testList
- First seen failing (any build type): 2024-04-15
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 6
- Total failure docs (all builds, all build types): 6
- Recent monthly unique-build counts (≤12 months): 2024-04: 1, 2024-08: 1, 2026-03: 1, 2026-06: 3
- Pattern: worsening (last month 3 vs. historical mean 1.0)
- Local reproduction (seed
(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.
17. IngestFromKafkaIT.testReplicaPromotionOnAllActiveIngestion
- Recent failing build: gradle-check #80746 — appeared in 1 build(s) in the 24h window: [80746]
- Full test name:
org.opensearch.plugin.kafka.IngestFromKafkaIT.testReplicaPromotionOnAllActiveIngestion
- First seen failing (any build type): 2026-02-11
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 3
- Total failure docs (all builds, all build types): 3
- Recent monthly unique-build counts (≤12 months): 2026-02: 1, 2026-03: 1, 2026-06: 1
- Pattern: stable (last month 1 vs. historical mean 1.0)
- Local reproduction (seed
B090793A40A127AC): Did not reproduce. 1 attempt with seed B090793A40A127AC passed in ~17s.
18. TransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPath
- Recent failing build: gradle-check #80737 — appeared in 1 build(s) in the 24h window: [80737]
- Full test name:
org.opensearch.storage.action.tiering.TransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPath
- First seen failing (any build type): 2026-06-17
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 1
- Total failure docs (all builds, all build types): 1
- Recent monthly unique-build counts (≤12 months): 2026-06: 1
- Pattern: new (only one month of data)
- Local reproduction (seed
C55443102101FA8): Did not reproduce. 1 attempt with seed C55443102101FA8 passed in ~5s.
19. TransportPrepareTieringActionTests.testShardOperationAsync_Timeout_FiresMergeDrainTimeoutException
- Recent failing build: gradle-check #80721 — appeared in 1 build(s) in the 24h window: [80721]
- Full test name:
org.opensearch.storage.action.tiering.TransportPrepareTieringActionTests.testShardOperationAsync_Timeout_FiresMergeDrainTimeoutException
- First seen failing (any build type): 2026-06-17
- Last seen failing: 2026-06-17
- Total unique builds historically affected: 1
- Total failure docs (all builds, all build types): 1
- Recent monthly unique-build counts (≤12 months): 2026-06: 1
- Pattern: new (only one month of data)
- Local reproduction (seed
625E0E1D19B5F2F7): Did not reproduce. 1 attempt with seed 625E0E1D19B5F2F7 passed in ~8s.
Notes on reproduction methodology
- The local clone's
main branch was 46 commits behind upstream and several failing tests are new test methods that don't exist on the local main. The local main was therefore left untouched. Reproductions ran against upstream/main (commit b53b8fe56fc) on a temporary detached HEAD. After reproductions, the clone was returned to its original state at 90fdbf95a0f, with the user's pre-existing staged changes restored from a stash.
- Each reproduction used the exact
REPRODUCE WITH: command line printed by the failing build (preserving tests.seed, tests.security.manager, tests.locale, tests.timezone, tests.jvm.argline, and runtime.java=25), against JAVA21_HOME for the build and JAVA25_HOME for the test runtime.
- Each reproduction was a single attempt. Per the project's flaky-test investigation guidance, a single seed-based attempt is informative but is not a determinism check; many of these tests have non-deterministic seeds (thread scheduling, GC pauses, network/socket timing). "Did not reproduce" here means "did not fail in this single attempt with the original seed/locale/timezone" and is not evidence the test is fixed.
- The 13
GoogleCloudStorageBlobStoreRepositoryTests tests could not be run locally: the gcs-fixture composeBuild task requires Docker Buildx ≥ 0.17.0, and the dev desktop has an older version. All 13 tests are in the same build (80737) and likely share an infrastructure-induced root cause: the failures show a mix of path is not accessible on cluster-manager node (repository verification) and Read timed out, iss: opensearch@appspot.gserviceaccount.com (GCS fixture I/O timeout), suggesting an unhealthy gcs-fixture container in that build rather than 13 independent test bugs. Build 80737 has 14 failures total; the 14th is TransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPath, which has an unrelated Mockito WantedButNotInvoked failure mode and is treated separately.
Honest caveats
- 6/7 attempted reproductions passed on a single run with the original seed. This is consistent with these being thread-scheduling / timing flakes whose seed does not control the failure. It is not evidence that any particular test is now fixed.
ConcurrentSeqNoVersioningIT.testSeqNoCASLinearizability is the dominant chronic flake in this dataset (141 unique builds, ~20 months of history) and is a known long-standing flake. Do not draw conclusions from a single passing run.
TransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPath and testShardOperationAsync_Timeout_FiresMergeDrainTimeoutException are brand-new test methods (introduced after the local main was last synced; both first failed today). The Mockito WantedButNotInvoked failure mode in builds 80737/80721 looks like a test-logic race rather than environmental sensitivity, but a single non-reproducing run is not enough to confirm.
WarmIndexSegmentReplicationIT.testRestartPrimaryAndReplicaWithDocuments failed in the most recent two committed-code timer/post-merge builds (80775 and 80790) with different seeds and different per-test locale/timezone. Both showed RefreshFailedEngineException: Refresh failed caused by CorruptIndexException: misplaced codec footer (file truncated?). Two consecutive committed-code failures within ~4 hours warrants attention even though the local repro did not pin it down.
- This report does not attempt root cause for any failure.
Flaky test report: committed-code failures on 2026-06-18
Window: 24h ending 2026-06-18T10:19 UTC (i.e. roughly 2026-06-17T10:00 UTC → 2026-06-18T10:00 UTC).
Source: OpenSearch metrics cluster (
gradle-check-*indices), filtered toTimerbuilds onmainandPost Merge Actionbuilds whose title starts withpush trigger main. PR builds excluded.Builds in window with at least one committed-code test failure: 6
main517db149c10mainmainc68d7513fe9mainDistinct failing tests: 19
Summary table
Sorted by total unique builds historically affected (across all build types). The build link is the most recent build in the 24h window where the test failed.
Per-test detail
Each item below covers a distinct failing test. "Pattern" classifies the most recent month vs. the prior history of monthly unique-build counts (worsening = ≥1.5× the historical mean, improving = ≤0.5×, stable = in between).
1.
ConcurrentSeqNoVersioningIT.testSeqNoCASLinearizabilityorg.opensearch.versioning.ConcurrentSeqNoVersioningIT.testSeqNoCASLinearizability66AE0538828AEFAA): Did not reproduce. 1 attempt with seed 66AE0538828AEFAA passed in ~11s.2.
GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotAndRestoreorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotAndRestoreC55443102101FA8): Could not run: gcs-fixture composeBuild requires docker buildx >= 0.17.0, dev desktop has older version.3.
WarmIndexSegmentReplicationIT.testRestartPrimaryAndReplicaWithDocumentsorg.opensearch.indices.replication.WarmIndexSegmentReplicationIT.testRestartPrimaryAndReplicaWithDocuments66AE0538828AEFAA): Did not reproduce. 1 attempt with seed 66AE0538828AEFAA passed in ~8s.4.
GoogleCloudStorageBlobStoreRepositoryTests.testRequestStatsorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testRequestStatsC55443102101FA8): Could not run: gcs-fixture composeBuild requires docker buildx >= 0.17.0, dev desktop has older version.5.
GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotWithLargeSegmentFilesorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testSnapshotWithLargeSegmentFilesC55443102101FA8): Could not run: gcs-fixture composeBuild requires docker buildx >= 0.17.0, dev desktop has older version.6.
NodeJoinLeftIT.testClusterStabilityWhenDisconnectDuringSlowNodeLeftTaskorg.opensearch.cluster.coordination.NodeJoinLeftIT.testClusterStabilityWhenDisconnectDuringSlowNodeLeftTask7E6611AC2B4A4A2C): Did not reproduce. 1 attempt with seed 7E6611AC2B4A4A2C passed in ~29s.7.
GoogleCloudStorageBlobStoreRepositoryTests.testMultipleSnapshotAndRollbackorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testMultipleSnapshotAndRollback(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.8.
GoogleCloudStorageBlobStoreRepositoryTests.testIndicesDeletedFromRepositoryorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testIndicesDeletedFromRepository(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.9.
GoogleCloudStorageBlobStoreRepositoryTests.testReadRangeorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testReadRange(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.10.
GoogleCloudStorageBlobStoreRepositoryTests.testWriteReadLargeorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testWriteReadLarge(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.11.
GoogleCloudStorageBlobStoreRepositoryTests.testContainerCreationAndDeletionorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testContainerCreationAndDeletion(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.12.
GoogleCloudStorageBlobStoreRepositoryTests.testDeleteBlobsorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testDeleteBlobs(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.13.
GoogleCloudStorageBlobStoreRepositoryTests.testReadNonExistingPathorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testReadNonExistingPath(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.14.
GoogleCloudStorageBlobStoreRepositoryTests.testDeleteSingleItemorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testDeleteSingleItem(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.15.
GoogleCloudStorageBlobStoreRepositoryTests.testWriteReadorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testWriteRead(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.16.
GoogleCloudStorageBlobStoreRepositoryTests.testListorg.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.testList(seed not extracted)): Not attempted; same gcs-fixture composeBuild docker requirement blocks all tests in this class.17.
IngestFromKafkaIT.testReplicaPromotionOnAllActiveIngestionorg.opensearch.plugin.kafka.IngestFromKafkaIT.testReplicaPromotionOnAllActiveIngestionB090793A40A127AC): Did not reproduce. 1 attempt with seed B090793A40A127AC passed in ~17s.18.
TransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPathorg.opensearch.storage.action.tiering.TransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPathC55443102101FA8): Did not reproduce. 1 attempt with seed C55443102101FA8 passed in ~5s.19.
TransportPrepareTieringActionTests.testShardOperationAsync_Timeout_FiresMergeDrainTimeoutExceptionorg.opensearch.storage.action.tiering.TransportPrepareTieringActionTests.testShardOperationAsync_Timeout_FiresMergeDrainTimeoutException625E0E1D19B5F2F7): Did not reproduce. 1 attempt with seed 625E0E1D19B5F2F7 passed in ~8s.Notes on reproduction methodology
mainbranch was 46 commits behind upstream and several failing tests are new test methods that don't exist on the localmain. The localmainwas therefore left untouched. Reproductions ran againstupstream/main(commitb53b8fe56fc) on a temporary detachedHEAD. After reproductions, the clone was returned to its original state at90fdbf95a0f, with the user's pre-existing staged changes restored from a stash.REPRODUCE WITH:command line printed by the failing build (preservingtests.seed,tests.security.manager,tests.locale,tests.timezone,tests.jvm.argline, andruntime.java=25), againstJAVA21_HOMEfor the build andJAVA25_HOMEfor the test runtime.GoogleCloudStorageBlobStoreRepositoryTeststests could not be run locally: thegcs-fixturecomposeBuildtask requires Docker Buildx ≥ 0.17.0, and the dev desktop has an older version. All 13 tests are in the same build (80737) and likely share an infrastructure-induced root cause: the failures show a mix ofpath is not accessible on cluster-manager node(repository verification) andRead timed out, iss: opensearch@appspot.gserviceaccount.com(GCS fixture I/O timeout), suggesting an unhealthygcs-fixturecontainer in that build rather than 13 independent test bugs. Build 80737 has 14 failures total; the 14th isTransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPath, which has an unrelated MockitoWantedButNotInvokedfailure mode and is treated separately.Honest caveats
ConcurrentSeqNoVersioningIT.testSeqNoCASLinearizabilityis the dominant chronic flake in this dataset (141 unique builds, ~20 months of history) and is a known long-standing flake. Do not draw conclusions from a single passing run.TransportPrepareTieringActionTests.testShardOperationAsync_PermitClosedOnTimeoutPathandtestShardOperationAsync_Timeout_FiresMergeDrainTimeoutExceptionare brand-new test methods (introduced after the localmainwas last synced; both first failed today). The MockitoWantedButNotInvokedfailure mode in builds 80737/80721 looks like a test-logic race rather than environmental sensitivity, but a single non-reproducing run is not enough to confirm.WarmIndexSegmentReplicationIT.testRestartPrimaryAndReplicaWithDocumentsfailed in the most recent two committed-code timer/post-merge builds (80775 and 80790) with different seeds and different per-test locale/timezone. Both showedRefreshFailedEngineException: Refresh failedcaused byCorruptIndexException: misplaced codec footer (file truncated?). Two consecutive committed-code failures within ~4 hours warrants attention even though the local repro did not pin it down.