[CI] SearchWithRandomDisconnectsIT testSearchWithRandomDisconnects failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-intake #31379 / part1
• elasticsearch-intake #31241 / part1

Reproduction Line:

./gradlew ":server:internalClusterTest" --tests "org.elasticsearch.search.basic.SearchWithRandomDisconnectsIT.testSearchWithRandomDisconnects" -Dtests.seed=98A9691449CF97F5 -Dtests.locale=uz-Cyrl-UZ -Dtests.timezone=Etc/GMT+9 -Druntime.java=25

Applicable branches:
9.2

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.IllegalStateException: org.elasticsearch.ElasticsearchTimeoutException: java.util.concurrent.TimeoutException: Timeout waiting for task.

Issue Reasons:

• [9.2] 2 failures in test testSearchWithRandomDisconnects (1.6% fail rate in 122 executions)
• [9.2] 2 failures in step part1 (9.1% fail rate in 22 executions)
• [9.2] 2 failures in pipeline elasticsearch-intake (9.1% fail rate in 22 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 3 failures in test testSearchWithRandomDisconnects (0.3% fail rate in 948 executions)
• [main] 2 failures in step part-1 (0.3% fail rate in 595 executions)
• [main] 2 failures in pipeline elasticsearch-pull-request (0.3% fail rate in 592 executions)

Build Scans:

• elasticsearch-periodic-platform-support #11421 / amazonlinux-2023_platform-support-aws
• elasticsearch-pull-request #103810 / part-1
• elasticsearch-pull-request #103072 / part-1

[elasticsearchmachine]

Pinging @elastic/es-search-foundations (Team:Search Foundations)

[elasticsearchmachine]

This has been muted on branch 9.2

Mute Reasons:

• [9.2] 2 failures in test testSearchWithRandomDisconnects (1.6% fail rate in 122 executions)
• [9.2] 2 failures in step part1 (9.1% fail rate in 22 executions)
• [9.2] 2 failures in pipeline elasticsearch-intake (9.1% fail rate in 22 executions)

Build Scans:

• elasticsearch-intake #31379 / part1
• elasticsearch-intake #31241 / part1