[CI] MultiVersionRepositoryAccessIT testReadOnlyRepo failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic #4452 / 8.1.3_bwc
• elasticsearch-periodic #4452 / 8.4.3_bwc
• elasticsearch-periodic #4452 / 8.0.1_bwc
• elasticsearch-periodic #4452 / 8.2.3_bwc
• elasticsearch-pull-request #36940 / 8.3.3_bwc
• elasticsearch-pull-request #36940 / 8.1.3_bwc
• elasticsearch-pull-request #36940 / 8.4.3_bwc
• elasticsearch-pull-request #36940 / 8.0.1_bwc

Reproduction Line:

./gradlew ":qa:repository-multi-version:v8.0.1#Step1OldClusterTest" -Dtests.class="org.elasticsearch.upgrades.MultiVersionRepositoryAccessIT" -Dtests.method="testUpgradeMovesRepoToNewMetaVersion" -Dtests.seed=ADED53BA5FEB4D62 -Dtests.bwc=true -Dtests.locale=hr -Dtests.timezone=America/Anguilla -Druntime.java=22

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

org.elasticsearch.client.ResponseException: method [DELETE], host [http://127.0.0.1:36545], URI [_snapshot/testUpgradeMovesRepoToNewMetaVersion], status line [HTTP/1.1 404 Not Found]
{"error":{"root_cause":[{"type":"repository_missing_exception","reason":"[testUpgradeMovesRepoToNewMetaVersion] missing"}],"type":"repository_missing_exception","reason":"[testUpgradeMovesRepoToNewMetaVersion] missing"},"status":404}

Issue Reasons:

• [main] 4 consecutive failures in test testReadOnlyRepo
• [main] 2 consecutive failures in step 8.1.3_bwc
• [main] 2 consecutive failures in step 8.4.3_bwc
• [main] 2 consecutive failures in step 8.0.1_bwc
• [main] 8 failures in test testReadOnlyRepo (0.8% fail rate in 1000 executions)
• [main] 2 failures in step 8.1.3_bwc (50.0% fail rate in 4 executions)
• [main] 2 failures in step 8.4.3_bwc (50.0% fail rate in 4 executions)
• [main] 2 failures in step 8.0.1_bwc (50.0% fail rate in 4 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 4 consecutive failures in test testReadOnlyRepo
• [main] 2 consecutive failures in step 8.1.3_bwc
• [main] 2 consecutive failures in step 8.4.3_bwc
• [main] 2 consecutive failures in step 8.0.1_bwc
• [main] 8 failures in test testReadOnlyRepo (0.8% fail rate in 1000 executions)
• [main] 2 failures in step 8.1.3_bwc (50.0% fail rate in 4 executions)
• [main] 2 failures in step 8.4.3_bwc (50.0% fail rate in 4 executions)
• [main] 2 failures in step 8.0.1_bwc (50.0% fail rate in 4 executions)

Build Scans:

• elasticsearch-periodic #4452 / 8.1.3_bwc
• elasticsearch-periodic #4452 / 8.4.3_bwc
• elasticsearch-periodic #4452 / 8.0.1_bwc
• elasticsearch-periodic #4452 / 8.2.3_bwc
• elasticsearch-pull-request #36940 / 8.3.3_bwc
• elasticsearch-pull-request #36940 / 8.1.3_bwc
• elasticsearch-pull-request #36940 / 8.4.3_bwc
• elasticsearch-pull-request #36940 / 8.0.1_bwc

[elasticsearchmachine]

Pinging @elastic/es-storage-engine (Team:StorageEngine)

[elasticsearchmachine]

Pinging @elastic/es-distributed (Team:Distributed)

[pxsalehi]

I'm not sure why the title says testReadOnlyRepo but the reproduction line is for testUpgradeMovesRepoToNewMetaVersion. I'll close this since testUpgradeMovesRepoToNewMetaVersion already has an open issue. (It also doesn't fail locally). Might be interesting for @brianseeders.