[CI] MlJobIT testDeleteJob failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic-platform-support #5794 / ubuntu-2404_platform-support-unix
• elasticsearch-periodic #5740 / openjdk17_checkpart4_java-matrix

Reproduction Line:

./gradlew ":x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest" --tests "org.elasticsearch.xpack.ml.integration.MlJobIT.testOpenJobFailsWhenPersistentTaskAssignmentDisabled" -Dtests.seed=61432B611BDD1B90 -Dtests.locale=dsb-Latn-DE -Dtests.timezone=Australia/Lindeman -Druntime.java=23

Applicable branches:
8.x

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 2 active tasks found:
cluster:admin/xpack/ml/job/close    G7Os0IhiQoa5SZKi4hqBow:21495 -                            transport  1736642035891 00:33:55 2.8m        127.0.0.1 javaRestTest-1 
cluster:admin/xpack/ml/job/close[n] G7Os0IhiQoa5SZKi4hqBow:21499 G7Os0IhiQoa5SZKi4hqBow:21495 transport  1736642035898 00:33:55 2.8m        127.0.0.1 javaRestTest-1 
 expected:<0> but was:<2>

Issue Reasons:

• [8.x] 2 failures in test testDeleteJob (0.3% fail rate in 657 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/ml-core (Team:ML)