Partition stays in force configuration after force failover

[deepthidevaki]

In some failed e2e multi-region failover test, failback took long time because a partition did not come out of forced configuration for almost 1hr. Eventually it succeeds though, but the test failed because of the timeout. It is not expected to take so long. Coming out of force configuration should be done with in seconds after force configuration is succeeded.

Example of such a run: https://camunda.slack.com/archives/C013MEVQ4M9/p1711523599459309

We can see the following error repeated for almost 1 hour. Then eventually the operation succeeds (probably after a leader change.)

java.util.concurrent.CompletionException: io.atomix.primitive.PrimitiveException$Unavailable: Force configuration change is in progress. Cannot accept request from 3 which is not a member of the new configuration.
	at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.CompletableFuture$UniRun.tryFire(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) ~[?:?]
	at io.atomix.raft.impl.ReconfigurationHelper.lambda$joinWithRetry$5(ReconfigurationHelper.java:135) ~[zeebe-atomix-cluster-8.5.0-SNAPSHOT.jar:8.5.0-SNAPSHOT]
	at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.CompletableFuture$Completion.run(Unknown Source) ~[?:?]
	at io.atomix.utils.concurrent.SingleThreadContext$WrappedRunnable.run(SingleThreadContext.java:178) ~[zeebe-atomix-utils-8.5.0-SNAPSHOT.jar:8.5.0-SNAPSHOT]
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
	at java.base/java.lang.Thread.run(Unknown Source) [?:?]
Caused by: io.atomix.primitive.PrimitiveException$Unavailable: Force configuration change is in progress. Cannot accept request from 3 which is not a member of the new configuration.
	at io.atomix.raft.RaftError$Type$5.createException(RaftError.java:139) ~[zeebe-atomix-cluster-8.5.0-SNAPSHOT.jar:8.5.0-SNAPSHOT]
	at io.atomix.raft.RaftError.createException(RaftError.java:65) ~[zeebe-atomix-cluster-8.5.0-SNAPSHOT.jar:8.5.0-SNAPSHOT]
	at io.atomix.raft.impl.ReconfigurationHelper.lambda$joinWithRetry$5(ReconfigurationHelper.java:133) ~[zeebe-atomix-cluster-8.5.0-SNAPSHOT.jar:8.5.0-SNAPSHOT]
	... 10 more

related to #16126