Handle intermediate change of status in pause method

[suraj-goel]

Fixes #17722.

Description

Fixed the bug

• After upgrading to Druid-30, One task is occasionally failing per day.
• Task fails with the following exception:

Can't pause, task is not in a pausable state (state: [PAUSED])

• Logs were added to debug the issue: [rcca-25570] Add log lines in pause method confluentinc/druid#304
• Logs when the task failed:

Feb 12, 2025 @ 15:21:08.165	Pausing the task with state: [READING]

Feb 12, 2025 @ 15:21:08.165	Returning 409 conflict for task with state: [PAUSED]

• As per the above logs, status is changing during the evaluation of the if statement.

Release note

---

Key changed/added classes in this PR

• SeekableStreamIndexTaskRunner.java

---

This PR has:

• been self-reviewed.
  • using the concurrency checklist (Remove this item if the PR doesn't have any relation to concurrency.)
• added documentation for new or modified features or behaviors.
• a release note entry in the PR description.
• added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
• added or updated version, license, or notice information in licenses.yaml
• added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
• added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
• added integration tests.
• been tested in a test Druid cluster.

[kfaraz]

Thanks for the PR, @suraj-goel !
I have left some thoughts. Let me know what you think.

[kfaraz]

Changes look good to me.
Left some minor suggestions.

[suraj-goel]

Changes look good to me. Left some minor suggestions.

@kfaraz , I have addressed the comments.