[SPARK-45669][CORE] Ensure the continuity of rolling log index

[shuyouZZ]

What changes were proposed in this pull request?

Ensure the continuity of rolling log index.

Why are the changes needed?

Current the log file index will increment before running initLogFile(). When running rollEventlogFile(), the index will increment first, then create new log file to init event log writer.

If the log file creation fails, initLogFile() will throw an exception and stop running the method. The log file index will still increment next time rollEventLogFile() is called,
which will cause the file index to become discontinuous. EventLogFileReader can not read the event log files normally.

Therefore, we need to update the logic here to ensure the continuity of rolling log index.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Existing unit test

Was this patch authored or co-authored using generative AI tooling?

No

[AngersZhuuuu]

ping @dongjoon-hyun @srowen @cloud-fan Could you take a review about this history server issue?

[github-actions]

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!