[SPARK-44704][CORE] Cleanup files from host node after migration due to graceful decommissioning

[Deependra-Patel]

What changes were proposed in this pull request?

Deleting files on executor exit when migration is enabled

Why are the changes needed?

1. This will release extra disk space on the node reducing the failures due to disk running out of space
2. If there is no shuffle data then YARN can decommission the node right away. Needs this other PR to be merged to expose this metric to YARN [SPARK-44209] Expose amount of shuffle data available on the node #42071

Does this PR introduce any user-facing change?

No

How was this patch tested?

Tested manually.
Will add unit tests once we get traction on this PR

[github-actions]

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!