when spark job had ran in k8s is finished ,it register to shutdown ho…

[lfspace]

What changes were proposed in this pull request?
In k8s the host-path config to spark-local-dir ,Spark job clearup the shuffle tmp dirs when it is finished.

Why are the changes needed?
The shuffle data will filled the disks of tmp dirs.

Does this PR introduce any user-facing change?

How was this patch tested?
In yaml config:

driver:
    volumeMounts:
      - name: "spark-local-dir-1"
        mountPath: "/shuff/data"
executor:
    volumeMounts:
      - name: "spark-local-dir-1"
        mountPath: "/shuff/data"

[AmplabJenkins]

Can one of the admins verify this patch?

[srowen]

Please read https://spark.apache.org/contributing.html

[github-actions]

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!