Ensure en error during ShuffleRun.close cannot block worker shutdown

[fjetter]

Any error during ShuffleRun.close can block the shutdown since the condition will block until the run is cleaned up. The exception is otherwise not handled and never retrieved. Therefore, we're logging it and clean up the state.

An example of an exception that could happen here is the failure to remove files of the disk buffer. There are surely other "not great but OK" cases.

[github-actions]

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

       21 files  ±  0         21 suites  ±0   11h 3m 28s ⏱️ -18s
  3 817 tests +  1    3 705 ✔️  -   1     107 💤 ±0  5 ❌ +2 
36 895 runs  +20  35 091 ✔️ +23  1 799 💤  - 5  5 ❌ +2 

For more details on these failures, see this check.

Results for commit 2d9e1b6. ± Comparison against base commit 9895194.

♻️ This comment has been updated with latest results.