Skip to content

Commit

Permalink
Update core/src/main/scala/org/apache/spark/shuffle/IndexShuffleBlock…
Browse files Browse the repository at this point in the history
…Resolver.scala


If we have a failure during block migration, log the exception.

Co-authored-by: Attila Zsolt Piros <2017933+attilapiros@users.noreply.github.com>
  • Loading branch information
holdenk and attilapiros committed Jun 3, 2020
1 parent b2da4c5 commit 7dde80e
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -226,6 +226,7 @@ private[spark] class IndexShuffleBlockResolver(

override def onFailure(streamId: String, cause: Throwable): Unit = {
// the framework handles the connection itself, we just need to do local cleanup
logWarning(s"Error while uploading $blockId", cause)
channel.close()
fileTmp.delete()
}
Expand Down

0 comments on commit 7dde80e

Please sign in to comment.