Skip to content

Commit

Permalink
[SPARK-21953] Show both memory and disk bytes spilled if either is pr…
Browse files Browse the repository at this point in the history
…esent

As written now, there must be both memory and disk bytes spilled to show either of them. If there is only one of those types of spill recorded, it will be hidden.

Author: Andrew Ash <andrew@andrewash.com>

Closes #19164 from ash211/patch-3.

(cherry picked from commit 6308c65)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
  • Loading branch information
ash211 authored and cloud-fan committed Sep 18, 2017
1 parent 3ae7ab8 commit 99de4b8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,7 @@ private[spark] object UIData {
def hasOutput: Boolean = outputBytes > 0
def hasShuffleRead: Boolean = shuffleReadTotalBytes > 0
def hasShuffleWrite: Boolean = shuffleWriteBytes > 0
def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 && diskBytesSpilled > 0
def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 || diskBytesSpilled > 0
}

/**
Expand Down

0 comments on commit 99de4b8

Please sign in to comment.