Skip to content

Commit

Permalink
[SPARK-21953] Show both memory and disk bytes spilled if either is pr…
Browse files Browse the repository at this point in the history
…esent

As written now, there must be both memory and disk bytes spilled to show either of them. If there is only one of those types of spill recorded, it will be hidden.

Author: Andrew Ash <andrew@andrewash.com>

Closes apache#19164 from ash211/patch-3.

(cherry picked from commit 6308c65)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
  • Loading branch information
ash211 authored and MatthewRBruce committed Jul 31, 2018
1 parent ae8ac94 commit 21b3e1e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,7 @@ private[spark] object UIData {
def hasOutput: Boolean = outputBytes > 0
def hasShuffleRead: Boolean = shuffleReadTotalBytes > 0
def hasShuffleWrite: Boolean = shuffleWriteBytes > 0
def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 && diskBytesSpilled > 0
def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 || diskBytesSpilled > 0
}

/**
Expand Down

0 comments on commit 21b3e1e

Please sign in to comment.