Skip to content

Commit

Permalink
Use the remoteBlockSize param in the tests instead of conditioning on…
Browse files Browse the repository at this point in the history
… if we're testing shuffles or not
  • Loading branch information
holdenk committed Jun 1, 2020
1 parent 4cfeb8e commit e81aa5a
Showing 1 changed file with 2 additions and 4 deletions.
Expand Up @@ -66,10 +66,8 @@ class BlockManagerDecommissionSuite extends SparkFunSuite with LocalSparkContext
// workload we need to worry about.
.set(config.STORAGE_DECOMMISSION_REPLICATION_REATTEMPT_INTERVAL, 1L)

// Force fetching to local disk
if (shuffle) {
conf.set("spark.network.maxRemoteBlockSizeFetchToMem", "1")
}
// Allow force fetching to local disk
conf.set("spark.network.maxRemoteBlockSizeFetchToMem", remoteBlockSize)

sc = new SparkContext(master, "test", conf)

Expand Down

0 comments on commit e81aa5a

Please sign in to comment.