Skip to content

Commit

Permalink
init pr
Browse files Browse the repository at this point in the history
  • Loading branch information
WeichenXu123 committed Dec 25, 2017
1 parent 33ae243 commit 1216100
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -165,7 +165,7 @@ final class OneVsRestModel private[ml] (
val newDataset = dataset.withColumn(accColName, initUDF())

// persist if underlying dataset is not persistent.
val handlePersistence = dataset.storageLevel == StorageLevel.NONE
val handlePersistence = !dataset.isStreaming && dataset.storageLevel == StorageLevel.NONE
if (handlePersistence) {
newDataset.persist(StorageLevel.MEMORY_AND_DISK)
}
Expand Down

0 comments on commit 1216100

Please sign in to comment.