Please sign in to comment.
[SPARK-22883][ML] ML test for StructuredStreaming: spark.ml.feature, I-M
This backports #20964 to branch-2.3. ## What changes were proposed in this pull request? Adds structured streaming tests using testTransformer for these suites: * IDF * Imputer * Interaction * MaxAbsScaler * MinHashLSH * MinMaxScaler * NGram ## How was this patch tested? It is a bunch of tests! Author: Joseph K. Bradley <josephdatabricks.com> Author: Joseph K. Bradley <email@example.com> Closes #21042 from jkbradley/SPARK-22883-part2-2.3backport.
- Loading branch information...
Showing with 89 additions and 57 deletions.
- +6 −8 mllib/src/test/scala/org/apache/spark/ml/feature/IDFSuite.scala
- +25 −6 mllib/src/test/scala/org/apache/spark/ml/feature/ImputerSuite.scala
- +24 −22 mllib/src/test/scala/org/apache/spark/ml/feature/InteractionSuite.scala
- +7 −7 mllib/src/test/scala/org/apache/spark/ml/feature/MaxAbsScalerSuite.scala
- +20 −5 mllib/src/test/scala/org/apache/spark/ml/feature/MinHashLSHSuite.scala
- +6 −8 mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala
- +1 −1 mllib/src/test/scala/org/apache/spark/ml/feature/NGramSuite.scala