New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SW-2628] Support Java Serialization of NullableDataFrameParams on H2OMOJOModel #2659
Conversation
…rams on H2OMOJOModel
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
@@ -39,6 +39,7 @@ import org.apache.spark.expose.Logging | |||
import org.apache.spark.ml.Model | |||
import org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema | |||
import org.apache.spark.sql.types._ | |||
import ai.h2o.sparkling.utils.DataFrameSerializationWrappers._ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is the additional import needed here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, here for example. $(crossValidationMetricsSummary)
returns DataFrameSerializationWrapper
and imported implicit method toDataFrame
will look after the conversion to DataFrame
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 👍
btw. I'm wondering if it could be possible to use some custom data structure instead of dataframes in the future for params
ml/src/test/scala/ai/h2o/sparkling/ml/models/H2OMOJOModelTestSuite.scala
Outdated
Show resolved
Hide resolved
DataFrames might be too big gun for such a small task. I went for data frames since binding for Python and R is for free and it's API is well defined and well-known. I'm open to ideas for improvements, but we must be careful with breaking changes. |
No description provided.