Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-13153][PySpark] ML persistence failed when handle no default value parameter #11043

Closed

Conversation

Wenpei
Copy link
Contributor

@Wenpei Wenpei commented Feb 3, 2016

Fix this defect by check default value exist or not.

@yanboliang Please help to review.

@@ -79,8 +79,9 @@ def _transfer_params_from_java(self):
for param in self.params:
if self._java_obj.hasParam(param.name):
java_param = self._java_obj.getParam(param.name)
value = _java2py(sc, self._java_obj.getOrDefault(java_param))
self._paramMap[param] = value
if self._java_obj.hasDefault(java_param):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should check by isDefined rather than hasDefault here.

@yanboliang
Copy link
Contributor

ping @mengxr @jkbradley
Could you add @Wenpei to white list ? This is an obvious bug and we should fix it.

@Wenpei
Copy link
Contributor Author

Wenpei commented Feb 3, 2016

It's OK now and ready to launch test.

@mengxr
Copy link
Contributor

mengxr commented Feb 12, 2016

ok to test

@mengxr
Copy link
Contributor

mengxr commented Feb 12, 2016

LGTM pending Jenins

@SparkQA
Copy link

SparkQA commented Feb 12, 2016

Test build #51161 has finished for PR 11043 at commit 06e06f7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

asfgit pushed a commit that referenced this pull request Feb 12, 2016
…alue parameter

Fix this defect by check default value exist or not.

yanboliang Please help to review.

Author: Tommy YU <tummyyu@163.com>

Closes #11043 from Wenpei/spark-13153-handle-param-withnodefaultvalue.

(cherry picked from commit d3e2e20)
Signed-off-by: Xiangrui Meng <meng@databricks.com>
@mengxr
Copy link
Contributor

mengxr commented Feb 12, 2016

Merged into master and branch-1.6. Thanks!

@asfgit asfgit closed this in d3e2e20 Feb 12, 2016
@Wenpei Wenpei deleted the spark-13153-handle-param-withnodefaultvalue branch February 15, 2016 03:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants