Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-10518][Docs]Update code examples in spark.ml user guide to use LIBSVM data source instead of MLUtils #8697

Closed
wants to merge 6 commits into from

Conversation

y-shimizu
Copy link
Contributor

I fixed to use LIBSVM data source in the example code in spark.ml instead of MLUtils

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@mengxr
Copy link
Contributor

mengxr commented Sep 10, 2015

@y-shimizu Please remove the MLUtils import if it is not used elsewhere. Also check whether RDD and LabeledPoint imports are used.

@@ -124,7 +124,7 @@ import org.apache.spark.ml.evaluation.MulticlassClassificationEvaluator
import org.apache.spark.mllib.util.MLUtils
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is no longer needed.

@y-shimizu
Copy link
Contributor Author

@mengxr I fixed. And sorry, I was wrong to use val in Java.

@mengxr
Copy link
Contributor

mengxr commented Sep 11, 2015

@y-shimizu The changes to ml-ensembles look good. But we also need to update other spark.ml guides, e..g, ml-features.md and ml-linear-methods.md. Please find the list on JIRA.

@y-shimizu
Copy link
Contributor Author

@mengxr I updated ml-features.md and ml-linear-methods.md .

@mengxr
Copy link
Contributor

mengxr commented Sep 11, 2015

LGTM. Merged into master. @y-shimizu I don't know your JIRA account name. Could you ping me on the JIRA page so I can assign it to you? Thanks!

@asfgit asfgit closed this in c268ca4 Sep 11, 2015
asfgit pushed a commit that referenced this pull request Nov 13, 2015
…dLibSVMFile to load DataFrame

Use LibSVM data source rather than MLUtils.loadLibSVMFile to load DataFrame, include:
* Use libSVM data source for all example codes under examples/ml, and remove unused import.
* Use libSVM data source for user guides under ml-*** which were omitted by #8697.
* Fix bug: We should use ```sqlContext.read().format("libsvm").load(path)``` at Java side, but the API doc and user guides misuse as ```sqlContext.read.format("libsvm").load(path)```.
* Code cleanup.

mengxr

Author: Yanbo Liang <ybliang8@gmail.com>

Closes #9690 from yanboliang/spark-11723.

(cherry picked from commit 99693fe)
Signed-off-by: Xiangrui Meng <meng@databricks.com>
asfgit pushed a commit that referenced this pull request Nov 13, 2015
…dLibSVMFile to load DataFrame

Use LibSVM data source rather than MLUtils.loadLibSVMFile to load DataFrame, include:
* Use libSVM data source for all example codes under examples/ml, and remove unused import.
* Use libSVM data source for user guides under ml-*** which were omitted by #8697.
* Fix bug: We should use ```sqlContext.read().format("libsvm").load(path)``` at Java side, but the API doc and user guides misuse as ```sqlContext.read.format("libsvm").load(path)```.
* Code cleanup.

mengxr

Author: Yanbo Liang <ybliang8@gmail.com>

Closes #9690 from yanboliang/spark-11723.
dskrvk pushed a commit to dskrvk/spark that referenced this pull request Nov 13, 2015
…dLibSVMFile to load DataFrame

Use LibSVM data source rather than MLUtils.loadLibSVMFile to load DataFrame, include:
* Use libSVM data source for all example codes under examples/ml, and remove unused import.
* Use libSVM data source for user guides under ml-*** which were omitted by apache#8697.
* Fix bug: We should use ```sqlContext.read().format("libsvm").load(path)``` at Java side, but the API doc and user guides misuse as ```sqlContext.read.format("libsvm").load(path)```.
* Code cleanup.

mengxr

Author: Yanbo Liang <ybliang8@gmail.com>

Closes apache#9690 from yanboliang/spark-11723.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants