Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] [MLLIB] Ordinary least square implementation #1560

Closed
wants to merge 3 commits into from

Conversation

falaki
Copy link
Contributor

@falaki falaki commented Jul 24, 2014

This is work in progress

Along with other statistical summaries we are interested in getting summary statistics for a linear regression model:

  • Standard deviation of estimated parameters
  • t-statistic and p-value for testing if estimated parameters may be equal to zero
  • R-squared and Adjusted R-squared
    Also possibly:
  • AIC
  • Leverage

We will be using SVD to solve the OLS and estimate above statistics.

@SparkQA
Copy link

SparkQA commented Jul 24, 2014

QA tests have started for PR 1560. This patch merges cleanly.
View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17086/consoleFull

@SparkQA
Copy link

SparkQA commented Jul 24, 2014

QA results for PR 1560:
- This patch FAILED unit tests.
- This patch merges cleanly
- This patch adds the following public classes (experimental):
class OrdinaryLeastSquares extends Optimizer with Logging {

For more information see test ouptut:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17086/consoleFull

@pwendell
Copy link
Contributor

Let's close this issue pending an update from @falaki .

@asfgit asfgit closed this in 1ac1c1d Jan 19, 2015
sunchao added a commit to sunchao/spark that referenced this pull request Jun 2, 2023
…o Apple Spark 3.2 (apache#1560)

This patch closes pie/boson#528 and pie/boson#529.

We've made quite a few changes in branch-3.2.0-boson-spark to enable all the tests with Boson extension enabled. As we are close to merge back to branch-3.2.0-spark, we can squash them into a single PR.

Co-authored-by: Chao Sun <sunchao@apache.org>
Co-authored-by: Liang-Chi Hsieh <viirya@gmail.com>
sunchao added a commit to sunchao/spark that referenced this pull request Jun 2, 2023
sunchao added a commit to sunchao/spark that referenced this pull request Jun 2, 2023
…o Apple Spark 3.2 (apache#1560)

This patch closes pie/boson#528 and pie/boson#529.

We've made quite a few changes in branch-3.2.0-boson-spark to enable all the tests with Boson extension enabled. As we are close to merge back to branch-3.2.0-spark, we can squash them into a single PR.

Co-authored-by: Chao Sun <sunchao@apache.org>
Co-authored-by: Liang-Chi Hsieh <viirya@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants