Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does not build with original Spark ML library #4

Open
shry15harsh opened this issue Jun 27, 2017 · 2 comments
Open

Does not build with original Spark ML library #4

shry15harsh opened this issue Jun 27, 2017 · 2 comments

Comments

@shry15harsh
Copy link

I get the error of missing getImpurityStats() method in Spark ML package. I checked the Dockerfile because in Docker it was running fine, then I found out that modified Spark distribution is used there in which this method has been added.
The pull request and the corresponding issue is still in progress on Spark JIRA. Nowhere in the steps, it is mentioned. Also, RedisLabs has written a lot about Spark-Redis integration on its website and Databricks gave presentation and tutorial. So I am wondering why nobody discussed it or is it just me for whom it is breaking?

@shry15harsh shry15harsh changed the title Does not build with original Spark library Does not build with original Spark ML library Jun 27, 2017
@shaynativ
Copy link
Contributor

Good point. On earlier versions the impurity stats weren't required. I'll try to speed up the pull request on Spark and meanwhile add this point the documentation.

@shry15harsh
Copy link
Author

Thanks. It would be really awesome if it gets in Spark. It would be really a scalable and fast model serving solution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants