Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows sparkling-shell cannot find version #97

Closed
NoahMarconi opened this issue Sep 30, 2016 · 4 comments
Closed

Windows sparkling-shell cannot find version #97

NoahMarconi opened this issue Sep 30, 2016 · 4 comments

Comments

@NoahMarconi
Copy link

Hi, testing out using windows and I'm getting an error after the cmd script fails to find a versions nubmer:

sparkling-shell --conf "spark.executor.memory=1g"
find: 'version': No such file or directory
You are trying to use Sparkling Water built for Spark , but your %SPARK_HOME(=C:/spark-2.0.0-bin-hadoop2.7) property points to Spark of version ~-5. Please ensure correct Spark is provided and re-run Sparkling Water.
@mmalohlava
Copy link
Member

Hi @NoahMarconi ,

thanks for bug report. Spark slightly change CLI and for some reason --version expects an additional parameter. It is fix on linux, but we leaked the problem into Windows distrib.

We will fix it in the following SW release.

Thank you!

@NoahMarconi
Copy link
Author

Sounds good, I'm just kicking the tires at the moment so I can run in a linux vm in the meantime.

@jakubhava
Copy link
Contributor

Starting to work on the issue. It's actually related to all spark versions, since there is a bug in windows script. Hopefully will provide fix soon

@jakubhava
Copy link
Contributor

problem solved, please this this PR #100. Once the review is done the change will be merged into master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants