Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update path from /root/spark/sbin/ to /root/spark/bin #159

Open
M1chaelM opened this issue Sep 1, 2014 · 2 comments
Open

update path from /root/spark/sbin/ to /root/spark/bin #159

M1chaelM opened this issue Sep 1, 2014 · 2 comments

Comments

@M1chaelM
Copy link

M1chaelM commented Sep 1, 2014

The path to various bash scrips seems to be incorrect in both spark-ec2.py and /root/spark-ec2/spark-standalone/setup.sh. It's easy to fix the first one; not sure about the second.

@JoshRosen
Copy link
Member

Hi @M1chaelM,

Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.

@M1chaelM
Copy link
Author

M1chaelM commented Sep 1, 2014

That sounds likely. :) I believe I’m following the directions for ampcamp4. The instructions for using us-west-1 give ami-6ac4ee2f (see http://ampcamp.berkeley.edu/big-data-mini-course/launching-a-bdas-cluster-on-ec2.html under "Can I use a EC2 region other than us-east-1 while creating the cluster?”)

I created a key-pair for the east region and rerunning the launch command shows that the most recent ami is ami-19474270. This seems to be working now.

Thank you!

On Sep 1, 2014, at 1:32 PM, Josh Rosen notifications@github.com wrote:

Hi @M1chaelM,

Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.


Reply to this email directly or view it on GitHub.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants