Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

setup an cluster in azure #47

Open
TonyAbell opened this issue Sep 15, 2015 · 3 comments
Open

setup an cluster in azure #47

TonyAbell opened this issue Sep 15, 2015 · 3 comments

Comments

@TonyAbell
Copy link
Contributor

Looking at the examples it looks like one can pass in a PrajnaClusterFile

I can not see a sample Prajna Cluster File.

Also, it is not clear how to setup a cluster in a cloud provider like Azure, any guidance would be appreciated.

@zhuweirong
Copy link
Contributor

Thanks Tony. Yes, we are aware of the lack of information on how to setup a cluster. We are in the process of providing the instructions/scripts for various scenarios. It will start with a cluster of windows domain joined machines, then we will also provide similar instructions/scripts for Azure.

@antogh
Copy link

antogh commented Sep 21, 2015

Hello Weirong Zhu,
please, if you can , try to give us a simplified cluster setup like Spark standalone (described here)
http://spark.apache.org/docs/latest/spark-standalone.html
this way even solo/small developers can test Prajna in their free time at home on their own pc or group of pcs without having to use expensive server licenses or cloud subscription (with credit card => $$$), that's good for production but for just taking confidence with the suite something simple I believe would really help this new product to spread rapidly.
One more question, I'm just curious, Spark is known to be built on top of Akka with Scala, Prajna was written in F# (quite similar to scala). Did you use also an actor model framework like Akka? If yes what did you use? Thanks. Antonio

@zhuweirong
Copy link
Contributor

Hi antogh,

Currently, the deployment instruction we have is similar to Spark's standalone mode. Please check out https://github.com/MSRCCS/Prajna/wiki/Use-Prajna (also specifically for deployment: https://github.com/MSRCCS/Prajna/wiki/Deploy-Prajna). Please let us know if you hit any problems.

Regarding to questions on Prajna internals, please refer to http://msrccs.github.io/Prajna/paper/Prajna_v1.pdf for Prajna technical implementation details.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants