Spark cluster installer
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
spark_config
README.md
install-spark.sh

README.md

Install Spark Cluster with shell script

Spark install script for debian and Ubuntu. but only tested in Ubuntu Server 16.04.

The script will let you setup a 3 node Spark cluster in no more than 10 minutes.

Installation in a node

sudo -s
su -
git clone https://github.com/chih7/spark-install.git
cd ./spark_install
./install-spark.sh
reboot

Done

Run as a cluster

clone the machine or install spark in other machine with the script.

note the ip address must same with the script.

in spark master machine

sudo -s
su -
vim  /usr/local/spark/conf/spark-env.sh # change  SPARK_LOCAL_IP=spark-xxxx
/usr/local/spark/sbin/start-all.sh

Done