Vagrant files for storm cluster
Puppet Shell Ruby
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
provision
.gitignore
README.md
Vagrantfile

README.md

vagrant-storm

A Vagrant setup to run a virtual Apache Storm cluster.

Per se, four nodes a configured (see the top of Vagrantfile), but of course you might to use a different configuration. To use a different cluster configuration, you need to change the specified hosts in Vagrantfile and you also need to adopt the Puppet configuration file in provision/puppet/manifests/site.pp such that all required services are running on some hosts.

Compatibility

I only tested the cluster on Ubuntu 14.04 with the vagrant-lxc plugin. If you plan to use a big virtual cluster running on a single machine, I strongly recommend using Linux containers (LXC) with vagrant-lxc instead of a full blown virtualisation. I guess it would also be possible to setup a virtual host machine running Ubuntu 14.04 on a different OS (even like Windows or Mac OS), and then use Linux containers with vagrant-lxc inside the virtual host.

Dependencies

For best results, you should also install the Vagrant plugin vagrant-hostmanager simply by typing

vagrant plugin install vagrant-hostmanager

This neat plugin will make sure that every nodein your cluster gets a hosts file containing all other nodes of your Vagrant virtual cluster. This way you do not need to have any DNS bindings for your hosts, and you can simply rely on a DHCP server for assigning IP addresses.

Starting

In order to start the cluster, simply go into the root directory and run

vagrant up

This will bring up all nodes. Sometimes some provisioning errors might occur during startup. They mostly come by some race conditions of the parallel startup. In most cases, you can simply rerun the provisioning with vagrant provision <node> for a specific node.

Available machines

In the default configuration, the following nodes will be started:

nimbus.stormcluster
zookeeper1.stormcluster
supervisor1.stormcluster
supervisor2.stormcluster

You can ssh into any of the machines using vagrant by typing

vagrant ssh <nodename>

where nodename is the hostname of one node (without domain!)