This Ansible playbook will build a Storm cluster with Zookeeper based on https://github.com/hpcloud-mon/ansible-storm with a few modifications to work on ancient centos 6.8. Upstart configs had to be changed.
You can pre-build a Rackspace cloud environment or run the playbook against an existing environment.
-
Ansible >= 2.0.
-
Expects RHEL/CentOS 6
-
It installs Zookeeper
-
It supports static inventory if the environment is pre-built (
inventory/staticfile). -
The
idis automatically set (on the inventory items in alphabetical order). -
It includes init scripts for both Zookeeper and upstart config for Storm components
- When provisioning Kafka on existing infrastructure edit
inventory/staticand add the nodes.
To customize, change the variables under playbooks/group_vars and playbooks/roles folders:
- playbooks/group_vars/all: contains cluster and cloud settings
- playbooks/roles/zookeeper/defaults/main.yml: Zookeeper specific settings
- playbooks/roles/storm/defaults/main.yml: Storm specific settings
(This is from https://github.com/hpcloud-mon/ansible-storm )
For a one-node cluster, set nodes_count in playbooks/group_vars/all to 1.
- For static / prebuilt environments:
bash stormn_static.sh
Tested on Mac OS. Windows setup for vagrant is not possible except from another linux VM or docker container.
Install vagrant from https://www.vagrantup.com/
Install VirtualBox from https://www.virtualbox.org/wiki/Downloads
Install Ansible with pip (see http://docs.ansible.com/ansible/intro_installation.html#latest-releases-via-pip)
To bring up three centos nodes with vagrant type
Vagrant up
The nodes will boot up and be 'provisioned' with provisioning/storm.yml
TODO: dynamic host inventory is not working yet
When ansible is finished you should be able to browse to http://192.168.33.23:8088/ to see the storm UI and everything running nicely