Skip to content
Go to file
This branch is 9 commits ahead of DandyDev:master.

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time

A working virtual Hadoop cluster

With these files you can setup and provision a locally running, virtual Hadoop cluster in real distributed fashion for trying out Hadoop and related technologies. It runs the latest Cloudera Hadoop distribution: CDH 5.


The cluster conists of 5 nodes:

  • Master node with 1GB of RAM (Running the NameNode, Hue, ResourceManager, HBase Master etc. after installing the Hadoop services)
  • Standby node with 512M of RAM (Running the standby NameNode)
  • 3 slaves with 1GB of RAM each (Running DataNodes, ZooKeeper, HBase RegionServer and HBase Thrift Server)

As you can see, you'll need at least 5GB of free RAM to run this. If you have less, you can try to remove one machine from the Vagrantfile. This will lead to worse performance though!


Depending on the hardware of your computer and your network, installation will probably take hours.

First install VirtualBox and Vagrant.

Install the Vagrant Hostmanager plugin:

$ vagrant plugin install vagrant-hostmanager

Clone this repository:

$ git clone

Provision the bare cluster. It will ask you to enter your password, so it can modify your /etc/hosts file for easy access in your browser. It uses the Vagrant Hostmanager plugin to do this.

$ cd virtual-hadoop-cluster
$ librarian-puppet install
$ vagrant up

You can visit following addresses to ensure everything is OK:

Have fun with your Hadoop cluster.


A virtual Hadoop cluster running CDH 5



No releases published


No packages published
You can’t perform that action at this time.