install hadoop automatically to hiCloud VM in Taiwan
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
api
bin
LICENSE
Makefile
README.md
config
install-ubuntu
setup_hadoop_labs

README.md

hicloud-hadoop

This is a toolkit to help developer to install hadoop cluster on hiCloud VMs.

Note: hiCloud is the Amazon EC2 like service provided by CHT, Taiwan.

Requirements

  1. These scripts are only tested on Ubuntu 12.04 LTS.
  2. You will need the CSV password file download form hiCloud.
  3. These scripts are based on libexpect-perl and dsh (distributed shell)

Steps

    ~# ssh-keygen -t rsa -P ""
  • Then you have to install needed packages to run this automation script
     ~# apt-get -y install libexpect-perl dsh git
  • Download current version of hicloud-hadoop script from sourceforge
    ~# git clone git://github.com/jazzwang/hicloud-hadoop.git
  • Upload the CSV file using PieTTY
  • Run ./config to generate conf/master and conf/slave for your cluster based on uploaded CSV password file
    ~# cd hicloud-hadoop
    ~/hicloud-hadoop# ./config
    ~/hicloud-hadoop# ./install-ubuntu
  • After installation, you will see messages like this:
    Please check http://IP:50070 and http://IP:50030 for the status

Bitdeli Badge