Switch branches/tags
Nothing to show
Find file
Fetching contributors…
Cannot retrieve contributors at this time
63 lines (38 sloc) 2.29 KB


Installs Apache hadoop and sets up a basic distributed cluster per the quick start documentation.



Tested on Ubuntu 8.10, though should work on most Linux distributions, see hadoop.


Opscode cookbooks,

  • java


You may wish to add more attributes for tuning the configuration file templates.


This cookbook performs the tasks described in the Hadoop Quick Start to get the software installed. You should copy this to a site-cookbook and modify the templates to meet your requirements.

Once the recipe is run, the distributed filesystem can be formated using the script /usr/bin/hadoop.

sudo -u hadoop /usr/bin/hadoop namenode -format

You may need to set up SSH keys for hadoop management commands.

Note that this is not the 'default' config per se, so using the script won't start the processes because the config files live elsewhere. For running various hadoop processes as services, we suggest runit. A sample 'run' script is provided. The HADOOP_LOG_DIR in the run script must exist for each process. These could be wrapped in a define.

  • datanode

  • jobtracker

  • namenode

  • tasktracker




Joshua Timberman (<>)


2009, Opscode, Inc

Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.