Skip to content
Chaance Graves edited this page Feb 15, 2016 · 6 revisions

Hadoop Tutorial

What is Hadoop and what can we use it for?

Apache Hadoop is a software library that provides a framework that allows for the distributed processing of large data sets across a cluster of computers. It uses simple programming models that are designed to scale up single servers to thousands of machines, each offering local computation and storage.

The project includes the following modules:

  • Hadoop Common: The common utilities that support the other Hadoop modules.
  • Hadoop Distributed File System (HDFS™): A distributed file system that provides high-throughput access to application data.
  • Hadoop YARN: A framework for job scheduling and cluster resource management.
  • Hadoop MapReduce: A YARN-based system for parallel processing of large data sets.

Getting Started

Refer to this link for Setting up a Single Node Cluster: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html

These links assist in installing Hadoop a simple way for Windows, Linux users:

Pay close attention to space needed to install the Hortonworks Sandbox on a VMWare (8.7 GB), So if you have time please follow instructions thoroughly given in this link: http://hortonworks.com/products/hortonworks-sandbox/#install

Also look into the tutorials offered on the Hortonworks website as well!

Clone this wiki locally