ICP2

Hadoop MapReduce and Hadoop Distributed File System (HDFS)

Task:

• Count of words in a text file that starts with 'a'
• Indentifying prime numbers in a list of numbers

Features:

• Hadoop
• Map-Reduce
• HDFS

Questions

1. Word Count: calculate the frequency of the words in a text file

Code:

Input:

Output:

2. Word Count for words starts with 'a'

Code:

Input:

Output:

3. Prime Number

Code:

Input:

Output:

References:

https://github.com/chenmiao/Big_Data_Analytics_Web_Text/wiki/Hadoop-with-Cloudera-VM-(the-Word-Count-Example)