Skip to content

emtrane/hadoop-maven-stub

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Example Usage

Local Development

Build the project mvn assembly:assembly

You're going to want to give it some extra memory export MAVEN_OPTS="-Xmx1024m"

Run the word count example mvn exec:java -Dexec.mainClass="com.github.emtrane.Main" -Dexec.args="-i /tmp/input -o /tmp/output"

Distributed Mode

Populate some input ./hadoop-0.20 fs -put text.file hdfs:///tmp/input

Get the usage help ./hadoop-0.20 jar hadoop-maven-stub-1-jar-with-dependencies.jar com.github.emtrane.Main

Run the word count example ./hadoop-0.20 jar hadoop-maven-stub-1-jar-with-dependencies.jar com.github.emtrane.Main -i /tmp/input -o /tmp/output

View the output ./hadoop-0.20 fs -cat /tmp/output/*

About

A starting point to hadoop hacking in a maven structure

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published