Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Maven Plugin to submit hadoop jobs
branch: master

This branch is 14 commits ahead, 9 commits behind akkumar:master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
.settings
src/main/java/com/github/hadoop/maven/plugin
.classpath
.gitignore
.project
INSTALL
LICENSE.txt
README
pom.xml

README

Maven Plugin for Hadoop
-------------------------
  
Copyright (C) 2011 MeMo News AG



This is a maven plugin for Hadoop issued under Apache License. 
This software comes with absolutely *NO WARRANTY* whatsoever. 
See LICENSE.txt for more details. 


Installation
============

The plugin should be available in the central repository soon.

<plugin> 
   <groupId>com.github.maven-hadoop.plugin</groupId>
   <artifactId>maven-hadoop-plugin</artifactId>
    <version>0.20.2-SNAPSHOT</version>
    <configuration>
        <hadoopHome>/opt/software/hadoop</hadoopHome>
        <path>hdfs://localhost:8020/user/${user.name}</path>
    </configuration>
</plugin>
      
     
where , hadoopHome  is set to HADOOP_HOME installation directory of the version against which this needs to be compiled against.

Usage / Goals:
=============

* mvn hadoop:pack
------

Creates the jar file to be submitted to the hadoop job engine. 

The jar contains a directory called ./lib , that contains all the dependent jars in the same. 
The classes of the current project are also available in the same. 

The jar would be created in $basedir/target/hadoop-deploy/${artifact.name}-{artifact.version}-hdeploy.jar. 

Once created, this could be started with the hadoop jar engine. 

$ $HADOOP_HOME/bin/hadoop jar  $basedir/target/hadoop-deploy/${artifact.name}-{artifact.version}-hdeploy.jar   job.launching.class

* mvn hadoop:deploy
--------

Deploys the packed job to the given path on hdfs.

   
      
Something went wrong with that request. Please try again.