Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
A Hadoop job that runs GATE applications
Java
Branch: master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
src/main/java/wpmcn/gate/hadoop
README.md
pom.xml

README.md

Hadoop GATE

This project contains a simple Hadoop job that runs a GATE application.

This job runs an archived GATE application on text files comprised of one document per line. It produces sequence files containing XML representations of the document annotation. The GATE application is a archive file with an application .xgapp file in its root directory. This application is copied to HDFS and placed into the distributed cache.

The first positional argument is the GATE application. Subsequent positional arguments are input directories, except for the final positional argument, which is the output directory. A sample command might be

hadoop jar Hadoop-GATE-1.0.jar wpmcn.gate.hadoop.HadoopGATE ANNIE.zip input output

This project uses the new Hadoop API. It is built with Maven and demonstrates how to use Maven to package all the GATE dependencies into a single jar file.

The Behemoth project also runs GATE on Hadoop.

Something went wrong with that request. Please try again.