HIPI: Hadoop Image Processing Interface
Java HTML CSS Other
Switch branches/tags
Nothing to show
Clone or download
voigtlandier Merge pull request #20 from birdyhuang/release
Added 'filename' for the HibImport tool
Latest commit 42f7b77 Apr 12, 2016
Failed to load latest commit information.
core - Changed from global tmp directory to user tmp directory for HIB uni… Sep 19, 2015
testdata - Updating downloader testimages to match new resized versions on web. Sep 24, 2015
tools Added 'filename' for the HibImport tool Apr 11, 2016
util code refactoring and cleanup Sep 2, 2015
web - Fixed several typos on website and restored remote test images for … Sep 23, 2015
.gitignore Migrating from Ant to Gradle. Aug 3, 2015
README.md - Updated web pages to announce support for OpenCV. Added tag for ver… Sep 21, 2015
build.gradle - Merging with Zack's changes to covar. Sep 13, 2015
license.txt Create license.txt Apr 23, 2014
settings.gradle commit before rebase from gradle Aug 20, 2015


HIPI (Hadoop Image Processing Interface) is a library designed to provide efficient and high-throughput image processing in the Apache Hadoop MapReduce parallel programming framework. It also provides support for OpenCV.

For more detail about what HIPI is, see the Main HIPI Webpage.

To stay in touch with the HIPI development community join the HIPI Users Group.

Getting started

1. Setup Hadoop

HIPI works with a standard installation of the Apache Hadoop Distributed File System (HDFS) and MapReduce. HIPI has been tested with Hadoop version 2.7.1.

If you haven't already done so, download and install Hadoop by following the instructions on the official Apache Hadoop website. A very useful resource is their Quickstart Guide, in particular, the Single Cluster Setup for first-time users.

Ensure that the Hadoop bin directory is in your system path:

  $> which hadoop

2. Install Gradle

The HIPI distribution uses the Gradle build automation system for code compilation and assembly. HIPI has been tested with Gradle version 2.5:

Install gradle on your system and verify that it is in your path as well:

  $> which gradle

3. Clone the HIPI Repository

Clone the latest HIPI distribution from GitHub:

  $> git clone git@github.com:uvagfx/hipi.git

4. Build the HIPI Library and Tools/Example Programs

From the HIPI root directory, simply run gradle to build the HIPI library along with the complete set of tools and example programs:

  $> gradle
  Found Java 1.8.

  Finished building the HIPI library along with all tools and examples.


  Total time: 2.058 secs

If the build fails, first carefully review the steps above. If you are convinced that you are doing everything correctly and that you've found an issue with the HIPI distribution or documentation please post a question to the HIPI Users Group or use the Issue Tracker to file a bug report.

After the build successfully finishes, you may want to inspect the settings.gradle file in the root directory along with the build.gradle files in the root, core, and tools directories in order to familiarize yourself with the various build targets. If you're new to Gradle, we recommend reading the Gradle Java Tutorial. For example, to build only the tools/hibImport tool from scratch:

  $> gradle clean tools:hibImport:jar
  :core:processResources UP-TO-DATE
  :tools:hibImport:processResources UP-TO-DATE


  Total time: 1.197 secs

HIPI is now installed on your system. To learn about future updates to the HIPI distribution you should join the HIPI Users Group and watch this repository. You can always obtain the latest version of HIPI on the release branch with the following command:

  $> git pull origin release
  From github.com:uvagfx/hipi
   * branch            release    -> FETCH_HEAD
  Already up-to-date.

Also, you can experiment with the development branch, which often contains new features that have not yet been integrated into the main release branch. Note that the development branch is generally less stable than the release branch.

Next Steps

Be sure to check out the HIPI Tools and Example Programs to learn more about HIPI.