The Hadoop Fair Sojourn Protocol Scheduler
Switch branches/tags
Nothing to show
Clone or download
Pull request Compare This branch is 2 commits ahead, 11 commits behind melrief:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
src
LICENSE.txt
README.md
pom.xml

README.md

Hadoop Fair Sojourn Protocol (HFSP)

The Hadoop Fair Sojourn Protocol Scheduler is a size-based scheduler for Hadoop.

Compile HFSP

In order to compile HFSP you need Maven. From the top directory issue the following command:

$ mvn package -DskipTests

This will create two files in the directory /target:

  • hfsp-scheduler-1.0.jar: a jar file containing the scheduler
  • hfsp-scheduler.xml: a default configuration file

Use HFSP

Copy hfsp-scheduler-1.0.jar in your Hadoop directory. Optionally, add the configuration file for HFSP in the hadoop configuration directory.

Set HFSP as task scheduler in conf/mapred-site.xml:

<configuration>
	<property>
          <name>mapred.jobtracker.taskScheduler</name>        
          <value>org.apache.hadoop.mapred.HFSPScheduler</value>  
	</property>
</configuration>

Hadoop versions

HFSP has been developed for the current stable version of Hadoop 1.x, that is Hadoop 1.1.2.

Contributors

Acknowledgements

The HFSP project is partially funded by the BigFoot project and the mPlane project