Skip to content


Subversion checkout URL

You can clone with
Download ZIP
Fetching contributors…

Cannot retrieve contributors at this time

67 lines (49 sloc) 2.9 KB
Thanks for using Cascading.
General Information:
Project and contact information:
This distribution includes four Cascading jar files:
cascading-x.y.z.jar - all relevant Cascading class files and libraries, with a 'lib' folder
cascading-core-x.y.z.jar - all Cascading Core class files
cascading-xml-x.y.z.jar - all Cascading XML operations class files
cascadgin-test-x.y.z.jar - all Cascading tests and test utilities
To use with Hadoop, we suggest stuffing cascading-core and cascading-xml jar files, and all third-party libs
into the 'lib' folder of your job jar and executing via 'hadoop jar your.jar <your args>'.
For example, your job jar would look like this (via: jar -t your.jar)
/<all your class and resource files>
/lib/<cascading third-party jar files>
Hadoop will unpack the jar locally and remotely (in the cluster) and add any libraries in 'lib' to the classpath.
This is a feature specific to Hadoop.
The cascading-x.y.z.jar file is typically used with scripting languages and is completely self contained.
This ant snippet works quite well (you may need to override cascading.home):
<property name="cascading.home" location="${basedir}/../cascading"/>
<property file="${cascading.home}/"/>
<property name="cascading.release.version" value="x.y.z"/>
<property name="cascading.filename.core" value="cascading-core-${cascading.release.version}.jar"/>
<property name="cascading.filename.xml" value="cascading-xml-${cascading.release.version}.jar"/>
<property name="cascading.libs" value="${cascading.home}/lib"/>
<property name="cascading.libs.core" value="${cascading.libs}"/>
<property name="cascading.libs.xml" value="${cascading.libs}/xml"/>
<condition property="cascading.path" value="${cascading.home}/"
<available file="${cascading.home}/${cascading.filename.core}"/>
<property name="cascading.lib.core" value="${cascading.path}/${cascading.filename.core}"/>
<property name="cascading.lib.xml" value="${cascading.path}/${cascading.filename.xml}"/>
<target name="jar" depends="build" description="creates a Hadoop ready jar will all dependencies">
<!-- copy Cascading classes and libraries -->
<copy todir="${build.classes}/lib" file="${cascading.lib.core}"/>
<copy todir="${build.classes}/lib" file="${cascading.lib.xml}"/>
<copy todir="${build.classes}/lib">
<fileset dir="${cascading.libs.core}" includes="*.jar"/>
<fileset dir="${cascading.libs.xml}" includes="*.jar"/>
<jar jarfile="${build.dir}/${}.jar">
<fileset dir="${build.classes}"/>
<fileset dir="${basedir}" includes="lib/"/>
<attribute name="Main-Class" value="${}/Main"/>
Jump to Line
Something went wrong with that request. Please try again.