Optimized joins using bloom filters on Hadoop via Cascading.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
src/java
test/java
LICENSE
NOTICE
README
build.xml

README

Compiling:

You need to have HADOOP_HOME set to the root directory of Hadoop on your computer.
CASACADING_HOME must point to a directory containing the cascading jar and cascading jar dependencies.

This source code is adapted from Rapleaf's production code. Rapleaf's version uses particular datastores and that dependency has been removed for 
this release.


Testing batch queries:

Distributed cache does not work in local mode in Hadoop. For this reason, the Relevance class has an alternate code path for the purposes of writing
unit tests that utilize batch queries. In order to activate "test mode", add this code to your test:

Relevance.TEST_MODE = true;


Any questions or feedback can be directed to nathan.marz@gmail.com