Skip to content

nathanmarz/cascading-batch-query

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Compiling:

You need to have HADOOP_HOME set to the root directory of Hadoop on your computer.
CASACADING_HOME must point to a directory containing the cascading jar and cascading jar dependencies.

This source code is adapted from Rapleaf's production code. Rapleaf's version uses particular datastores and that dependency has been removed for 
this release.


Testing batch queries:

Distributed cache does not work in local mode in Hadoop. For this reason, the Relevance class has an alternate code path for the purposes of writing
unit tests that utilize batch queries. In order to activate "test mode", add this code to your test:

Relevance.TEST_MODE = true;


Any questions or feedback can be directed to nathan.marz@gmail.com

About

Optimized joins using bloom filters on Hadoop via Cascading.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages