-
Notifications
You must be signed in to change notification settings - Fork 3
Optimized joins using bloom filters on Hadoop via Cascading.
License
nathanmarz/cascading-batch-query
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
Compiling: You need to have HADOOP_HOME set to the root directory of Hadoop on your computer. CASACADING_HOME must point to a directory containing the cascading jar and cascading jar dependencies. This source code is adapted from Rapleaf's production code. Rapleaf's version uses particular datastores and that dependency has been removed for this release. Testing batch queries: Distributed cache does not work in local mode in Hadoop. For this reason, the Relevance class has an alternate code path for the purposes of writing unit tests that utilize batch queries. In order to activate "test mode", add this code to your test: Relevance.TEST_MODE = true; Any questions or feedback can be directed to nathan.marz@gmail.com
About
Optimized joins using bloom filters on Hadoop via Cascading.
Resources
License
Stars
Watchers
Forks
Releases
No releases published