Skip to content

bucketsize/evmr

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Intro:
======
A map-reduce framework written in ruby.

The motivation was to use fast network IO lib called EventMachice for map-reduce just as a POC.

Have Mappers and Reducers scheduled work packets, an intermedeate merge is hidden and resides with the scheduler.

TODO:
====
Scheduler can be a reducer.
Merge can also be a reducer.
Have multiple fault-tolerent scheduler/mergers.
Use a distributed cache to hold intermediate work packets.

https://github.com/bucketsize/evmr

About

mapreduce using eventmachine for IO

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages