No description or website provided.
JavaScript
Latest commit 063d80c Sep 16, 2010 1 Ryan McGrath Fixing broadcasting
Failed to load latest commit information.
lib
models
public
views Merge branch 'master' of git@github.com:nko/anansi Aug 29, 2010
.gitignore
.gitmodules
README.md
background_tasks.js run every 10 mins Aug 28, 2010
couch.js add some validation Aug 28, 2010
run_dev_server.js Removing, moving, fixing Aug 28, 2010
server.js Fixing broadcasting Sep 16, 2010
strawman
util.js
worker_api.js

README.md

We're Awesome

README driven development! Here we go!

Anansi (why is it called like that?) is a distributed MapReduce implementation for JavaScript that runs on the worlds largest computational network. Consumer PCs.

Trade-offs

Technically there is no reason not to run MapReduce jobs on idling web clients. But of course this was a competition and we had to spend some time to implement cool realtime scrolling graphs, so some things were left out.

  • There is no input reader step. Data has to be uploaded in chunks.
  • There's always exactly one map phase and one reduce phase. No partitions and you can't supply a partitioning function.
  • The grouping step after the map step is lame and slow.
  • Results aren't validated by more than one client.
  • We're using a relational database goes and hides in the basement

Thanks To