Implement distributed version of streaming parallel EM-tree #5

Open
cmdevries opened this Issue Oct 11, 2014 · 0 comments

Projects

None yet

1 participant

@cmdevries
Owner

Compress transmission of integer accumulators between machines vectors using https://github.com/lemire/FastPFOR.

Hadoop + HDFS (just get hadoop to hand over the bytes, or use HDFS directly).

ZeroMQ + GlusterFS.

Apache Spark might work well with python bindings for library, https://github.com/apache/spark.

HDFS + Erlang scheduler (gascheduler) + C++ code as a simple TCP server.

@cmdevries cmdevries added this to the distributed milestone Oct 11, 2014
@cmdevries cmdevries added enhancement and removed enhancement labels Oct 11, 2014
@cmdevries cmdevries changed the title from Implement distributed versions of streaming parallel EM-tree to Implement distributed version of streaming parallel EM-tree Oct 11, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment