Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.
Sign upImplement distributed version of streaming parallel EM-tree #5
Comments
cmdevries
added this to the distributed milestone
Oct 11, 2014
cmdevries
added
enhancement
and removed
enhancement
labels
Oct 11, 2014
cmdevries
changed the title from
Implement distributed versions of streaming parallel EM-tree
to
Implement distributed version of streaming parallel EM-tree
Oct 11, 2014
cmdevries
added
the
distributed
label
Oct 11, 2014
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
cmdevries commentedOct 11, 2014
Compress transmission of integer accumulators between machines vectors using https://github.com/lemire/FastPFOR.
Hadoop + HDFS (just get hadoop to hand over the bytes, or use HDFS directly).
ZeroMQ + GlusterFS.
Apache Spark might work well with python bindings for library, https://github.com/apache/spark.
HDFS + Erlang scheduler (gascheduler) + C++ code as a simple TCP server.