Skip to content


Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP


piccolbo edited this page · 38 revisions


New in 1.1

  • Native R serialization/deserialization, which implies that all R objects are supported as key or value, without any conversion boilerplate code.This is the new default. JSON still supported. csv reader/writer also available -- somewhat experimental.
  • Multiple backends (hadoop and local); local backend is useful for debugging at small scale; having two backends enforces modular design, opens up further possibilities (EMR, CUDA have been suggested), forces to clarify semantics.
  • Multiple tests of backend equivalence.
  • Simpler interface for profiler.
  • Equijoins (rough equivalent of merge for mapreduce)
  • dfs.empty to check if file is empty
  •, to.reduce, to.reduce.all higher order functions to create simple map and reduce functions from regular ones.
Something went wrong with that request. Please try again.