Hadoop HDFS and Yarn client
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
src
test
.gitignore
.travis.yml
HDFS.md
LICENSE.md
NOTES.md
README.md
REQUIRE
YARN.md
YARNCM.md
genproto.sh

README.md

Elly

Build Status

Elly is a Hadoop HDFS and Yarn client. It provides:

  • A familiar Julia ClusterManager interface, making it possible to use the familiar Julia parallel constructs on any Hadoop/Yarn cluster: addprocs, @parallel, spawn, pmap, etc.
  • Lower level APIs to write native Yarn applications.
  • A familiar Julia IO API for accessing HDFS files. It is a pure Julia implementation with no dependencies on libhdfs.

Using Elly

Requirements

  • Since Elly uses the newer Protobuf interface, it requires a Hadoop 2.2+ distribution.