Skip to content
Owl's Parallel & Distributed Computing Engine
Branch: master
Clone or download
Latest commit 878f458 Jul 26, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
bin change folder structure Jul 26, 2018
data add kmeans.data Aug 30, 2016
lib refactor ... Jul 26, 2018
test change folder structure Jul 26, 2018
.gitignore Jbuilderify + 4.06.0 build (#5) Feb 8, 2018
LICENSE Initial commit Jul 24, 2016
Makefile refactor ... Jul 26, 2018
README.md update readme Aug 12, 2017
actor.opam refactor ... Jul 26, 2018
jbuild-ignore Jbuilderify + 4.06.0 build (#5) Feb 8, 2018
jbuild-workspace Jbuilderify + 4.06.0 build (#5) Feb 8, 2018

README.md

OCaml Distributed Data Processing

A distributed data processing system developed in OCaml

Todo

How to express arbitrary DAG? How to express loop? Apply function.

Interface to Irmin or HDFS to provide persistent storage

Test delay-bounded and error-bounded barrier

Split Context module into server and client two modules

Implement parameter.mli

Implement barrier control in parameter modules

Rename ... DataContext and ModelContext?

Implement Coordinate Descent in model parallel ...

Enhance Mapreduce engine, incorporate with owl.

Add techreport based on the barrier control.

How to compile & run it?

To compile and build the system, you do not have to install all the software yourself. You can simply pull a ready-made container to set up development environment.

docker pull ryanrhymes/actor

Then you can start the container by

docker run -t -i ryanrhymes/actor:latest /bin/bash

After the container starts, go to the home director, clone the git repository.

git clone https://github.com/ryanrhymes/actor.git

Then you can compile and build the system.

make oasis && make
You can’t perform that action at this time.