forked from discoproject/odisco
Library for implementing Disco jobs in ocaml.
License
pmundkur/odisco
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
master
Could not load branches
Nothing to show
Could not load tags
Nothing to show
{{ refName }}
default
Name already in use
A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code
-
Clone
Use Git or checkout with SVN using the web URL.
Work fast with our official CLI. Learn more.
- Open with GitHub Desktop
- Download ZIP
Sign In Required
Please sign in to use Codespaces.
Launching GitHub Desktop
If nothing happens, download GitHub Desktop and try again.
Launching GitHub Desktop
If nothing happens, download GitHub Desktop and try again.
Launching Xcode
If nothing happens, download Xcode and try again.
Launching Visual Studio Code
Your codespace will open once ready.
There was a problem preparing your codespace, please try again.
This branch is up to date with discoproject/odisco:master.
Latest commit
Git stats
Files
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
ODisco is a library for implementing Disco map-reduce jobs in OCaml. It implements the Disco worker protocol, and provides the plumbing to connect user-specified computations to Disco data sources and results. Prerequisites: -------------- The library has the following dependencies: . ocaml 3.12.0 or later . ocaml-findlib (Debian/Ubuntu/Fedora) / godi-findlib (Godi) / findlib (Gentoo, source) . libzip-ocaml-dev (Debian/Ubuntu) / ocaml-zip (Fedora) / godi-zip (Godi) / camlzip (Gentoo, source) . Disco 0.4 or later (http://discoproject.org) . sonet This is a simple asynchronous networking library for OCaml. $ git clone git://github.com/pmundkur/sonet.git $ cd sonet && make && make install To uninstall: $ cd sonet && make uninstall The tests have the following dependencies: . atd (https://github.com/MyLifeLabs/atd) / libatd-ocaml-dev (Debian/Ubuntu) / godi-atd (Godi) . atdgen (https://github.com/MyLifeLabs/atdgen) / libatdgen-ocaml-dev (Debian/Ubuntu) / godi-atdgen (Godi) . biniou (https://github.com/mjambon/biniou) / libbiniou-ocaml-dev (Debian/Ubuntu) / godi-biniou (Godi) Building: --------- $ make Installing: ----------- $ make install Uninstalling: ------------- $ make uninstall Using: ------ . Write a module implementing the lib/task.ml:TASK interface. Pass this module to Worker.start in your main program. See tests/test_install_task.ml for an example. Read the documentation in lib/task.mli and lib/worker.mli for more details. . Build it and link to the ODisco library. See tests/Makefile for an example build. . Submit your compiled executable to Disco using 'disco job'. For example, to do a word count on a large text file: $ make -C tests $ wget -O /tmp/bigfile.txt http://discoproject.org/media/text/bigfile.txt $ ddfs push text /tmp/bigfile.txt $ ddfs blobs text \ | disco job -m -r -p ocamlwc tests/word_count.opt \ | xargs disco wait \ | xargs ddfs cat
About
Library for implementing Disco jobs in ocaml.
Resources
License
Stars
Watchers
Forks
Packages 0
No packages published
Languages
- OCaml 95.0%
- Makefile 5.0%