DAFT Allows File Transfers
Distributed file transfer application in user space.
Securely move data files during distributed computational experiments and provide a global view of all files, even when there is no distributed filesystem and probably faster than NFS for large files.
put filename: add/publish a given file into the system.
bcast filename: equivalent to put then send the file to all nodes.
get filename: retrieve a file previously published into the system.
ls [-l]: list all files known to the system and optionally where their chunks are.
Prerequisite: you need opam installed; c.f. [opam] http://opam.ocaml.org/doc/Install.html.
opam install depext opam depext ZMQ opam depext cryptokit opam install dolog batteries fileutils ZMQ cryptokit make config make build make install
Example user session
To maintain complexity low, the system will be Write Once Read Many (WORM). Files put under the system's control are never modified. There will be several data servers (one per node) and at least one meta-data server (on the node where the user is interacting with the system, or remote).