Skip to content
Wongiseng edited this page Oct 11, 2013 · 40 revisions

#DuckTape

Overview

DuckTape is a platform to string together experiments from existing code base. It is designed for any of the following situations:

  • You have a simple piece of code that you want to try out with different inputs (a parameter sweep)
  • You have several interconnected pieces of code that you wanted to use in a reproducible experiment.
  • You have an experimental workflow with different pieces of code in different programming languages (* main support currently on Java domain*)
  • You have a piece of code that tests the limits of your computer. You'd like to do a parameter sweep on a cluster, without rewriting everything (under development)

Features

The DuckTape allows you to easily incorporate your code into our platform and with a few simple annotations, run it in a controlled environment. With the DuckTape you get:

  • Complete separation of you code and your running parameters
  • HTML Reports that offer quick insight into the result of a run
  • Automatic provenance information generated based on PROV-O
  • Command line programs can be used as modules for unsupported languages
  • Support for modules in Java, (Python, Matlab under development)
  • To scale your experiments from your laptop to a cluster with minimal effort (under development)

Usage

The following steps are required to use DuckTape:

  • Install DuckTape by obtaining our latest build of Ducktape from our Maven Repositories
  • Compose workflow by creating a Yaml file containing the parameters you would like to run with.
  • Run the workflow using : mvn exec:java -Dexec.mainClass=org.data2semantics.platform.run.Run

Quick Start provides short description on how to immediately start using DuckTape, for running example workflow that we provide.

Example Workflows gives you existing workflow examples predefined to simplify using DuckTape.

##Documentation

Further documentation for using more features provided by DuckTape is provided here

Status

The DuckTape is currently in development. A proof of concept is capable of running basic workflows. We expect to be releasing alpha level code at the end of 2013.

Acknowledgments

This software was supported by the Dutch national program COMMIT.