Skip to content

DATAVIEW Release 2.2

Choose a tag to compare

@ChangxinBai ChangxinBai released this 13 Oct 10:47
· 52 commits to master since this release

DATAVIEW documentation: https://github.com/shiyonglu/DATAVIEW

In this release of DATAVIEW 2.2, we have implemented the following features:

(1) Task model: No change.

(2) Workflow model

  1. For workflow.java, changed the return object of getExecutionTime() method from Map<Integer, Map<String, Double >> to Map<String, Map<String, Double >> and getTransferTime() method from Map<Integer, Map<Integer, Double>> to Map<String, Map<String, Double>>. The key of the Map is changed from TaskID to TaskName.
  2. DATAVIEW_Table was proposed to support relational algebra operator tasks.

(3) WorkflowPlanner model
1) We improved the LPOD planner in accordance with the LPOD journal paper, which reduces the time complexity to polynomial time using dynamic programming.

(4) WorkflowExecutor model
1) We supported the workflow configuration functionality, such as the LocalStorage properties, Amazon EC2 parameters and confidential task names during the workflow execution process, which is located in DATAVIEW/WebContent/config.json, which can be referred from https://github.com/shiyonglu/DATAVIEW/blob/master/DATAVIEW/WebContent/config.json.

(5): A Provenance model
1) We added the provenance collector component so that provenance is captured during the execution of a workflow, which is used by the LPOD planner for the estimate of task execution times and data movement times.

(6) Visual programming
1) A local treeView functionality is integrated in the current version, eliminating the dependency on an external PHP script.

(7): DATAVIEW website
1) A user can now access the official DATAVIEW website: www.dataview.org or run their own custom workflow on the DATAVIEW server or on Amazon EC2 cloud. This project can be executed with any JAVA version.

(8): Relational algebra
1) This release supports relational algebra in terms of 13 Relational Algebra tasks, so that a user can connect these tasks into a RA expression and run it.