Skip to content

Workflow-Based Model for Parallel and Distributed Processing. Prototype and use-cases.

Notifications You must be signed in to change notification settings

PedroOliveiraFernandes/WorkflowModelForDistributedProcessing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Workflow-Based Model for Parallel and Distributed Processing

The contents of this repository contain the source code and utility scripts developed for the prototype and experimentation with case study examples done in the context of my master's thesis in the area of Computer Science and Engineering carried out under the supervision of Professor Luis Assunção during the 2022/2023 scholar year at the Instituto Superior de Engenharia de Lisboa of the Instituto Politécnico de Lisboa (ISEL-IPL).

The work done in this thesis is a contribution to finding answers to some open issues, proposing a workflow model with the following characteristics:

  • Decentralization of control over the execution of multiple tasks in a workflow;

  • Execution of a workflow with multiple iterations;

  • Possibility of specifying replicas of a task to support load balancing;

  • Encapsulation of tasks in containers, enabling their execution on multiple computing nodes;

  • Flexible specification of workflows independently of the technological infrastructure for its execution.

The prototype for experimentation runs on a computing infrastructure that uses virtual machines, forming a virtual cluster with multiple computing nodes (virtual machines) hosted on the Google Cloud Platform. Multiple computing nodes share files through the Gluster distributed file system. The multiple tasks of a workflow, activated in the context of autonomous components called Activities, are executed encapsulated in Docker containers, allowing great flexibility in the development and reuse of these Tasks in multiple application cases.

In the main directory of this repository, there are two relevant sub-directories:

  • /ExperimentationUseCases, containing the workflow use-case projects done to support the validation and experimentation of the prototype;
  • /WorkflowModel, containing the source code and utility configuration files that constitute the components of the workflow model prototype.