Skip to content
@ewoks-kit

ewoks-kit

Ewoks development organisation

Extensible Workflow System: Core Projects

Ewoks is a framework for automating data processing and experiments at large-scale facilities in a reproducible, traceable, and portable manner.

It is a meta workflow system that can execute the same computation graph using different workflow management systems.

Repositories

flowchart LR
    ewoksweb["ewoksweb (Web UI)"]
    ewoksserver["ewoksserver (REST backend)"]

    ewoksjob["ewoksjob (Client)"]
    ewoksjobworker["ewoksjob (Worker)"]

    ewoks["ewoks (API / CLI)"]

    ewokscore["ewokscore (Core engine & runtime)"]
    ewoksdask["ewoksdask"]
    ewoksppf["ewoksppf"]
    ewoksorange["ewoksorange"]

    %% User interaction
    ewoksweb --> ewoksserver

    %% Submission path
    ewoksserver --> ewoksjob
    ewoksjob --> ewoksjobworker

    %% Execution
    ewoksjobworker --> ewoks
    ewoks --> ewokscore
    ewoks --> ewoksdask
    ewoks --> ewoksppf
    ewoks --> ewoksorange
Loading
  • ewoks: main python API and CLI for workflow execution.
  • ewokscore: runtime graph and task utilities used by Ewoks Engines and Ewoks Apps.

Workflow Engines

  • ewokscore: basic engine for sequential execution.
  • ewoksdask: engine for distributed execution.
  • ewoksppf: engine that supports loops and conditional links.
  • ewoksorange: engine with a desktop graphical user interface.

Engines can be created by anyone. The ewoks package can discover all engines installed in the same python environment.

Workflow Management

  • ewoksjob: Job scheduling system
    • client: submit workflows (no ewoks installation required)
    • worker: execute workflows (ewoks installed)
  • ewoksutils: Shared utilities used by ewoks, ewokscore, and ewoksjob on both client and worker sides.
  • ewoksweb: web frontend for workflow creation and execution.
  • ewoksserver: REST server for workflow creation and execution.

Development and Operations

  • ewokssphinx: Sphinx directives for Ewoks Apps documentation.
  • ewokswhale: Ewoks docker application.
  • ewoksdraw: Graphical rendering of Ewoks workflows.

Popular repositories Loading

  1. ewoks ewoks Public

    Extensible Workflow System

    Jupyter Notebook 1

  2. ewokscore ewokscore Public

    API for graphs and tasks in Ewoks

    Python 1

  3. .github .github Public

    ewoks-kit organization management

  4. ewokswhale ewokswhale Public

    Ewoks Docker application

    Python

  5. ewoksdraw ewoksdraw Public

    Visualize Ewoks workflows

    Python

  6. ewoksppf ewoksppf Public

    Pypushflow binding for Ewoks

    Python

Repositories

Showing 10 of 13 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…