Skip to content

Commit 571ca84

Browse files
Adding module docs
1 parent 5401c2e commit 571ca84

File tree

2 files changed

+19
-20
lines changed

2 files changed

+19
-20
lines changed

codeflare/pipelines/Datamodel.py

Lines changed: 14 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -1,23 +1,22 @@
1-
"""Data Model
2-
1+
"""codeflare.pipelines.Datamodel
32
The core data model structures are defined here. These include the various aspects for creating a DAG, the
43
input and output to the DAG itself.
54
6-
- :class:`~codeflare.pipelines.Datamodel.Pipeline`
7-
The pipeline graph is captured in Pipeline class with the supporting constructs of Node and Edge. There are
8-
different types of nodes, the key ones are EstimatorNode and an AndNode. The details of the kind of nodes
9-
are captured in a separate document that also outlines the type, the firing semantics (when a node gets executed),
10-
and the state of it.
11-
12-
The input and output for the pipeline are captured in the PipelineInput and PipelineOutput classes, which are
13-
supported by the Xy and XYRef classes. The basic data are captured in Xy and XYRef, where XYRef is a holder for
14-
pointers to X and y. The input to the pipeline defines which nodes take what Xy pointers, whereas the pipeline
15-
output defines what nodes produce the outputs.
16-
17-
Finally, the data model allows for morphing of pipeline based on parameterizations, these parameterizations can
18-
be for grid search or for other such similar reasons.
5+
- :class:`~codeflare.pipelines.Datamodel.Pipeline`: The class that defines the pipeline graph is captured, which is supported by Node and Edge constructs.
6+
- :class:`~codeflare.pipelines.Datamodel.Node`: The node class that has two implementations, :class:`~codeflare.pipelines.Datamodel.EstimatorNode` and :class:`~codeflare.pipelines.Datamodel.AndNode`, the details of these are captured in a separate document on nodes and their semantics defined by the type, firing semantics, and state.
7+
- :class:`~codeflare.pipelines.Datamodel.PipelineInput`: The input for pipeline, supported by Xy and XYRef holder classes.
8+
- :class:`~codeflare.pipelines.Datamodel.PipelineOutput`: The output for pipeline (after execution), supported by Xy and XYRef holder classes.
9+
- :class:`~codeflare.pipelines.Datamodel.Xy`: A basic holder class for X and y, both of which are numpy arrays.
10+
- :class:`~codeflare.pipelines.Datamodel.XYRef`: A basic holder class for pointers to X and y, pointers are reference to objects in Plasma store of Ray.
11+
- :class:`~codeflare.pipelines.Datamodel.PipelineParam`: Finally, the data model allows for morphing of pipeline based on parameterizations, these parameterizations can be for grid search or for other such similar reasons.
1912
"""
2013

14+
# Authors: Mudhakar Srivatsa <msrivats@us.ibm.com>
15+
# Raghu Ganti <rganti@us.ibm.com>
16+
# Carlos Costa <chcost@us.ibm.com>
17+
#
18+
# License: Apache v2.0
19+
2120
from abc import ABC, abstractmethod
2221
from enum import Enum
2322

@@ -32,8 +31,6 @@
3231

3332
class Xy:
3433
"""
35-
.. _xy
36-
3734
Holder class for Xy, where X is array-like and y is array-like. This is the base
3835
data structure for fully materialized X and y.
3936

docs/source/conf.py

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,9 +10,11 @@
1010
# add these directories to sys.path here. If the directory is relative to the
1111
# documentation root, use os.path.abspath to make it absolute, like shown here.
1212
#
13-
# import os
14-
# import sys
15-
# sys.path.insert(0, os.path.abspath('.'))
13+
#import os
14+
#import sys
15+
#sys.path.insert(0, os.path.abspath('../'))
16+
#sys.path.insert(0, os.path.abspath('../codeflare/'))
17+
#sys.path.insert(0, os.path.abspath('../codeflare/pipelines/'))
1618

1719

1820
# -- Project information -----------------------------------------------------

0 commit comments

Comments
 (0)