Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v1.0.0 release #5

Merged
merged 91 commits into from
May 11, 2024
Merged

v1.0.0 release #5

merged 91 commits into from
May 11, 2024

Conversation

ryanchao2012
Copy link
Owner

@ryanchao2012 ryanchao2012 commented Apr 7, 2024

Migrate Task to new interface

class TaskAttribute:
    op_class: str = "EmptyOperator"
    op_module: str = None
    op_params: Dict[str, Any] = None
    upstream: TaskClass | Iterable[TaskClass, ...] = None
    downstream: TaskClass | Iterable[TaskClass, ...] = None


class Task(TaskAttribute):
    @classmethod
    def _get_taskid(cls):
        ...

    @classmethod        
    def _to_varname(cls):
        ...

    @classmethod
    def _to_ast(cls):
        ...

    @classmethod  # with cache
    def _get_attributes(cls):
        ...

    @classmethod
    def _resolve_operator(cls) -> Type:
        ...
    
    
AirFly = Task


class TaskPair:
    up: TaskClass
    down: TaskClass

    @classmethod
    def _to_ast(cls):
        ...

class TaskTree:
    taskset: Set[TaskClass]
    taskpairs: Set[TaskPair]

    @classmethod
    def from_module(cls, module: ModuleType):
        ...

    def to_dag(self, name: str, includes, dag_params, formatted=True) -> str:
        ...

    def _collect_taskset(cls):
        ...
        
    def _collect_taskpairs(cls):
        ...

    def _to_ast(self):
        ...

    def _build_header(self):
        ...

    def _build_imports(self):
        ...

    def _build_includes(self):
        ...

    def _build_dag_context(self):
        ...

@ryanchao2012 ryanchao2012 marked this pull request as ready for review April 28, 2024 17:02
@ryanchao2012 ryanchao2012 added this to the v1.0.0 milestone Apr 28, 2024
@ryanchao2012
Copy link
Owner Author

ryanchao2012 commented Apr 28, 2024

plan to release on 2024/05/05 2024/05/10

@ryanchao2012 ryanchao2012 changed the title v1.0.0 v1.0.0 release Apr 29, 2024
@ryanchao2012 ryanchao2012 merged commit a956c0e into main May 11, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant