Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[torchx.pipelines] Add an Airflow pipeline adapter #68

Closed
kiukchung opened this issue Jun 17, 2021 · 2 comments
Closed

[torchx.pipelines] Add an Airflow pipeline adapter #68

kiukchung opened this issue Jun 17, 2021 · 2 comments
Assignees
Labels
enhancement New feature or request module: pipelines issues related to the torchx.pipeline adapters

Comments

@kiukchung
Copy link
Collaborator

Description

Add support for airflow pipeline adapter for torchx AppDefs.

Motivation/Background

torchx-0.1.0.dev only supports Kubeflow Pipelines

Detailed Proposal

Essentially add: https://github.com/pytorch/torchx/tree/master/torchx/pipelines/kfp for airflow

Alternatives

N/A

Additional context/links

N/A

@kiukchung kiukchung added the enhancement New feature or request label Jun 17, 2021
@d4l3k d4l3k added the module: pipelines issues related to the torchx.pipeline adapters label Jul 14, 2021
@d4l3k
Copy link
Contributor

d4l3k commented Oct 26, 2021

@d4l3k d4l3k linked a pull request Jun 15, 2022 that will close this issue
@d4l3k
Copy link
Contributor

d4l3k commented Jun 16, 2022

Example at https://pytorch.org/torchx/main/pipelines/airflow.html

If we think we need a full airflow component / or someone wants to contribute one we can reopen this down the line

@d4l3k d4l3k closed this as completed Jun 16, 2022
@d4l3k d4l3k self-assigned this Jul 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request module: pipelines issues related to the torchx.pipeline adapters
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants