Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Endpoint for dag_run status #80

Open
6 tasks done
hannelita opened this issue Jul 28, 2020 · 1 comment
Open
6 tasks done

Endpoint for dag_run status #80

hannelita opened this issue Jul 28, 2020 · 1 comment
Labels
enhancement New feature or request
Milestone

Comments

@hannelita
Copy link
Contributor

hannelita commented Jul 28, 2020

Acceptance

  • <DAG_ID>/dag_run endpoint on CKAN which gives a report with the status of the DAG
  • Collect Airflow default API response for a DAG (for local and remote Airflow instances)

Note: This task won't provide any integration with GCP logs (see #69 ); it only collects the output of Airflow API

Tasks

  • Create endpoint; DAG_RUN is optional. If no DAG_RUN is specified, list the most recent dag_runs
  • If a DAG run is specified, retrieve info only for that particular RUN (note: when you trigger the DAG, the response brings the DAG_RUN (see /aircan_submit will take the DAG name #79)
  • Return Airflow API response (local Airflow)
  • Return Airflow API response (remote Airflow). It will require another integration with GCP
@hannelita hannelita added the enhancement New feature or request label Jul 28, 2020
@hannelita hannelita added this to the August 3rd milestone Jul 28, 2020
@hannelita hannelita added this to To Do in Project Management via automation Jul 28, 2020
@hannelita hannelita moved this from To Do to Prioritized in Project Management Jul 31, 2020
@hannelita hannelita moved this from Prioritized to In progress in Project Management Aug 10, 2020
@hannelita hannelita modified the milestones: August 3rd, Aug 17 Aug 10, 2020
@hannelita hannelita moved this from In progress to In Review in Project Management Aug 12, 2020
@hannelita hannelita moved this from In Review to Done in Project Management Aug 31, 2020
@rufuspollock
Copy link
Member

@hannelita could you update this issue quickly with some info on what status is and update e.g. acceptance with links to outputs / items justifying the completion status.

Then if everything is done can you closed as FIXED with a brief note 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
Development

No branches or pull requests

2 participants