Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Verify workflow success in CI on Airflow #48

Merged
merged 8 commits into from Feb 22, 2023

Conversation

vaibhavk1992
Copy link
Contributor

No description provided.

Copy link
Contributor

@arielshaqed arielshaqed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very neat, thanks! Just a bunch of small but important comments.

I am not sure how the translation works from printing a code in step dag_status_id to failing the action in state Check failed DAG satus. In any case I have a suggestion how to improve the script so that hopefully we won't need this step at all!

Also, please run flake8 on the Python program.

dag_status.py Show resolved Hide resolved
dag_status.py Outdated Show resolved Hide resolved
dag_status.py Outdated Show resolved Hide resolved
dag_status.py Outdated Show resolved Hide resolved
.github/workflows/provider.yaml Outdated Show resolved Hide resolved
.github/workflows/provider.yaml Outdated Show resolved Hide resolved
dag_status.py Outdated Show resolved Hide resolved
Copy link
Contributor

@arielshaqed arielshaqed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this! It is a big improvement to our CI.

@arielshaqed arielshaqed merged commit 34d29d5 into treeverse:main Feb 22, 2023
FredrikBakken pushed a commit to FredrikBakken/airflow-provider-lakeFS that referenced this pull request Aug 13, 2023
* Adding airflow status checker

* Adding airflow status checker

* Adding airflow package to requirement

* Adding the dag run status via API route

* Adding the dag run status via API route

* Adding the dag auth as user and pass

* Adding final kill in case of long running DAG

* Added few lines and changed code as requested
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants