Skip to content

Display API Sever errors in task logs & fail task on error#48580

Merged
kaxil merged 1 commit intoapache:mainfrom
astronomer:fix-pickle-error
Mar 31, 2025
Merged

Display API Sever errors in task logs & fail task on error#48580
kaxil merged 1 commit intoapache:mainfrom
astronomer:fix-pickle-error

Conversation

@kaxil
Copy link
Member

@kaxil kaxil commented Mar 31, 2025

Follow-up of #48517

Currently, when a task fails due to API Server error, the task logs shows nothing, and the task continues running.

It also leads to the pickling issue on LocalExecutor that was fixed by #48517.

This PR improves upon it and propogates the API server error in the task UI and fails the task.

image

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

Follow-up of apache#48517

Currently, when a task fails due to API Server error, the task logs shows nothing, and the task continues running.

It also leads to the pickling issue on LocalExecutor that was fixed by apache#48517.

This PR improves upon it and propogates the API server error in the task UI and fails the task.
@kaxil kaxil merged commit 02d251c into apache:main Mar 31, 2025
61 of 62 checks passed
@kaxil kaxil deleted the fix-pickle-error branch March 31, 2025 14:59
shubham-pyc pushed a commit to shubham-pyc/airflow that referenced this pull request Apr 2, 2025
)

Follow-up of apache#48517

Currently, when a task fails due to API Server error, the task logs shows nothing, and the task continues running.

It also leads to the pickling issue on LocalExecutor that was fixed by apache#48517.

This PR improves upon it and propogates the API server error in the task UI and fails the task.
nailo2c pushed a commit to nailo2c/airflow that referenced this pull request Apr 4, 2025
)

Follow-up of apache#48517

Currently, when a task fails due to API Server error, the task logs shows nothing, and the task continues running.

It also leads to the pickling issue on LocalExecutor that was fixed by apache#48517.

This PR improves upon it and propogates the API server error in the task UI and fails the task.
diogotrodrigues pushed a commit to diogotrodrigues/airflow that referenced this pull request Apr 6, 2025
)

Follow-up of apache#48517

Currently, when a task fails due to API Server error, the task logs shows nothing, and the task continues running.

It also leads to the pickling issue on LocalExecutor that was fixed by apache#48517.

This PR improves upon it and propogates the API server error in the task UI and fails the task.
simonprydden pushed a commit to simonprydden/airflow that referenced this pull request Apr 8, 2025
)

Follow-up of apache#48517

Currently, when a task fails due to API Server error, the task logs shows nothing, and the task continues running.

It also leads to the pickling issue on LocalExecutor that was fixed by apache#48517.

This PR improves upon it and propogates the API server error in the task UI and fails the task.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants