Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid including fallback message for S3TaskHandler if streaming logs #29708

Merged
merged 3 commits into from
Feb 23, 2023

Conversation

pdebelak
Copy link
Contributor

This checks the metadata for the log_pos and if it is present and greater than 1 it doesn't include the "Falling back to local log" message.

closes: #29393


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

This checks the metadata for the log_pos and if it is present and
greater than 1 it doesn't include the "Falling back to local log"
message.
Copy link
Contributor

@dstandish dstandish left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, with one suggestion

airflow/providers/amazon/aws/log/s3_task_handler.py Outdated Show resolved Hide resolved
Copy link
Contributor

@pgagnon pgagnon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nits, feel free to ignore. 👍

airflow/providers/amazon/aws/log/s3_task_handler.py Outdated Show resolved Hide resolved
airflow/providers/amazon/aws/log/s3_task_handler.py Outdated Show resolved Hide resolved
pdebelak and others added 2 commits February 22, 2023 16:58
Co-authored-by: Daniel Standish <15932138+dstandish@users.noreply.github.com>
Co-authored-by: Philippe Gagnon <12717218+pgagnon@users.noreply.github.com>
Co-authored-by: Philippe Gagnon <12717218+pgagnon@users.noreply.github.com>
@mrkcohen
Copy link

mrkcohen commented Apr 5, 2023

what version of airflow will this fix be included in?

@dimon222
Copy link
Contributor

dimon222 commented Apr 6, 2023

what version of airflow will this fix be included in?

Its in amazon providers 7.3.0
fcd3c01

PS: Airflow 2.5.2+

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
6 participants