No task logs in airflow UI

[ido177]

Apache Airflow version

3.0.4

If "Other Airflow 2 version" selected, which one?

2.10

What happened?

When running a task, if it transitions to the UP_FOR_RETRY state, no logs are displayed in the Airflow UI for that task attempt.
This seems to have been introduced in commit #41272.

What you think should happen instead?

Logs for all task attempts should be available in the UI, even if the attempt ends with UP_FOR_RETRY.

How to reproduce

• Deploy Airflow via the official Helm chart (1.18.0) in Kubernetes.
• Configure logging to store logs local on the worker pods.
• Run a DAG with a task that is expected to fail and retry.
• When the task enters the UP_FOR_RETRY state, check its logs in the UI.

Operating System

Debian GNU/Linux 12 (bookworm)

Versions of Apache Airflow Providers

Any — this is a core Airflow issue, not related to a specific provider version.

Deployment

Official Apache Airflow Helm Chart

Deployment details

Deployed in Kubernetes with local log storage (inside the pods).

Anything else?

I previously patched my own Airflow build and it worked

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[FencyC]

Hi,

We are also seeing this issue on Airflow 2.10.5, which began after our upgrade to 2.10.0. Our logs are synced to AWS S3.
The task logs disappear from the UI (or become unavailable) only when a task fails and is put up_for_retry.

However, we have confirmed that all log files, including those for failed attempts, are present and complete in our S3 bucket. This suggests the issue is with the Airflow UI's ability to retrieve or display these logs when a task is in the up_for_retry state.

This makes debugging very difficult, as we can't easily review logs from failed attempts before a retry starts. Looks like this is a serious bug in Airflow Core. Can someone help us to fix this?
Thanks !