airflow v3 : conn_id `xxx` isn't defined

[raphaelauv]

Apache Airflow version

main (development)

What happened?

Using airflow main branch , with breeze breeze start-airflow

I create a K8S connection with the normal UI, the connection is present in the UI , I can see it with the swagger but I can run a task using it

from airflow import DAG
from pendulum import today
from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator

with DAG(
    dag_id="kubernetes_dag",
    schedule=None,
    start_date=today("UTC").add(days=-1)
):
    KubernetesPodOperator(
        task_id="task-one",
        namespace="default",
        kubernetes_conn_id="toto",
        image="alpine:3.16.2",
        cmds=["sh", "-c", "echo hello"],
    )

fail with

{"logger":"airflow.models.connection","timestamp":"2025-01-12T15:02:27.744286","error_detail":[{"exc_type":"RuntimeError","exc_value":"UNEXPECTED COMMIT - THIS WILL BREAK HA LOCKS!","syntax_error":null,"is_cause":false,"frames":[{"filename":"/opt/airflow/airflow/models/connection.py","lineno":463,"name":"get_connection_from_secrets"},{"filename":"/opt/airflow/airflow/utils/session.py","lineno":101,"name":"wrapper"},{"filename":"/usr/local/lib/python3.9/contextlib.py","lineno":126,"name":"__exit__"},{"filename":"/opt/airflow/airflow/utils/session.py","lineno":43,"name":"create_session"},{"filename":"/usr/local/lib/python3.9/site-packages/sqlalchemy/orm/session.py","lineno":1454,"name":"commit"},{"filename":"/usr/local/lib/python3.9/site-packages/sqlalchemy/orm/session.py","lineno":832,"name":"commit"},{"filename":"/usr/local/lib/python3.9/site-packages/sqlalchemy/orm/session.py","lineno":800,"name":"_prepare_impl"},{"filename":"/usr/local/lib/python3.9/site-packages/sqlalchemy/event/attr.py","lineno":346,"name":"__call__"},{"filename":"/opt/airflow/airflow/utils/sqlalchemy.py","lineno":382,"name":"_validate_commit"}]}],"event":"Unable to retrieve connection from secrets backend (MetastoreBackend). Checking subsequent secrets backend.","level":"error"}
{"timestamp":"2025-01-12T15:02:27.744664","logger":"task","error_detail":[{"exc_type":"AirflowNotFoundException","exc_value":"The conn_id `toto` isn't defined","syntax_error":null,"is_cause":false,"frames":[{"filename":"/opt/airflow/task_sdk/src/airflow/sdk/execution_time/task_runner.py","lineno":448,"name":"run"},{"filename":"/opt/airflow/task_sdk/src/airflow/sdk/execution_time/task_runner.py","lineno":547,"name":"_execute_task"},{"filename":"/opt/airflow/airflow/models/baseoperator.py","lineno":376,"name":"wrapper"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/operators/pod.py","lineno":583,"name":"execute"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/operators/pod.py","lineno":591,"name":"execute_sync"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/operators/pod.py","lineno":1157,"name":"build_pod_request_obj"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/hooks/kubernetes.py","lineno":292,"name":"is_in_cluster"},{"filename":"/usr/local/lib/python3.9/functools.py","lineno":993,"name":"__get__"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/hooks/kubernetes.py","lineno":300,"name":"api_client"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/hooks/kubernetes.py","lineno":212,"name":"get_conn"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/hooks/kubernetes.py","lineno":205,"name":"_get_field"},{"filename":"/usr/local/lib/python3.9/functools.py","lineno":993,"name":"__get__"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/hooks/kubernetes.py","lineno":186,"name":"conn_extras"},{"filename":"/opt/airflow/providers/src/airflow/providers/cncf/kubernetes/hooks/kubernetes.py","lineno":176,"name":"get_connection"},{"filename":"/opt/airflow/airflow/hooks/base.py","lineno":65,"name":"get_connection"},{"filename":"/opt/airflow/airflow/models/connection.py","lineno":474,"name":"get_connection_from_secrets"}]}],"event":"Task failed with exception","level":"error"}

Operating System

ubuntu 24.04

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[raphaelauv]

from official airflow slack is found that you can set

AIRFLOW__CORE__EXECUTOR=SequentialExecutor

until LocalExecutor is switched to new AIP-72 implementation