Airflow UI DAG Import Errors

[bparhy]

Apache Airflow version

2.1.3

What happened

We are using airflow in k8s. Webserver and scheduler are running without any errors in their logs.

Below is the snippet of a DAG.

from airflow import DAG
from airflow.operators.python_operator import PythonOperator
from airflow.providers.snowflake.hooks.snowflake import SnowflakeHook
from airflow.providers.snowflake.operators.snowflake import SnowflakeOperator
from bi_plugin import SnowflakeMultiSqlStatmentOperator

I am seeing the below error in the UI. But the dag is parsing perfect and I can see its code and I can run it with out any issue.

Broken DAG: [/usr/local/airflow/dags/network/vbc_telemetry_feed_prod.py] Traceback (most recent call last):
File "", line 219, in _call_with_frames_removed
File "/usr/local/airflow/dags/network/vbc_telemetry_feed_prod.py", line 5, in
from bi_plugin import SnowflakeMultiSqlStatmentOperator
ModuleNotFoundError: No module named 'bi_plugin'

We used to have plugin code in this bi_plugin module with 2.1.3 migration we are still keeping the bi_plugin file in the plugins folder which is again inside the dags folder and our imports are changed to

from bi_plugin import SnowflakeMultiSqlStatmentOperator

Please let me know. Any help in this direction is appreciated.

What you expected to happen

I was expecting no errors in the UI.

How to reproduce

No response

Operating System

linux

Versions of Apache Airflow Providers

No response

Deployment

Other 3rd-party Helm chart

Deployment details

This is a kubernetes deployment with two schedulers and one webserver.

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct