SQL extractor causing snowflake query timeouts

[harels]

a user is using Airflow to run relatively simple Snowflake queries using a SnowflakeHook.
These queries usually finish in <30 seconds, but approximately 5-10% of the time the task executing them deadlocks and runs forever until being killed manually by a user or by Airflow when the DAG timeout is reached.
When the task is terminated, I see that execution hung while the Snowflake connector was performing OCSP validation.
Setting "insecure_mode=True" on the Snowflake connection resolves the problem but this solution is not ideal.
I've tried upgrading both snowflake-connector-python and apache-airflow-providers-snowflake to their latest versions (2.8.0 and 3.3.0) with no change in behavior.

Snowflake team identified a potential conflict with OpenLineage that may be responsible for this behavior.
by passing the environmental variable OPENLINEAGE_DISABLED=True, the connection failures went away.

Issue raised with Snowflake too:
snowflakedb/snowflake-connector-python#1299

apache-airflow==2.4.1+astro.1
apache-airflow-providers-snowflake==2.5.0
snowflake-connector-python==2.7.1
snowflake-sqlalchemy==1.4.2
openlineage-airflow==0.14.1
openlineage-integration-common==0.14.1
openlineage-python==0.14.1
openlineage_sql==0.14.1

[harels]

might be related to #833

[mobuchowski]

Will take a look on this on Airflow side.

[denimalpaca]

@harels @mobuchowski did #1435 complete this?

[kacpermuda]

We removed snowflake calls in Airflow integration: apache/airflow#39113

[JDarDagran]

Closing for now. Snowflake released possible fix but seems a bit unrelated to this.