Skip to content

Add capability in Airflow connections to validate host #31460

@amoghrajesh

Description

@amoghrajesh

Apache Airflow version

2.6.1

What happened

While creating connections in airflow, the form doesn't check for the correctness of the format of the host provided. For instance, we can proceed providing something like this which is not a valid url: spark://k8s://100.68.0.1:443?deploy-mode=cluster. It wont instantly fail but will return faulty hosts and other details if called later.

Motivation:
#31376 (comment)

What you think should happen instead

The Connection form can have a validator which should check for these scenarios and report if there is an issue to save developers and users time later.

How to reproduce

  1. Go to airflow connections form
  2. Fill in connection host as: spark://k8s://100.68.0.1:443?deploy-mode=cluster, other details can be anything
  3. Create the connection
  4. Run airflow connections get <name>
  5. The host and schema will be wrong

Operating System

Macos

Versions of Apache Airflow Providers

No response

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions