Airflow 3: Statsd removal and enable OTEL as default metrics agent

[dirrao]

Airflow 3: Statsd removal and enable OTEL as default metrics agent
related: #40800

[potiuk]

BTW. We have discussed STATSD vs. OTEL - at the last dev call and it's not at all clear if we are going to remove statsd

[dirrao]

BTW. We have discussed STATSD vs. OTEL - at the last dev call and it's not at all clear if we are going to remove statsd

Thanks for the latest update. I will put this MR on hold until further clarification.

[kaxil]

BTW. We have discussed STATSD vs. OTEL - at the last dev call and it's not at all clear if we are going to remove statsd

Thanks for the latest update. I will put this MR on hold until further clarification.

Thanks @dirrao -- we just need to figure out the impact to the users including our Helm chart users that currently uses Statsd: https://github.com/apache/airflow/tree/main/chart/templates/statsd

I will post the meeting notes of the dev call here before the end of the day today