Skip to content

Keep provider_config_fallback_defaults.cfg in sync with provider.yaml - #72549

Draft
FrankYang0529 wants to merge 1 commit into
apache:mainfrom
FrankYang0529:airflow-provider-config-fallback-defaults-sync
Draft

Keep provider_config_fallback_defaults.cfg in sync with provider.yaml#72549
FrankYang0529 wants to merge 1 commit into
apache:mainfrom
FrankYang0529:airflow-provider-config-fallback-defaults-sync

Conversation

@FrankYang0529

@FrankYang0529 FrankYang0529 commented Sep 5, 2026

Copy link
Copy Markdown
Member

Why

How

  • Remove the [atlas] section, worker_precheck and worker_pods_queued_check_interval; replace use_ssl with http_compress = False in [elasticsearch_configs].
  • Drop the two docs lines that list password in [atlas] as _cmd / _secret capable.
  • Replace the worker_precheck row in CFG_FALLBACK_CONFIG_OPTIONS (devel-common test data) with worker_prefetch_multiplier.
  • Add the check-provider-config-fallback-defaults prek hook : every (section, option) in the cfg must be declared in some providers/**/provider.yaml with the same default. It runs whenever the cfg or a provider.yaml changes, and only checks that the cfg is a subset of provider.yaml.

Verification

  • uv run --project scripts pytest scripts/tests/ci/prek/test_check_provider_config_fallback_defaults.py
  • uv run --no-sync pytest airflow-core/tests/unit/core/test_configuration.py
  • cd task-sdk && uv run --no-sync pytest tests/task_sdk/test_configuration.py

Was generative AI tooling used to co-author this PR?
  • Yes - Claude Code

  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant