Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove duplicate call to sync_metadata inside DagFileProcessorManager #15121

Merged
merged 1 commit into from Mar 31, 2021

Conversation

ashb
Copy link
Member

@ashb ashb commented Mar 31, 2021

_process_message already calls sync_metadata if it's a DagParsingStat,
so there's no need to call it again. This isn't expensive, but no point
doing it

I've also added a runtime check to ensure this function is only used in
sync mode, which makes the purpose/logic used in this function clearer.

`_process_message` already calls sync_metadata if it's a DagParsingStat,
so there's no need to call it again.  This isn't expensive, but no point
doing it

I've also added a runtime check to ensure this function is only used in
sync mode, which makes the purpose/logic used in this function clearer.
@ashb ashb requested a review from XD-DENG March 31, 2021 21:04
@boring-cyborg boring-cyborg bot added the area:Scheduler Scheduler or dag parsing Issues label Mar 31, 2021
@ashb ashb merged commit 116a8a0 into apache:master Mar 31, 2021
@ashb ashb deleted the avoid-duplicate-sync-metadata branch March 31, 2021 22:23
kaxil pushed a commit to astronomer/airflow that referenced this pull request Apr 1, 2021
…apache#15121)

`_process_message` already calls sync_metadata if it's a DagParsingStat,
so there's no need to call it again.  This isn't expensive, but no point
doing it

I've also added a runtime check to ensure this function is only used in
sync mode, which makes the purpose/logic used in this function clearer.

(cherry picked from commit 116a8a0)
kaxil pushed a commit to astronomer/airflow that referenced this pull request Apr 12, 2021
…apache#15121)

`_process_message` already calls sync_metadata if it's a DagParsingStat,
so there's no need to call it again.  This isn't expensive, but no point
doing it

I've also added a runtime check to ensure this function is only used in
sync mode, which makes the purpose/logic used in this function clearer.

(cherry picked from commit 116a8a0)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Scheduler Scheduler or dag parsing Issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants