Skip to content

Conversation

@andygrove
Copy link
Member

@andygrove andygrove commented Jul 6, 2022

Which issue does this PR close?

Closes #2842

Rationale for this change

Anti joins were ignoring join filters and producing incorrect results. See #2842 for an example

What changes are included in this PR?

  • Swap the order of some code so that join filters are applied earlier

Are there any user-facing changes?

No

@github-actions github-actions bot added the core Core DataFusion crate label Jul 6, 2022
@avantgardnerio avantgardnerio mentioned this pull request Jul 6, 2022
@avantgardnerio
Copy link
Contributor

I tested against postgres in some simple tests & TPC-H query 21 and it works as expected!

@andygrove
Copy link
Member Author

Thanks for the review @Dandandan and thanks @avantgardnerio for uncovering this issue while working on optimizer rules to decorrelate subqueries!

@andygrove andygrove requested a review from alamb July 6, 2022 14:22
@andygrove andygrove merged commit ae6dab0 into apache:master Jul 6, 2022
@andygrove andygrove deleted the anti-join-with-filter branch July 6, 2022 18:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core DataFusion crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Anti join ignores join filters

3 participants