HIVE-13582: Support for Quantified predicates for non-correlated queries #612
Conversation
| #### A masked pattern was here #### | ||
| CBO PLAN: | ||
| HiveAggregate(group=[{}], agg#0=[count()]) | ||
| HiveFilter(condition=[AND(OR(IS NULL($4), =($1, 0)), OR(IS NOT NULL($0), =($1, 0), IS NOT NULL($4)), OR(>=($2, $1), =($1, 0), IS NOT NULL($4), IS NULL($0)))]) |
There was a problem hiding this comment.
Why is this condition not pushed to inner join below?
There was a problem hiding this comment.
Hmm that's a good point and I am not sure why not. Is there a rule which does this? Or the join itself needs to be created with the condition?
There was a problem hiding this comment.
HiveFilterJoinRule should be the rule responsible to push filters into join conditions.
There was a problem hiding this comment.
It looks like HiveFilterJoinRule isn't able to push the filter on LEFT join (before join re-ordering FILTER is on top of LEFT JOIN instead of on INNER JOIN).
I can create a follow-up to further investigate this and may be fix/improve it if possible. Let me know what do you think.
There was a problem hiding this comment.
Yes, it makes sense... This may be a problem with other queries too, since algorithm ends up reordering joins considering that one of them is a cartesian product (but it is not).
vineetgarg02
force-pushed
the
HIVE-13582
branch
3 times, most recently
from
3accd61
to
f4fb5f2
Compare
This adds the support for Quantified predicates (ANY/SOME, ALL) in WHERE and SELECT.
Note that
<>ANYand=ALLis not yet supported.