Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
[SPARK-19851] Add support for EVERY and ANY (SOME) aggregates #22047
What changes were proposed in this pull request?
Please give credit to @ptkool for this work.
Description from original PR:
How was this patch tested?
Testing was performed using unit tests, integration tests, and manual tests.
@gatorsmile I tried to implement the rewrites suggested in the original PR. It does not seem very straightforward to me. The basic issue is, we are unable to replace the aggregate expression to a scalar expression over aggregates. We only support limited number of true aggregate expressions under window.
For example -we are unable to rewrite .
I tried a similar frame work to replace aggregate expressions like