You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Server side segment pruning is currently supported for =, RANGE,IN filter operators using min-max value stats (segment metadata). Similarly, bloom filter is also used for = filter.
For IN filter operator, we should add support for bloom filter based pruning if the number of values in the IN clause are below a certain threshold.
Adding this support for large number of values in IN clause won't be helpful as the pruning may not happen (since values are likely to be spread across several segments) and the time to prune itself may negate the benefits.
The text was updated successfully, but these errors were encountered:
Server side segment pruning is currently supported for =, RANGE,IN filter operators using min-max value stats (segment metadata). Similarly, bloom filter is also used for = filter.
For IN filter operator, we should add support for bloom filter based pruning if the number of values in the IN clause are below a certain threshold.
Adding this support for large number of values in IN clause won't be helpful as the pruning may not happen (since values are likely to be spread across several segments) and the time to prune itself may negate the benefits.
The text was updated successfully, but these errors were encountered: