Skip to content

Support dynamic filters for range co-partitioned joins #23376

Description

@gene-bordegaray

Is your feature request related to a problem or challenge?

Partitioned hash join dynamic filter pushdown is currently disable for non-hash partitioning. That is because current routing can incorrectly filter rows from the probe side.

With range co-partitioned joins, the optimizer can prove declare left partition i and right partition i cover compatible key domains. Thus dynamic filter for partition i can be routed to probe partition i.

Describe the solution you'd like

Allow partitioned join dynamic filters when the join inputs are co-partitioned by the join keys.

Describe alternatives you've considered

Another option is a global dynamic filter that is applied to all probe partitions. That is simpler, but less precise and potentially more expensive than partition-local routing.

Additional context

Related:

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions