Skip to content

Conversation

@ahshahid
Copy link
Contributor

What changes were proposed in this pull request?

Combined PR for SPARK-55072 and SPARK-55185

Why are the changes needed?

To verify that the issue of SPARK-55072 is fixed by taking in along the changes of SPARK-55185

Does this PR introduce any user-facing change?

No

How was this patch tested?

Bugtests added

Was this patch authored or co-authored using generative AI tooling?

No

…romConstraints rule are run as part of the operatorOptimizationRuleSet, so that generated filter on Left leg of Join, in some specific situation, is not missed
…romConstraints rule are run as part of the operatorOptimizationRuleSet, so that generated filter on Left leg of Join, in some specific situation, is not missed
…romConstraints rule are run as part of the operatorOptimizationRuleSet, so that generated filter on Left leg of Join, in some specific situation, is not missed
…romConstraints rule are run as part of the operatorOptimizationRuleSet, so that generated filter on Left leg of Join, in some specific situation, is not missed
…romConstraints rule are run as part of the operatorOptimizationRuleSet, so that generated filter on Left leg of Join, in some specific situation, is not missed
…romConstraints rule are run as part of the operatorOptimizationRuleSet, so that generated filter on Left leg of Join, in some specific situation, is not missed
…straint rule is run as part of post optimzation batch with fixed ietrations
…straint rule is run as part of post optimzation batch with fixed ietrations
@github-actions github-actions bot added the SQL label Jan 26, 2026
@github-actions
Copy link

JIRA Issue Information

=== Bug SPARK-55185 ===
Summary: Adding rule InferFiltersFromConstraints to the Batch "Operator Optimization after Inferring Filters" causes idempotency break
Assignee: None
Status: Open
Affected: ["4.2.0","4.1.1"]

=== Improvement SPARK-55072 ===
Summary: Inferring new Constraint misses IsNotNull on Left Leg, when an Outer Join gets converted into inner Join
Assignee: None
Status: Open
Affected: ["4.2.0","4.1.1"]


This comment was automatically generated by GitHub Actions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant