Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-10443] [SQL] Refactor SortMergeOuterJoin to reduce duplication #8596

Closed
wants to merge 1 commit into from

Conversation

andrewor14
Copy link
Contributor

LeftOutputIterator and RightOutputIterator are symmetrically identical and can share a lot of code. If someone makes a change in one but forgets to do the same thing in the other we'll end up with inconsistent behavior. This patch also adds inline comments to clarify the intention of the code.

This commit merges the two existing output iterator classes in
an effort to reduce the symmetrically duplicate code. It also
adds comments to make it more readable.
@andrewor14
Copy link
Contributor Author

@JoshRosen if you have time (this is relatively low priority)

@SparkQA
Copy link

SparkQA commented Sep 4, 2015

Test build #41990 has finished for PR 8596 at commit cc4b553.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14 andrewor14 changed the title [SPARK-10443] Refactor SortMergeOuterJoin to reduce duplication [SPARK-10443] [SQL] Refactor SortMergeOuterJoin to reduce duplication Sep 4, 2015
@davies
Copy link
Contributor

davies commented Sep 10, 2015

LGTM

@davies
Copy link
Contributor

davies commented Sep 10, 2015

Merged into master.

@asfgit asfgit closed this in 3db7255 Sep 10, 2015
@andrewor14 andrewor14 deleted the smoj-cleanup branch September 10, 2015 20:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants