Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-13917] [SQL] generate broadcast semi join #11742

Closed
wants to merge 3 commits into from

Conversation

davies
Copy link
Contributor

@davies davies commented Mar 15, 2016

What changes were proposed in this pull request?

This PR brings codegen support for broadcast left-semi join.

How was this patch tested?

Existing tests. Added benchmark, the result show 7X speedup.

@davies davies changed the title generate semi join [SPARK-13917] [SQL] generate broadcast semi join Mar 15, 2016
@davies
Copy link
Contributor Author

davies commented Mar 15, 2016

cc @nongli

@SparkQA
Copy link

SparkQA commented Mar 15, 2016

Test build #53223 has finished for PR 11742 at commit 3298319.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 15, 2016

Test build #53226 has finished for PR 11742 at commit 7471741.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

|$numOutput.add(1);
|${consume(ctx, input)}
""".stripMargin

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

extra new line

@nongli
Copy link
Contributor

nongli commented Mar 16, 2016

LGTM

@asfgit asfgit closed this in 421f6c2 Mar 16, 2016
@SparkQA
Copy link

SparkQA commented Mar 16, 2016

Test build #53278 has finished for PR 11742 at commit f1ca6f2.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

roygao94 pushed a commit to roygao94/spark that referenced this pull request Mar 22, 2016
## What changes were proposed in this pull request?

This PR brings codegen support for broadcast left-semi join.

## How was this patch tested?

Existing tests. Added benchmark, the result show 7X speedup.

Author: Davies Liu <davies@databricks.com>

Closes apache#11742 from davies/gen_semi.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants