Skip to content

Conversation

@davies
Copy link
Contributor

@davies davies commented Mar 15, 2016

What changes were proposed in this pull request?

This PR brings codegen support for broadcast left-semi join.

How was this patch tested?

Existing tests. Added benchmark, the result show 7X speedup.

@davies davies changed the title generate semi join [SPARK-13917] [SQL] generate broadcast semi join Mar 15, 2016
@davies
Copy link
Contributor Author

davies commented Mar 15, 2016

cc @nongli

@SparkQA
Copy link

SparkQA commented Mar 15, 2016

Test build #53223 has finished for PR 11742 at commit 3298319.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 15, 2016

Test build #53226 has finished for PR 11742 at commit 7471741.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

|$numOutput.add(1);
|${consume(ctx, input)}
""".stripMargin

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

extra new line

@nongli
Copy link
Contributor

nongli commented Mar 16, 2016

LGTM

@asfgit asfgit closed this in 421f6c2 Mar 16, 2016
@SparkQA
Copy link

SparkQA commented Mar 16, 2016

Test build #53278 has finished for PR 11742 at commit f1ca6f2.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

roygao94 pushed a commit to roygao94/spark that referenced this pull request Mar 22, 2016
## What changes were proposed in this pull request?

This PR brings codegen support for broadcast left-semi join.

## How was this patch tested?

Existing tests. Added benchmark, the result show 7X speedup.

Author: Davies Liu <[email protected]>

Closes apache#11742 from davies/gen_semi.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants