Skip to content

[SPARK-12602] [SQL] Join Reordering: Pushing Inner Join Through Left/Right Outer Join #10551

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
gatorsmile wants to merge 6 commits into from
Closed

[SPARK-12602] [SQL] Join Reordering: Pushing Inner Join Through Left/Right Outer Join #10551

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
41703c2
Merge remote-tracking branch 'upstream/master' into outerInnerReordering
gatorsmile Jan 2, 2016
7237f61
reorder outer and inner joins
gatorsmile Jan 2, 2016
d9b5411
renaming.
gatorsmile Jan 2, 2016
5f67a74
restrict the types
gatorsmile Jan 2, 2016
70336a4
support mixed order and unmatched join key
gatorsmile Jan 2, 2016
7909d4c
convert right outer join to left outer join for generating left depp …
gatorsmile Jan 2, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
renaming.
  • Loading branch information
@gatorsmile
gatorsmile committed Jan 2, 2016
commit d9b54115f6dbd3e815963cec702a4a8aae28c154
6 changes: 3 additions & 3 deletions sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ abstract class Optimizer extends RuleExecutor[LogicalPlan] {
SetOperationPushDown,
SamplePushDown,
ReorderInnerJoin,
ReorderOuterInner,
ReorderOuterInnerJoins,
PushPredicateThroughJoin,
PushPredicateThroughProject,
PushPredicateThroughGenerate,
Expand Down Expand Up @@ -771,11 +771,11 @@ object ReorderInnerJoin extends Rule[LogicalPlan] with PredicateHelper {


/**
* Reorder the adjacent outer and inner joins and push inner join below left/right outer join.
* Reorder the adjacent outer and inner joins and push inner join through left/right outer join.
*
* TODO: improve the checking conditions to cover out-of-order cases.
*/
object ReorderOuterInner extends Rule[LogicalPlan] {
object ReorderOuterInnerJoins extends Rule[LogicalPlan] {
def apply(plan: LogicalPlan): LogicalPlan = plan transform {

case j @ Join(left @ Join(ll, lr, joinType, lCondition), right, Inner, condition) =>
Expand Down