Skip to content

[SPARK-7165] [SQL] use sort merge join for outer join #5717

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
adrian-wang wants to merge 10 commits into from
Closed

[SPARK-7165] [SQL] use sort merge join for outer join #5717

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
d95417e
use sort merge join for outer join
adrian-wang Jun 19, 2015
71ff4e9
rebase
adrian-wang Jun 19, 2015
a8d1ff7
bring it up to date
adrian-wang Jul 30, 2015
fdea91d
fix default setting change
adrian-wang Jul 30, 2015
a4cf5cd
fix style
adrian-wang Jul 31, 2015
53c2bdb
fix comments from @jeanlyn
adrian-wang Aug 4, 2015
6a771e9
Use withSQLConf in JoinSuite
adrian-wang Aug 4, 2015
13f86bd
minor fixes
adrian-wang Aug 4, 2015
d2a1d12
bug fix
adrian-wang Aug 4, 2015
d02f6bb
fix broadcast selection
adrian-wang Aug 5, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
minor fixes
  • Loading branch information
@adrian-wang
adrian-wang committed Aug 6, 2015
commit 13f86bdea7ca713263f446548f89a16e2ee8c372
2 changes: 1 addition & 1 deletion sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoin.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ case class SortMergeJoin(
UnknownPartitioning(streamedPlan.outputPartitioning.numPartitions)
case Inner =>
PartitioningCollection(Seq(streamedPlan.outputPartitioning, bufferedPlan.outputPartitioning))
case LeftOuter | rightOuter =>
case LeftOuter | RightOuter =>
streamedPlan.outputPartitioning
case x =>
throw new IllegalStateException(s"SortMergeJoin should not take $x as the JoinType")
Expand Down
2 changes: 1 addition & 1 deletion sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -481,4 +481,4 @@ class JoinSuite extends QueryTest with SQLTestUtils with BeforeAndAfterEach {
Row(3, 1) ::
Row(3, 2) :: Nil)
}
}
}