Skip to content

[SPARK-18891][SQL] Support for Scala Map collection types #16986

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
michalsenkyr wants to merge 9 commits into from
Closed

[SPARK-18891][SQL] Support for Scala Map collection types #16986

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
e94a255
Arbitrary map support implementation
michalsenkyr Feb 12, 2017
8e1d924
Add support for Java Maps
michalsenkyr Feb 26, 2017
b65f6ce
Fix code style
michalsenkyr Apr 16, 2017
bea90d5
Remove Java Map support
michalsenkyr May 19, 2017
7af9b06
Merge branch 'master' into dataset-map-builder
michalsenkyr May 22, 2017
e47abc6
Set returnNullable to false on map key function
michalsenkyr Jun 4, 2017
25ec2f0
Remove parameters containing element data types
michalsenkyr Jun 4, 2017
dbdcb9c
Remove Java Map specific code
michalsenkyr Jun 10, 2017
e37e0ca
Store key/value arrays in local vars
michalsenkyr Jun 10, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'master' into dataset-map-builder
  • Loading branch information
@michalsenkyr
michalsenkyr authored May 22, 2017
commit 7af9b0625a245d34943b7192532c93f2aafac635
5 changes: 5 additions & 0 deletions sql/core/src/test/scala/org/apache/spark/sql/DatasetPrimitiveSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -339,6 +339,11 @@ class DatasetPrimitiveSuite extends QueryTest with SharedSQLContext {
LHMapClass(LHMap(1 -> 2)) -> LHMap("test" -> MapClass(Map(3 -> 4))))
}

test("nested sequences") {
checkDataset(Seq(Seq(Seq(1))).toDS(), Seq(Seq(1)))
checkDataset(Seq(List(Queue(1))).toDS(), List(Queue(1)))
}

test("package objects") {
import packageobject._
checkDataset(Seq(PackageClass(1)).toDS(), PackageClass(1))
Expand Down
You are viewing a condensed version of this merge commit. You can view the full changes here.