Skip to content

[SPARK-23933][SQL] Add map_from_arrays function #21258

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kiszk wants to merge 13 commits into from
Closed

[SPARK-23933][SQL] Add map_from_arrays function #21258

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
e4171e1
initial commit
kiszk May 7, 2018
95d92d8
fix pyspark test failure
kiszk May 7, 2018
1df6bb5
address review comments
kiszk May 7, 2018
2075770
address review comments
kiszk May 15, 2018
d5ff7be
fix pyspark test failure
kiszk May 16, 2018
4eee89d
fix pyspark test failure
kiszk May 17, 2018
7b66ab4
fix pyspark test failure
kiszk May 17, 2018
2fcbb80
fix pyspark test faiure
kiszk May 18, 2018
228fcc6
address review comments
kiszk Jun 8, 2018
6d53a96
address review comments
kiszk Jun 8, 2018
a4b3ec2
use show() to check pyspark result
kiszk Jun 10, 2018
a0b4ac5
fix pyspark test error
kiszk Jun 10, 2018
38d0868
address review comments
kiszk Jun 11, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
address review comments
  • Loading branch information
@kiszk
kiszk committed Jun 11, 2018
commit 38d086877385324ae872652e9dbeb484a0915557
12 changes: 6 additions & 6 deletions sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -204,8 +204,8 @@ class ComplexTypeSuite extends SparkFunSuite with ExpressionEvalHelper {
val strArray = Literal.create(strSeq, ArrayType(StringType, false))

val integerArray = Literal.create(integerSeq, ArrayType(IntegerType, true))
val intwithNullArray = Literal.create(intWithNullSeq, ArrayType(IntegerType, true))
val longwithNullArray = Literal.create(longWithNullSeq, ArrayType(LongType, true))
val intWithNullArray = Literal.create(intWithNullSeq, ArrayType(IntegerType, true))
val longWithNullArray = Literal.create(longWithNullSeq, ArrayType(LongType, true))

val nullArray = Literal.create(null, ArrayType(StringType, false))

Expand All @@ -214,15 +214,15 @@ class ComplexTypeSuite extends SparkFunSuite with ExpressionEvalHelper {
checkEvaluation(MapFromArrays(integerArray, strArray), createMap(integerSeq, strSeq))

checkEvaluation(
MapFromArrays(strArray, intwithNullArray), createMap(strSeq, intWithNullSeq))
MapFromArrays(strArray, intWithNullArray), createMap(strSeq, intWithNullSeq))
checkEvaluation(
MapFromArrays(strArray, longwithNullArray), createMap(strSeq, longWithNullSeq))
MapFromArrays(strArray, longWithNullArray), createMap(strSeq, longWithNullSeq))
checkEvaluation(
MapFromArrays(strArray, longwithNullArray), createMap(strSeq, longWithNullSeq))
MapFromArrays(strArray, longWithNullArray), createMap(strSeq, longWithNullSeq))
checkEvaluation(MapFromArrays(nullArray, nullArray), null)

intercept[RuntimeException] {
checkEvaluation(MapFromArrays(intwithNullArray, strArray), null)
checkEvaluation(MapFromArrays(intWithNullArray, strArray), null)
}
intercept[RuntimeException] {
checkEvaluation(
Expand Down