Skip to content

[SPARK-36702][SQL] ArrayUnion handle duplicated Double.NaN and Float.Nan #33955

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
AngersZhuuuu wants to merge 24 commits into from
Closed

[SPARK-36702][SQL] ArrayUnion handle duplicated Double.NaN and Float.Nan #33955

Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
8579c97
[SPARK-36702][SQL] ArrayUnion handle duplicated Double.NaN and Float.Nan
AngersZhuuuu Sep 10, 2021
d6e4f39
follow comment
AngersZhuuuu Sep 10, 2021
a481196
Update collectionOperations.scala
AngersZhuuuu Sep 10, 2021
1857988
Update collectionOperations.scala
AngersZhuuuu Sep 10, 2021
4e533fd
Update collectionOperations.scala
AngersZhuuuu Sep 11, 2021
119679c
update
AngersZhuuuu Sep 13, 2021
45d1fee
Update SQLOpenHashSet.scala
AngersZhuuuu Sep 13, 2021
08cc967
update
AngersZhuuuu Sep 13, 2021
8d0e4a9
Merge branch 'SPARK-36702-WrapOpenHashSet' of https://github.com/Ange…
AngersZhuuuu Sep 13, 2021
36758d1
update
AngersZhuuuu Sep 13, 2021
5b077a5
Update collectionOperations.scala
AngersZhuuuu Sep 13, 2021
89a4263
Update collectionOperations.scala
AngersZhuuuu Sep 13, 2021
1ac5ab3
Update collectionOperations.scala
AngersZhuuuu Sep 13, 2021
08da413
Update collectionOperations.scala
AngersZhuuuu Sep 13, 2021
0da6ea5
Update collectionOperations.scala
AngersZhuuuu Sep 13, 2021
3059ea1
Update collectionOperations.scala
AngersZhuuuu Sep 13, 2021
991fddd
Update sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expr…
AngersZhuuuu Sep 13, 2021
db8159e
trigger
AngersZhuuuu Sep 13, 2021
eb1f028
Update SQLOpenHashSet.scala
AngersZhuuuu Sep 13, 2021
f59c0a8
Merge branch 'master' into SPARK-36702-WrapOpenHashSet
AngersZhuuuu Sep 14, 2021
f27c4e1
Update SQLOpenHashSet.scala
AngersZhuuuu Sep 14, 2021
affd31a
Revert "Update SQLOpenHashSet.scala"
AngersZhuuuu Sep 14, 2021
fe407c9
Update SQLOpenHashSet.scala
AngersZhuuuu Sep 14, 2021
4e5e085
trigger
AngersZhuuuu Sep 14, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Revert "Update SQLOpenHashSet.scala" 
This reverts commit f27c4e1.
  • Loading branch information
@AngersZhuuuu
AngersZhuuuu committed Sep 14, 2021
commit affd31a6fa7c464bbe773136c598f121758d4945
4 changes: 4 additions & 0 deletions sql/catalyst/src/main/scala/org/apache/spark/sql/util/SQLOpenHashSet.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,10 @@ import org.apache.spark.annotation.Private
import org.apache.spark.sql.types.{DataType, DoubleType, FloatType}
import org.apache.spark.util.collection.OpenHashSet

/**
* A wrap of [[OpenHashSet]] that can handle null, Double.NaN and Float.NaN
* w.r.t. the SQL semantic.
*/
@Private
class SQLOpenHashSet[@specialized(Long, Int, Double, Float) T: ClassTag](
initialCapacity: Int,
Expand Down