Skip to content

[SPARK-22856][SQL] Add wrappers for codegen output and nullability #20043

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
viirya wants to merge 14 commits into from
Closed

[SPARK-22856][SQL] Add wrappers for codegen output and nullability #20043

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
5ace8b8
Add wrappers for codegen output.
viirya Dec 21, 2017
d120750
Merge remote-tracking branch 'upstream/master' into SPARK-22856
viirya Dec 21, 2017
81c9b6e
Fix equality check with string.
viirya Dec 21, 2017
53926cc
Address comments.
viirya Dec 21, 2017
69422d4
Merge remote-tracking branch 'upstream/master' into SPARK-22856
viirya Dec 22, 2017
4384c84
Fix merging.
viirya Dec 22, 2017
d864aff
Merge remote-tracking branch 'upstream/master' into SPARK-22856
viirya Feb 21, 2018
8715d32
Add test.
viirya Feb 21, 2018
f59bb19
Use TrueLiteral/FalseLiteral. Add java type and access property to Ex…
viirya Feb 28, 2018
37ae9b0
Address comment.
viirya Mar 1, 2018
0841c4a
Address comment.
viirya Mar 1, 2018
e530f01
Remove ExprType.
viirya Mar 1, 2018
c8c70a9
Merge remote-tracking branch 'upstream/master' into SPARK-22856
viirya Mar 5, 2018
ac2e595
Merge remote-tracking branch 'upstream/master' into SPARK-22856
viirya Apr 4, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Address comment.
  • Loading branch information
@viirya
viirya committed Mar 1, 2018
commit 37ae9b0e217de323dbc73c9e1247ebe9bf2c278c
3 changes: 1 addition & 2 deletions ...lyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -323,8 +323,7 @@ class CodegenContext {
case _: StructType | _: ArrayType | _: MapType => s"$value = $initCode.copy();"
case _ => s"$value = $initCode;"
}
ExprCode(code, FalseLiteral,
GlobalValue(value, ExprType(this, dataType)))
ExprCode(code, FalseLiteral, GlobalValue(value, ExprType(this, dataType)))
}

def declareMutableStates(): String = {
Expand Down
2 changes: 1 addition & 1 deletion sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ import scala.collection.mutable.ArrayBuffer
import org.apache.spark.rdd.RDD
import org.apache.spark.sql.catalyst.InternalRow
import org.apache.spark.sql.catalyst.expressions._
import org.apache.spark.sql.catalyst.expressions.codegen._
import org.apache.spark.sql.catalyst.expressions.codegen.{CodegenContext, ExprCode, ExprType, FalseLiteral, VariableValue}
import org.apache.spark.sql.catalyst.plans._
import org.apache.spark.sql.catalyst.plans.physical._
import org.apache.spark.sql.execution.{BinaryExecNode, CodegenSupport,
Expand Down