Skip to content

[SPARK-23582][SQL] StaticInvoke should support interpreted execution #20753

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kiszk wants to merge 13 commits into from
Closed

[SPARK-23582][SQL] StaticInvoke should support interpreted execution #20753

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
9fea286
initial prototype
kiszk Mar 7, 2018
76c61ad
fix style error
kiszk Mar 7, 2018
80579c5
address review comments
kiszk Mar 8, 2018
d02e926
fix scala style error
kiszk Mar 8, 2018
b1f08c1
fix test failures
kiszk Mar 8, 2018
7d66bb9
move utility methods to ScalaReflection
kiszk Mar 26, 2018
c66e452
fix style error
kiszk Mar 26, 2018
1b3ea29
fix style error
kiszk Mar 26, 2018
7279557
address review comments
kiszk Mar 27, 2018
0530dcc
fix test failures
kiszk Mar 28, 2018
0c61e60
minimize changes
kiszk Apr 4, 2018
984cee7
fix build failure
kiszk Apr 4, 2018
7b30c30
fix scala style error
kiszk Apr 5, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix test failures 
import checkObjectExprEvaluation for test
  • Loading branch information
@kiszk
kiszk committed Apr 4, 2018
commit b1f08c1b23d901ac10486d32a8ac0e3489cdc3e2
3 changes: 2 additions & 1 deletion ...yst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ObjectExpressionsSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -150,7 +150,7 @@ class ObjectExpressionsSuite extends SparkFunSuite with ExpressionEvalHelper {
"toJavaDate", ObjectType(classOf[SQLDate]), 77777, DateTimeUtils.toJavaDate(77777)),
(DateTimeUtils.getClass, ObjectType(classOf[Timestamp]),
"toJavaTimestamp", ObjectType(classOf[SQLTimestamp]),
88888888L, DateTimeUtils.toJavaTimestamp(88888888L))
88888888.toLong, DateTimeUtils.toJavaTimestamp(88888888))
).foreach { case (cls, dataType, methodName, argType, arg, expected) =>
checkObjectExprEvaluation(StaticInvoke(cls, dataType, methodName,
Seq(BoundReference(0, argType, true))), expected, InternalRow.fromSeq(Seq(arg)))
Expand Down Expand Up @@ -216,6 +216,7 @@ class ObjectExpressionsSuite extends SparkFunSuite with ExpressionEvalHelper {
checkEvaluation(createExternalRow, Row.fromSeq(Seq(1, "x")), InternalRow.fromSeq(Seq()))
}

// This is an alternative version of `checkEvaluation` to compare results
Copy link
Member Author

@kiszk kiszk Mar 9, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This code is intentionally imported for testing from #20757

Copy link
Member

@maropu maropu Mar 9, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this pr is merged first, I'll remove this in my pr.

// by scala values instead of catalyst values.
private def checkObjectExprEvaluation(
expression: => Expression, expected: Any, inputRow: InternalRow = EmptyRow): Unit = {
Expand Down