-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-23594][SQL] GetExternalRowField should support interpreted execution #20746
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Test build #87995 has finished for PR 20746 at commit
|
|
retest this please |
|
|
||
| // If an input row or a field are null, a runtime exception will be thrown | ||
| val errMsg1 = intercept[RuntimeException] { | ||
| evaluate(getRowField, InternalRow.fromSeq(Seq(null))) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor comment: This only tests the interpreted code path. Maybe we should add something to the ExpressionEvalHelper harness to test all paths in case of failure. Let me know if you want to pick this up, we can also spin that off into a separate PR.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Aha, sound nice to me. Would it be better to add the helper function first before this pr?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's just merge this, and add the helper in a follow-up.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have created https://issues.apache.org/jira/browse/SPARK-23611 to track this.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ok, thanks! I'll make a pr later for that.
|
@maropu look pretty good. I left one comment, otherwise this is gtg. |
|
Test build #87997 has finished for PR 20746 at commit
|
|
Merging to master. Thanks! |
What changes were proposed in this pull request?
This pr added interpreted execution for
GetExternalRowField.How was this patch tested?
Added tests in
ObjectExpressionsSuite.