-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-22191] [SQL] Add hive serde example with serde properties #19420
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| // $example off:spark_hive$ | ||
|
|
||
| // Hive serde's are also supported with serde properties. | ||
| String sqlQuery = "CREATE TABLE src_serde(key decimal(38,18), value int) USING hive" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi, @crlalam.
We use 2-space indentation in general.
FYI, maybe, you can see Scala Coding Style.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @dongjoon-hyun ,
Thanks for the review and pointing me to the coding style. Fixed coding style issues and updated the pull request. Please take a look.
|
Jenkins OK to test |
| // $example off:spark_hive$ | ||
|
|
||
| // Hive serde's are also supported with serde properties. | ||
| String sqlQuery = "CREATE TABLE src_serde(key decimal(38,18), value int) USING hive" + |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The indentation here doesn't match the rest of the function.
|
I love more examples, but is there a place we plan to put this in the documentation? |
|
Can one of the admins verify this patch? |
Closes apache#17422 Closes apache#17619 Closes apache#18034 Closes apache#18229 Closes apache#18268 Closes apache#17973 Closes apache#18125 Closes apache#18918 Closes apache#19274 Closes apache#19456 Closes apache#19510 Closes apache#19420 Closes apache#20090 Closes apache#20177 Closes apache#20304 Closes apache#20319 Closes apache#20543 Closes apache#20437 Closes apache#21261 Closes apache#21726 Closes apache#14653 Closes apache#13143 Closes apache#17894 Closes apache#19758 Closes apache#12951 Closes apache#17092 Closes apache#21240 Closes apache#16910 Closes apache#12904 Closes apache#21731 Closes apache#21095 Added: Closes apache#19233 Closes apache#20100 Closes apache#21453 Closes apache#21455 Closes apache#18477 Added: Closes apache#21812 Closes apache#21787 Author: hyukjinkwon <[email protected]> Closes apache#21781 from HyukjinKwon/closing-prs.
What changes were proposed in this pull request?
Added an example for, specifying serde with serde properties for hive tables using OPTIONS.
How was this patch tested?
Verified manually by running examples with run-example.sh. Verified in Scala, java and python.