Skip to content

Conversation

@egraldlo
Copy link
Contributor

@egraldlo egraldlo commented Jun 1, 2014

I don't know whether it's time to implement system function about string operation in spark sql now.

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

converted seems better than beConverted here.

@liancheng
Copy link
Contributor

LGTM except some minor formatting issues.

@marmbrus
Copy link
Contributor

marmbrus commented Jun 2, 2014

Thanks for doing this!

We should add this to the hive parser as well.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps, "A function that converts the characters of a string to uppercase."

@egraldlo
Copy link
Contributor Author

egraldlo commented Jun 2, 2014

thanks @liancheng and @marmbrus, I have modified the formatting issues and "nullable".

@egraldlo
Copy link
Contributor Author

egraldlo commented Jun 2, 2014

hi @liancheng, @marmbrus, in HiveQl.scala, MAX and MIN is not in it, maybe aggregation function max and min were supported afterwards.

@marmbrus
Copy link
Contributor

marmbrus commented Jun 2, 2014

test this please

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@marmbrus
Copy link
Contributor

marmbrus commented Jun 2, 2014

Change the PR title to begin with [SPARK-1995][SQL] ... please

@AmplabJenkins
Copy link

Merged build finished. All automated tests passed.

@AmplabJenkins
Copy link

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15355/

@egraldlo egraldlo changed the title system function upper and lower can be supported [SPARK-1995][SQL] system function upper and lower can be supported Jun 3, 2014
@asfgit asfgit closed this in ec8be27 Jun 3, 2014
@marmbrus
Copy link
Contributor

marmbrus commented Jun 3, 2014

Thanks for doing this!

Merged in master and 1.0

asfgit pushed a commit that referenced this pull request Jun 3, 2014
I don't know whether it's time to implement system function about string operation in spark sql now.

Author: egraldlo <[email protected]>

Closes #936 from egraldlo/stringoperator and squashes the following commits:

3c6c60a [egraldlo] Add UPPER, LOWER, MAX and MIN into hive parser
ea76d0a [egraldlo] modify the formatting issues
b49f25e [egraldlo] modify the formatting issues
1f0bbb5 [egraldlo] system function upper and lower supported
13d3267 [egraldlo] system function upper and lower supported

(cherry picked from commit ec8be27)
Signed-off-by: Michael Armbrust <[email protected]>
pdeyhim pushed a commit to pdeyhim/spark-1 that referenced this pull request Jun 25, 2014
I don't know whether it's time to implement system function about string operation in spark sql now.

Author: egraldlo <[email protected]>

Closes apache#936 from egraldlo/stringoperator and squashes the following commits:

3c6c60a [egraldlo] Add UPPER, LOWER, MAX and MIN into hive parser
ea76d0a [egraldlo] modify the formatting issues
b49f25e [egraldlo] modify the formatting issues
1f0bbb5 [egraldlo] system function upper and lower supported
13d3267 [egraldlo] system function upper and lower supported
xiliu82 pushed a commit to xiliu82/spark that referenced this pull request Sep 4, 2014
I don't know whether it's time to implement system function about string operation in spark sql now.

Author: egraldlo <[email protected]>

Closes apache#936 from egraldlo/stringoperator and squashes the following commits:

3c6c60a [egraldlo] Add UPPER, LOWER, MAX and MIN into hive parser
ea76d0a [egraldlo] modify the formatting issues
b49f25e [egraldlo] modify the formatting issues
1f0bbb5 [egraldlo] system function upper and lower supported
13d3267 [egraldlo] system function upper and lower supported
wangyum pushed a commit that referenced this pull request May 26, 2023
…936)

Related PR:

* [SPARK-33480][SQL] Support char/varchar type
* [SPARK-34164][SQL] Improve write side varchar check to visit only last few tailing spaces
* [SPARK-34130][SQL] Impove preformace for char varchar padding and length check with StaticInvoke
* [SPARK-35359][SQL] Insert data with char/varchar datatype will fail when data length exceed length limitation
* [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results Kent Yao* 2020/12/7, 9:40 PM
* [SPARK-33834][SQL] Verify ALTER TABLE CHANGE COLUMN with Char and Varchar Kent Yao* 2020/12/22, 11:07 AM
* [SPARK-37643][SQL] when charVarcharAsString is true, for char datatype predicate query should skip rpadding rule fhygh* 2022/4/18, 11:11 PM
* [SPARK-34833][SQL][FOLLOWUP] Handle outer references in all the places
* [SPARK-34833][SQL] Apply right-padding correctly for correlated subqueries
* [SPARK-34233][SQL] FIX NPE for char padding in binary comparison
* [SPARK-34192][SQL] Move char padding to write side and remove length check on read side too
* [SPARK-33901][SQL] Fix Char and Varchar display error after DDLs
* [SPARK-33901][SQL][FOLLOWUP] Add drop table in charvarchar test
* [SPARK-37160][SQL] Add a config to optionally disable padding for char type
* [SPARK-33892][SQL] Display char/varchar in DESC and SHOW CREATE TABLE
* [SPARK-34233][SQL] FIX NPE for char padding in binary comparison
* [SPARK-39052][SQL] Support Literal.create(Char, StringType)
* [SPARK-34908][SQL][TESTS] Add test cases for char and varchar with functions
* [SPARK-33879][SQL] Char Varchar values fails w/ match error as partition columns
* [SPARK-33591][SQL][3.0] Recognize null in partition spec values
* [SPARK-34203][SQL][3.0] Convert null partition values to __HIVE_DEFAULT_PARTITION__ in v1 In-Memory catalog 
* [SPARK-35244][SQL] Invoke should throw the original exception

[NOT-MERGED][SPARK-37452][SQL] Char and Varchar break backward compatibility between v3.1 and v2
[NOT-MERGED][SPARK-35700][SQL] Read char/varchar orc table with created and written by external systems
[NOT Merged][SPARK-33834][SQL] Verify ALTER TABLE CHANGE COLUMN with Char and Varchar Kent Yao* 2020/12/22, 11:07 AM
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants