Skip to content

[SPARK-31797][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions #28534

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
TJX2014 wants to merge 18 commits into from
Closed

[SPARK-31797][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions #28534

Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
5e60ec5
SPARK-31710: TIMESTAMP_SECONDS, TIMESTAMP_MILLISECONDS and TIMESTAMP_…
TJX2014 May 19, 2020
27a162b
improve code quality according to advices
TJX2014 May 20, 2020
f879987
code style improved and remove bad asInstanceOf etc
TJX2014 May 20, 2020
4c17d49
From a readability perspective it may be better to put the base class…
TJX2014 May 20, 2020
3411935
new exception check when overflow occur when multiply long and more p…
TJX2014 May 20, 2020
17a33f5
long overflow in datetime.sql added and pass the local test
TJX2014 May 20, 2020
344e5e1
test overflow condition fix, just small unit for per test
TJX2014 May 20, 2020
407dcfc
fix unit test failed due to string value in ExpressionDescription
TJX2014 May 20, 2020
944c644
regenerate sql-expression-schema.md
TJX2014 May 20, 2020
642668c
minimize code gen by judge equal 1 and remove duplicate unit test
TJX2014 May 20, 2020
62bf8b5
correct style of usage content
TJX2014 May 21, 2020
7da94b5
short name to MillisToTimestamp and MicrosToTimestamp
TJX2014 May 21, 2020
3704fee
correct short name in sql-expression-schema.md
TJX2014 May 21, 2020
f5b0a5a
function rename timestamp_microseconds to timestamp_micros and timest…
TJX2014 May 21, 2020
f4f7c35
disable cast string to long in number to timestamp
TJX2014 May 21, 2020
3c949ac
regenerate sql-expression-schema.md, UT added in DateExpressionsSuite
TJX2014 May 22, 2020
fdfd75c
UT style improve
TJX2014 May 22, 2020
f0cc631
UT style improve
TJX2014 May 22, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
correct short name in sql-expression-schema.md
  • Loading branch information
@TJX2014
TJX2014 committed May 22, 2020
commit 3704fee9ef9f77e8216bacbed734ab4ef0f660e1
4 changes: 2 additions & 2 deletions sql/core/src/test/resources/sql-functions/sql-expression-schema.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -175,8 +175,8 @@
| org.apache.spark.sql.catalyst.expressions.MapValues | map_values | SELECT map_values(map(1, 'a', 2, 'b')) | struct<map_values(map(1, a, 2, b)):array<string>> |
| org.apache.spark.sql.catalyst.expressions.MapZipWith | map_zip_with | SELECT map_zip_with(map(1, 'a', 2, 'b'), map(1, 'x', 2, 'y'), (k, v1, v2) -> concat(v1, v2)) | struct<map_zip_with(map(1, a, 2, b), map(1, x, 2, y), lambdafunction(concat(namedlambdavariable(), namedlambdavariable()), namedlambdavariable(), namedlambdavariable(), namedlambdavariable())):map<int,string>> |
| org.apache.spark.sql.catalyst.expressions.Md5 | md5 | SELECT md5('Spark') | struct<md5(CAST(Spark AS BINARY)):string> |
| org.apache.spark.sql.catalyst.expressions.MicroSecondsToTimestamp | timestamp_microseconds | SELECT timestamp_microseconds(1230219000123123) | struct<timestamp_microseconds(1230219000123123):timestamp> |
| org.apache.spark.sql.catalyst.expressions.MilliSecondsToTimestamp | timestamp_milliseconds | SELECT timestamp_milliseconds(1230219000123) | struct<timestamp_milliseconds(1230219000123):timestamp> |
| org.apache.spark.sql.catalyst.expressions.MicrosToTimestamp | timestamp_microseconds | SELECT timestamp_microseconds(1230219000123123) | struct<timestamp_microseconds(1230219000123123):timestamp> |
| org.apache.spark.sql.catalyst.expressions.MillisToTimestamp | timestamp_milliseconds | SELECT timestamp_milliseconds(1230219000123) | struct<timestamp_milliseconds(1230219000123):timestamp> |
| org.apache.spark.sql.catalyst.expressions.Minute | minute | SELECT minute('2009-07-30 12:58:59') | struct<minute(CAST(2009-07-30 12:58:59 AS TIMESTAMP)):int> |
| org.apache.spark.sql.catalyst.expressions.MonotonicallyIncreasingID | monotonically_increasing_id | N/A | N/A |
| org.apache.spark.sql.catalyst.expressions.Month | month | SELECT month('2016-07-30') | struct<month(CAST(2016-07-30 AS DATE)):int> |
Expand Down