Skip to content

[SPARK-16774][SQL] Fix use of deprecated timestamp constructor & improve timezone handling #14398

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
holdenk wants to merge 12 commits into from
Closed

[SPARK-16774][SQL] Fix use of deprecated timestamp constructor & improve timezone handling #14398

Changes from 1 commit
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
7c0fd8d
Stop using deprecated Timestamp constructor
holdenk Jul 28, 2016
634a05e
Wait the old timezone code was badnews bears - did stuff based implic…
holdenk Jul 29, 2016
6233b4c
Simplify & disable the roundtrip test - it wasn't really running anyw…
holdenk Jul 29, 2016
e4508e3
not used anymore
holdenk Jul 29, 2016
0385d8b
Just remove the roundtrip test for now - can be added back from git h…
holdenk Jul 29, 2016
5e80a8d
Use standard calendar
holdenk Jul 29, 2016
c01db02
Don't need to capture return value of set
holdenk Jul 29, 2016
ec75f73
Add another TODO with JIRA link
holdenk Jul 29, 2016
7c28252
Merge branch 'master' into SPARK-16774-fix-use-of-deprecated-timestam…
holdenk Jul 29, 2016
8670bb6
Add back tests and add some more notes
holdenk Jul 30, 2016
1109275
nvm about those localmilis based tests - should be covered through to…
holdenk Jul 30, 2016
671f7be
Remove superflous getTime call
holdenk Jul 31, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Just remove the roundtrip test for now - can be added back from git h… 
…istory later
  • Loading branch information
@holdenk
holdenk committed Jul 29, 2016
commit 0385d8bd3f7ea85abb14191a4f3eb7eb1dbd4582
26 changes: 0 additions & 26 deletions sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -536,32 +536,6 @@ class DateTimeUtilsSuite extends SparkFunSuite {
}
}

// Disabled since now that we use the actual timezone info the roundtripping is broken.
/*
test("daysToMillis and millisToDays") {
// There are some days are skipped entirely in some timezone, skip them here.
val skipped_days = Map[String, Int](
"Kwajalein" -> 8632,
"Pacific/Apia" -> 15338,
"Pacific/Enderbury" -> 9131,
"Pacific/Fakaofo" -> 15338,
"Pacific/Kiritimati" -> 9131,
"Pacific/Kwajalein" -> 8632,
"MIT" -> 15338)
for (tz <- DateTimeTestUtils.ALL_TIMEZONES) {
DateTimeTestUtils.withDefaultTimeZone(tz) {
val skipped = skipped_days.getOrElse(tz.getID, Int.MinValue)
(-20000 to 20000).foreach { d =>
if (d != skipped) {
assert(millisToDays(daysToMillis(d)) === d,
s"Round trip of ${d} did not work in tz ${tz}")
}
}
}
}
}
*/

test("convert TZ with boundary time pacific") {
val tz = TimeZone.getTimeZone("America/Los_Angeles")
val boundaryDates = List(
Expand Down