Skip to content

[SPARK-7199][SQL] Add date and timestamp support to UnsafeRow #5984

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
viirya wants to merge 17 commits into from
Closed

[SPARK-7199][SQL] Add date and timestamp support to UnsafeRow #5984

Changes from 1 commit
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
4c07b57
Add date and timestamp support to UnsafeRow.
viirya May 7, 2015
e42a809
Fix style.
viirya May 7, 2015
fcf8db9
Add functions for Date and Timestamp to SpecificRow.
viirya May 7, 2015
752251f
Support setDate. Fix failed test.
viirya May 8, 2015
b16994e
Merge remote-tracking branch 'upstream/master' into add_date_timestamp
viirya May 22, 2015
46946c6
Adapt for moved DateUtils.
viirya May 22, 2015
635388a
Merge remote-tracking branch 'upstream/master' into add_date_timestamp
viirya Jun 11, 2015
a463e83
Use Long to store timestamp for rows.
viirya Jun 11, 2015
f4f5de6
Fix scala style.
viirya Jun 11, 2015
80af342
Fix compiling error.
viirya Jun 11, 2015
fb532b5
Merge remote-tracking branch 'upstream/master' into add_date_timestamp
viirya Jun 13, 2015
281e844
Fix scala style.
viirya Jun 13, 2015
9f3e577
Merge remote-tracking branch 'upstream/master' into add_date_timestamp
viirya Jun 16, 2015
672ef17
Remove getter/setter for Date and Timestamp and use Int and Long for …
viirya Jun 16, 2015
c30d490
Use default IntUnsafeColumnWriter and LongUnsafeColumnWriter.
viirya Jun 17, 2015
0b89698
Add timestamp to settableFieldTypes.
viirya Jun 17, 2015
7f21ce9
For comment.
viirya Jun 17, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Use Long to store timestamp for rows.
  • Loading branch information
@viirya
viirya committed Jun 11, 2015
commit a463e8372cbaf67de6c4674bc999350fa6c0c039
4 changes: 2 additions & 2 deletions sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/rows.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -138,7 +138,7 @@ class GenericRow(protected[sql] val values: Array[Any]) extends Row {
override def getTimestamp(i: Int): java.sql.Timestamp = {
values(i) match {
case null => null
case t: java.sql.Timestamp => t
case l: Long => DateUtils.toJavaTimestamp(l)
}
}

Expand Down Expand Up @@ -227,7 +227,7 @@ class GenericMutableRow(v: Array[Any]) extends GenericRow(v) with MutableRow {
}

override def setTimestamp(ordinal: Int, value: java.sql.Timestamp): Unit = {
values(ordinal) = value
values(ordinal) = DateUtils.fromJavaTimestamp(value)
}

override def setNullAt(i: Int): Unit = { values(i) = null }
Expand Down