-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-31359][SQL] Speed up timestamps rebasing #28119
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Closed
Closed
Changes from 1 commit
Commits
Show all changes
42 commits
Select commit
Hold shift + click to select a range
354965f
Optimize rebaseGregorianToJulianMicros
MaxGekk c6a70b2
Optimize rebaseJulianToGregorianMicros
MaxGekk 52bf1d4
Set LA as the default time zone
MaxGekk bf08bd2
Re-gen DateTimeBenchmark results on JDK 8
MaxGekk 4b89d12
Re-gen DateTimeBenchmark results on JDK 11
MaxGekk ac2beef
Optimize rebaseMicros
MaxGekk 66a8af4
Re-gen DateTimeBenchmark results on JDK 11
MaxGekk 2b21ad7
Re-gen DateTimeBenchmark results on JDK 8
MaxGekk 17f2684
Move days rebase functions to RebaseDateTime
MaxGekk ddd1794
Move micros rebase functions to RebaseDateTime
MaxGekk 743d111
Load rebase records from resource files
MaxGekk a52175d
Move rebasing tests to RebaseDateTimeSuite
MaxGekk 2b4a437
Add comments
MaxGekk 6202535
Add comments to julian-gregorian rebase functions
MaxGekk d39c835
Merge remote-tracking branch 'remotes/origin/master' into optimize-re…
MaxGekk 248b9a5
Fix DaysWritable v1.2
MaxGekk d5800f9
Fix OrcColumnVector v1.2
MaxGekk d87ebec
Validate JSON files
MaxGekk 5d417b7
Add tests for rebasing micros
MaxGekk ba96e3c
Re-gen JSON files
MaxGekk f9d0faa
Assume seconds in JSON files
MaxGekk 377ef8a
Add JSON generate function
MaxGekk 44df0dc
Don't check that zone id is resolvable
MaxGekk be672b6
Try AnyRefMap
MaxGekk 8cd02d9
Try Java HashMap
MaxGekk be37b16
Revert "Try Java HashMap"
MaxGekk f6cf352
Put switches and diff to one array
MaxGekk 88ff829
Revert "Put switches and diff to one array"
MaxGekk 0ffd2a6
Fix comments
MaxGekk 9a38c62
Random step in tests
MaxGekk 03e2ed3
Intro JsonRebaseRecord
MaxGekk 5204265
Add note about the system JVM time zone
MaxGekk b9951b9
Add a comment for RebaseDateTime
MaxGekk 8c3570d
Re-gen DateTimeRebaseBenchmark results on JDK 8
MaxGekk 9402336
Blacklist some time zones
MaxGekk 90dc0bd
Re-gen DateTimeRebaseBenchmark results on JDK 11
MaxGekk 25f0996
Merge branch 'optimize-rebase-micros' of github.com:MaxGekk/spark int…
MaxGekk 864734d
Disable JSON generation
MaxGekk a84d40e
Add comments for refRebaseGregorianToJulianDays() and refRebaseJulian…
MaxGekk bb12a81
Fix the comment for RebaseDateTime
MaxGekk d2d03b2
Fix indentation and rename params
MaxGekk 4281d4b
Address Wenchen's review comments
MaxGekk File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Disable JSON generation
- Loading branch information
commit 864734d9d94cbd73dd1c91f8d1071f77dbf1875e
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.