-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-13244][SQL] Migrates DataFrame to Dataset #11443
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Closed
Closed
Changes from 1 commit
Commits
Show all changes
37 commits
Select commit
Hold shift + click to select a range
ed932d2
Temporarily renames Dataset to DS
liancheng e59e940
Renames DataFrame to Dataset[T]
liancheng b357371
Fixes Java API compilation failures
liancheng 3783e31
Fixes styling issues
liancheng a02a922
Fixes compilation failure introduced while rebasing
liancheng 3db81f8
Temporarily disables MiMA check for convenience
liancheng f67f497
Fixes infinite recursion in Dataset constructor
liancheng f921583
Fixes test failures
liancheng fa22261
Migrates encoder stuff to the new Dataset
liancheng 8cf5672
Makes some shape-keeping operations typed
liancheng 712ee19
Adds collectRows() for Java API
liancheng c73b91f
Migrates joinWith operations
liancheng 54cb36a
Migrates typed select
liancheng cbd7519
Renames typed groupBy to groupByKey
liancheng f1a2903
Migrates typed groupBy
liancheng 15b4193
Migrates functional transformers
liancheng 9aff0e2
Removes the old DS class and gets everything compiled
liancheng f053852
Fixes compilation error
liancheng 3a7aff4
Row encoder should produce GenericRowWithSchema
liancheng 9f8e0ad
Fixes compilation error after rebasing
liancheng bc081a9
Migrated Dataset.showString should handle typed objects
liancheng 6b69f43
MapObjects should also handle DecimalType and DateType
liancheng 29cb70f
Always use eager analysis
liancheng ba86e09
Fixes compilation error after rebasing
liancheng 5727f48
Fixes compilation error after rebasing
liancheng cd63810
Temporarily ignores Python UDT test cases
liancheng 4c8d139
fix python
cloud-fan cf0c112
Merge pull request #9 from cloud-fan/ds-to-df
liancheng 91942cf
fix pymllib
cloud-fan 736fbcb
Merge pull request #10 from cloud-fan/ds-to-df
liancheng 488a82e
MIMA
yhuai 343c611
Fix typo...
yhuai 63d4d69
MIMA: Exclude DataFrame class.
yhuai f6bcd50
Revert "MIMA: Exclude DataFrame class."
yhuai 49c6fc2
Revert "Fix typo..."
yhuai d52ce17
Revert "MIMA"
yhuai 7d29c06
Merge remote-tracking branch 'upstream/master' into ds-to-df
yhuai File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Fixes infinite recursion in Dataset constructor
- Loading branch information
commit f67f497020c6a369e5d95dbd47dd8e63b33c29c9
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This file should be renamed to Dataset.scala. Didn't do this yet for better diff view.