-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-20392][SQL] Set barrier to prevent re-entering a tree #17770
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Closed
Closed
Changes from 1 commit
Commits
Show all changes
29 commits
Select commit
Hold shift + click to select a range
82978d7
Set barrier to prevent re-analysis of analyzed plan.
viirya 24905e3
Use a logical node to set analysis barrier.
viirya e15b001
Add test for analysis barrier.
viirya a076d83
Let AnalysisBarrier as LeafNode.
viirya b29ded3
Remove resolveOperators path.
viirya 8c8fe1e
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya a855182
Solving merging issue.
viirya 4ff9610
Do not change exposed logicalPlan.
viirya d0a94f4
Fix test.
viirya 02e11f9
Address comments.
viirya 17f1a02
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya 4629959
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya c313e35
Correctly set isStreaming for barrier.
viirya 7e9dfac
Address comments.
viirya fba3690
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya f63ea0b
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya b9d03cd
Fix test.
viirya 6a7204c
Address comments.
viirya 3437ae0
Wrap AnalysisBarrier on df.logicalPlan.
viirya 555fa8e
Fix test.
viirya 505aba6
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya f3e4208
fix test.
viirya c0bee01
Avoid overriding find in AnalysisBarrier.
viirya 1c1cc9d
Fix test.
viirya eb0598e
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya cba784b
fix test.
viirya b478e55
Merge remote-tracking branch 'upstream/master' into SPARK-20392
viirya 8314cc3
Create a new field in Dataset for the plan with barrier.
viirya 6add9ec
Address comments.
viirya File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Add test for analysis barrier.
- Loading branch information
commit e15b001327786c419e60fa388b1e8ddd42950e31
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
where is this exception thrown?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
CheckAnalysis. We wrap an unresolved plan with a barrier. So the analyzer won't go through it and it remains unresolved.