-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-23861][SQL][Doc] Clarify default window frame with and without orderBy clause #20978
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Added doc per discussion on mailing list. Sorry that I have not generated scaladoc before, what's the best way to generate scaladoc locally? |
|
Test build #88896 has finished for PR 20978 at commit
|
|
Test build #88895 has finished for PR 20978 at commit
|
|
PRODUCTION=1 RELEASE_VERSION="$SPARK_VERSION" jekyll build |
| * Window.partitionBy("country").orderBy("date").rowsBetween(-3, 3) | ||
| * }}} | ||
| * | ||
| * @note When ordering is not defined, the default frame boundaries are (rowFrame, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I tried to improve the wording (feel free not to use this):
When ordering is not defined, an unbounded window frame (rowFrame, unboundedPreceding, unboundedFollowing) is used by default. When ordering is defined, a growing window frame (rangeFrame, unboundedPreceding, currentRow) is used by default.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think your wording is better. Updated.
|
@felixcheung Thanks much for the tips! I was able to generate scaladoc using |
|
Test build #88956 has finished for PR 20978 at commit
|
|
jenkins retest please |
|
retest this please |
|
Test build #88981 has finished for PR 20978 at commit
|
|
retest this please |
|
it makes very little sense that this keeps failing |
|
@hvanhovell @HyukjinKwon thanks for helping with the build! I think this PR is ready except for that I still couldn't figure out why Do you have suggestion how do I build the doc from local source? |
|
Test build #88983 has finished for PR 20978 at commit
|
|
Merging to master. Thanks! |
|
LGTM :) |
|
and .. I guess @hvanhovell is hitting a network issue? I just merged it into master. |
|
Yeah, I got distracted. Thanks for merging. |
|
Thanks all! |
|
Nay unidocSourceBase is just for web links in the doc.
Have you tried
PRODUCTION=1 RELEASE_VERSION="$SPARK_VERSION" jekyll build
|
… orderBy clause ## What changes were proposed in this pull request? Add docstring to clarify default window frame boundaries with and without orderBy clause ## How was this patch tested? Manually generate doc and check. Author: Li Jin <[email protected]> Closes apache#20978 from icexelloss/SPARK-23861-window-doc.

What changes were proposed in this pull request?
Add docstring to clarify default window frame boundaries with and without orderBy clause
How was this patch tested?
Manually generate doc and check.