-
Notifications
You must be signed in to change notification settings - Fork 29k
SPARK-1483: Rename minSplits to minPartitions in public APIs #430
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. All automated tests passed. |
|
All automated tests passed. |
|
Maybe you want to deprecate defaultMinSplits, and create a defaultMinPartitions. |
|
Merged build triggered. |
|
Merged build started. |
|
@rxin thanks for the comments, just addressed that and wait for Jenkins |
|
Merged build finished. |
|
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14199/ |
|
Jenkins, retest this please. |
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. |
|
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14201/ |
|
Jenkins, retest this please. |
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. |
|
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14204/ |
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. |
|
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14206/ |
|
it's weird...always timeout....because I modified core and hive-related file in the same PR? |
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. All automated tests passed. |
|
All automated tests passed. |
|
finally~thanks @rxin , any other comments? |
|
Thanks. Merged. |
https://issues.apache.org/jira/browse/SPARK-1483 From the original JIRA: " The parameter name is part of the public API in Scala and Python, since you can pass named parameters to a method, so we should name it to this more descriptive term. Everywhere else we refer to "splits" as partitions." - @mateiz Author: CodingCat <[email protected]> Closes #430 from CodingCat/SPARK-1483 and squashes the following commits: 4b60541 [CodingCat] deprecate defaultMinSplits ba2c663 [CodingCat] Rename minSplits to minPartitions in public APIs (cherry picked from commit e31c8ff) Signed-off-by: Reynold Xin <[email protected]>
https://issues.apache.org/jira/browse/SPARK-1483 From the original JIRA: " The parameter name is part of the public API in Scala and Python, since you can pass named parameters to a method, so we should name it to this more descriptive term. Everywhere else we refer to "splits" as partitions." - @mateiz Author: CodingCat <[email protected]> Closes apache#430 from CodingCat/SPARK-1483 and squashes the following commits: 4b60541 [CodingCat] deprecate defaultMinSplits ba2c663 [CodingCat] Rename minSplits to minPartitions in public APIs
Direct copy of revised design doc
* [SPARK-45382][BUILD] Upgrade Netty to 4.1.99.Final ### What changes were proposed in this pull request? This PR aims to Upgrade Netty to 4.1.99.Final. ### Why are the changes needed? Netty 4.1.99.Final is the first release where Netty community has Java 21 test coverage. - netty/netty#13627 It also fixes a bug which could lead to SIGSERV while running on JDK21+. Since the bug was introduced at `4.1.98.Final`, Apache Spark was not affected yet. - netty/netty#13640 Here is a full release note. - https://netty.io/news/2023/09/21/4-1-99-Final.html ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#43180 from dongjoon-hyun/SPARK-45382. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]> (cherry picked from commit 0b68e41) * HADP-54076 Upgrade netty-codec-http2 to 4.1.110 --------- Co-authored-by: Dongjoon Hyun <[email protected]>
…" (apache#442) * Revert "[HDAP-54076][FOLLOW-UP] Fix could not find file ...libnetty_tcnative_linux_x86_64.so to copy (apache#437)" This reverts commit 720c28e. * Revert "[HADP-54076][SPARK-48420] Upgrade netty to 4.1.110 (apache#430)" This reverts commit 98f4ffe.
https://issues.apache.org/jira/browse/SPARK-1483
From the original JIRA: " The parameter name is part of the public API in Scala and Python, since you can pass named parameters to a method, so we should name it to this more descriptive term. Everywhere else we refer to "splits" as partitions." - @mateiz