Skip to content

Commit b62e253

Browse files
committed
[SPARK-32073][R] Drop R < 3.5 support
### What changes were proposed in this pull request? Spark 3.0 accidentally dropped R < 3.5. It is built by R 3.6.3 which not support R < 3.5: ``` Error in readRDS(pfile) : cannot read workspace version 3 written by R 3.6.3; need R 3.5.0 or newer version. ``` In fact, with SPARK-31918, we will have to drop R < 3.5 entirely to support R 4.0.0. This is inevitable to release on CRAN because they require to make the tests pass with the latest R. ### Why are the changes needed? To show the supported versions correctly, and support R 4.0.0 to unblock the releases. ### Does this PR introduce _any_ user-facing change? In fact, no because Spark 3.0.0 already does not work with R < 3.5. Compared to Spark 2.4, yes. R < 3.5 would not work. ### How was this patch tested? Jenkins should test it out. Closes apache#28908 from HyukjinKwon/SPARK-32073. Authored-by: HyukjinKwon <[email protected]> Signed-off-by: HyukjinKwon <[email protected]>
1 parent 11d2b07 commit b62e253

File tree

5 files changed

+4
-13
lines changed

5 files changed

+4
-13
lines changed

R/WINDOWS.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,8 +22,8 @@ To build SparkR on Windows, the following steps are required
2222

2323
1. Make sure `bash` is available and in `PATH` if you already have a built-in `bash` on Windows. If you do not have, install [Cygwin](https://www.cygwin.com/).
2424

25-
2. Install R (>= 3.1) and [Rtools](https://cloud.r-project.org/bin/windows/Rtools/). Make sure to
26-
include Rtools and R in `PATH`. Note that support for R prior to version 3.4 is deprecated as of Spark 3.0.0.
25+
2. Install R (>= 3.5) and [Rtools](https://cloud.r-project.org/bin/windows/Rtools/). Make sure to
26+
include Rtools and R in `PATH`.
2727

2828
3. Install JDK that SparkR supports (see `R/pkg/DESCRIPTION`), and set `JAVA_HOME` in the system environment variables.
2929

R/pkg/DESCRIPTION

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ URL: https://www.apache.org/ https://spark.apache.org/
1515
BugReports: https://spark.apache.org/contributing.html
1616
SystemRequirements: Java (>= 8, < 12)
1717
Depends:
18-
R (>= 3.1),
18+
R (>= 3.5),
1919
methods
2020
Suggests:
2121
knitr,

R/pkg/inst/profile/general.R

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,10 +16,6 @@
1616
#
1717

1818
.First <- function() {
19-
if (utils::compareVersion(paste0(R.version$major, ".", R.version$minor), "3.4.0") == -1) {
20-
warning("Support for R prior to version 3.4 is deprecated since Spark 3.0.0")
21-
}
22-
2319
packageDir <- Sys.getenv("SPARKR_PACKAGE_DIR")
2420
dirs <- strsplit(packageDir, ",")[[1]]
2521
.libPaths(c(dirs, .libPaths()))

R/pkg/inst/profile/shell.R

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,10 +16,6 @@
1616
#
1717

1818
.First <- function() {
19-
if (utils::compareVersion(paste0(R.version$major, ".", R.version$minor), "3.4.0") == -1) {
20-
warning("Support for R prior to version 3.4 is deprecated since Spark 3.0.0")
21-
}
22-
2319
home <- Sys.getenv("SPARK_HOME")
2420
.libPaths(c(file.path(home, "R", "lib"), .libPaths()))
2521
Sys.setenv(NOAWT = 1)

docs/index.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -44,10 +44,9 @@ source, visit [Building Spark](building-spark.html).
4444

4545
Spark runs on both Windows and UNIX-like systems (e.g. Linux, Mac OS), and it should run on any platform that runs a supported version of Java. This should include JVMs on x86_64 and ARM64. It's easy to run locally on one machine --- all you need is to have `java` installed on your system `PATH`, or the `JAVA_HOME` environment variable pointing to a Java installation.
4646

47-
Spark runs on Java 8/11, Scala 2.12, Python 2.7+/3.4+ and R 3.1+.
47+
Spark runs on Java 8/11, Scala 2.12, Python 2.7+/3.4+ and R 3.5+.
4848
Java 8 prior to version 8u92 support is deprecated as of Spark 3.0.0.
4949
Python 2 and Python 3 prior to version 3.6 support is deprecated as of Spark 3.0.0.
50-
R prior to version 3.4 support is deprecated as of Spark 3.0.0.
5150
For the Scala API, Spark {{site.SPARK_VERSION}}
5251
uses Scala {{site.SCALA_BINARY_VERSION}}. You will need to use a compatible Scala version
5352
({{site.SCALA_BINARY_VERSION}}.x).

0 commit comments

Comments
 (0)