Skip to content

[SPARK-28723][SQL] Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile #25443

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wangyum wants to merge 24 commits into from
Closed

[SPARK-28723][SQL] Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile #25443

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
540d6da
Test on jenkins
wangyum Aug 14, 2019
6821aa5
Temporary way for testing JDK 11 on jenkins
wangyum Aug 14, 2019
e6508c0
Try to manually copy environment variables from the parent in run-tes…
HyukjinKwon Aug 14, 2019
2ebdcb9
Revert "Temporary way for testing JDK 11 on jenkins" (#23)
HyukjinKwon Aug 14, 2019
0085ad7
Try shell=True with explicit environment variables (#24)
HyukjinKwon Aug 14, 2019
1c1143f
Revert "Try shell=True with explicit environment variables (#24)"
HyukjinKwon Aug 14, 2019
8435110
Revert " Revert "Temporary way for testing JDK 11 on jenkins" (#23)"
HyukjinKwon Aug 14, 2019
77a70ae
Revert "Try to manually copy environment variables from the parent in…
HyukjinKwon Aug 14, 2019
6fdf309
Check if we need to set PATH for JDK11
wangyum Aug 14, 2019
b984414
Add JAVA_HOME into PATH as well
HyukjinKwon Aug 14, 2019
593a154
fix
wangyum Aug 14, 2019
8b04e78
Revert "fix"
wangyum Aug 14, 2019
59554f9
set java.version to 11
wangyum Aug 14, 2019
17285a6
Update
wangyum Aug 14, 2019
9254dfb
Fix: unresolved dependency: org.apache.hive#hive-metastore;2.3.6: not…
wangyum Aug 15, 2019
0ac0b30
Revert java.version to 1.8
wangyum Aug 15, 2019
500b4a7
Merge remote-tracking branch 'upstream/master' into test-on-jenkins
wangyum Aug 16, 2019
0caa93f
Update deps
wangyum Aug 16, 2019
24bb028
Update deps2
wangyum Aug 16, 2019
46322df
Test SPARK-28765 on JDK 11
wangyum Aug 17, 2019
3856828
Merge remote-tracking branch 'upstream/master' into test-on-jenkins
wangyum Aug 18, 2019
9defec2
Test Hive 2.3.6 on JDK 8
wangyum Aug 18, 2019
a9cbd7f
Merge remote-tracking branch 'upstream/master' into test-on-jenkins
wangyum Aug 22, 2019
ff4783c
Hive 2.3.6 vote passes
wangyum Aug 22, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Test SPARK-28765 on JDK 11
  • Loading branch information
@wangyum
wangyum committed Aug 17, 2019
commit 46322dfa623348a39304b9983edbea18d30d2090
3 changes: 0 additions & 3 deletions dev/deps/spark-deps-hadoop-2.7
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -95,15 +95,12 @@ jackson-module-jaxb-annotations-2.9.9.jar
jackson-module-paranamer-2.9.9.jar
jackson-module-scala_2.12-2.9.9.jar
jackson-xc-1.9.13.jar
jakarta.activation-1.2.1.jar
jakarta.activation-api-1.2.1.jar
jakarta.annotation-api-1.3.4.jar
jakarta.inject-2.5.0.jar
jakarta.ws.rs-api-2.1.5.jar
jakarta.xml.bind-api-2.3.2.jar
janino-3.0.15.jar
javassist-3.22.0-CR2.jar
javax.annotation-api-1.2.jar
javax.inject-1.jar
javax.servlet-api-3.1.0.jar
javolution-5.5.1.jar
Expand Down
3 changes: 0 additions & 3 deletions dev/deps/spark-deps-hadoop-3.2
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -96,15 +96,12 @@ jackson-mapper-asl-1.9.13.jar
jackson-module-jaxb-annotations-2.9.9.jar
jackson-module-paranamer-2.9.9.jar
jackson-module-scala_2.12-2.9.9.jar
jakarta.activation-1.2.1.jar
jakarta.activation-api-1.2.1.jar
jakarta.annotation-api-1.3.4.jar
jakarta.inject-2.5.0.jar
jakarta.ws.rs-api-2.1.5.jar
jakarta.xml.bind-api-2.3.2.jar
janino-3.0.15.jar
javassist-3.22.0-CR2.jar
javax.annotation-api-1.2.jar
javax.inject-1.jar
javax.servlet-api-3.1.0.jar
javolution-5.5.1.jar
Expand Down
14 changes: 14 additions & 0 deletions pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -742,11 +742,25 @@
<groupId>org.glassfish.jersey.core</groupId>
<artifactId>jersey-server</artifactId>
<version>${jersey.version}</version>
<!-- SPARK-28765 jersey-server doesn't have the following dependency -->
<exclusions>
<exclusion>
<groupId>jakarta.xml.bind</groupId>
<artifactId>jakarta.xml.bind-api</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.glassfish.jersey.core</groupId>
<artifactId>jersey-common</artifactId>
<version>${jersey.version}</version>
<!-- SPARK-28765 jersey-common doesn't have the following dependency -->
<exclusions>
<exclusion>
<groupId>com.sun.activation</groupId>
<artifactId>jakarta.activation</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.glassfish.jersey.core</groupId>
Expand Down
5 changes: 5 additions & 0 deletions resource-managers/kubernetes/core/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,11 @@
<groupId>com.fasterxml.jackson.dataformat</groupId>
<artifactId>jackson-dataformat-yaml</artifactId>
</exclusion>
<!-- SPARK-28765 kubernetes-client doesn't have the following dependency -->
<exclusion>
<groupId>javax.annotation</groupId>
<artifactId>javax.annotation-api</artifactId>
</exclusion>
</exclusions>
</dependency>

Expand Down