Skip to content

[SPARK-19995][YARN] Register tokens to current UGI to avoid re-issuing of tokens in yarn client mode #17335

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jerryshao wants to merge 4 commits into from
+3 −0
Closed

[SPARK-19995][YARN] Register tokens to current UGI to avoid re-issuing of tokens in yarn client mode #17335

Changes from 1 commit
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
d31dcb3
Using real user to initialize hive SessionState
jerryshao Mar 17, 2017
85a4220
Use delegation tokens to authenticate metastore connection
jerryshao Mar 21, 2017
11a1094
Remove unnecessary import
jerryshao Mar 21, 2017
e9b5580
Fix NPE bug in the code
jerryshao Mar 21, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Fix NPE bug in the code 
Change-Id: I6be6be7b1e9a4580e5e1eeab8aac451ea830ef8b
  • Loading branch information
@jerryshao
jerryshao committed Mar 21, 2017
commit e9b55800e9ad02ef07f081a5dfb4943ac5d80523
6 changes: 3 additions & 3 deletions resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -369,11 +369,11 @@ private[spark] class Client(

// Merge credentials obtained from registered providers
val nearestTimeOfNextRenewal = credentialManager.obtainCredentials(hadoopConf, credentials)
// Add credentials to current user's UGI, so that following operations don't need to use the
// Kerberos tgt to get delegations again in the client side.
UserGroupInformation.getCurrentUser.addCredentials(credentials)

if (credentials != null) {
// Add credentials to current user's UGI, so that following operations don't need to use the
// Kerberos tgt to get delegations again in the client side.
UserGroupInformation.getCurrentUser.addCredentials(credentials)
logDebug(YarnSparkHadoopUtil.get.dumpTokens(credentials).mkString("\n"))
}

Expand Down