Skip to content

[SPARK-31486] [CORE] spark.submit.waitAppCompletion flag to control spark-submit exit in Standalone Cluster Mode #28258

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
akshatb1 wants to merge 15 commits into from
+88 −26
Closed

[SPARK-31486] [CORE] spark.submit.waitAppCompletion flag to control spark-submit exit in Standalone Cluster Mode #28258

Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
13ea149
Implementation of spark.submit.waitForCompletion flag which will cont…
Apr 19, 2020
68d76d0
Fixing to adher to JavaDoc and Scalastyle guidelines
akshatb1 Apr 19, 2020
34c7d26
Using conf.getBoolean for the config
akshatb1 Apr 20, 2020
a93ce76
Using Match Statement and updating config property location in docume…
akshatb1 May 1, 2020
d5eded1
Addressing documentation related review comments
akshatb1 May 2, 2020
8eef373
Fixing indentation
akshatb1 May 2, 2020
0918106
Implementing the flag using asyn message
akshatb1 May 10, 2020
e225495
Implementing the flag using async DriverStatusResponse message
akshatb1 May 10, 2020
20f1bd6
Merge branch 'master' of https://github.com/akshatb1/spark
akshatb1 May 10, 2020
9050a08
Using Thread Scheduler to Monitor Driver Status
akshatb1 May 16, 2020
45c9817
Refactoring to avoid multiple calls of pollAndReportStatus method
akshatb1 May 22, 2020
743d93d
Fixing indentation
akshatb1 Jun 2, 2020
fe142a8
Fixing Indentation for method parameters
akshatb1 Jun 2, 2020
27a81c9
Merging master
akshatb1 Jun 2, 2020
0e152f4
Merging master
akshatb1 Jun 8, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Using conf.getBoolean for the config
  • Loading branch information
@akshatb1
akshatb1 committed Apr 20, 2020
commit 34c7d26d7d69734bd334518bc36147763ee77f14
2 changes: 1 addition & 1 deletion core/src/main/scala/org/apache/spark/deploy/Client.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ private class ClientEndpoint(

private val lostMasters = new HashSet[RpcAddress]
private var activeMasterEndpoint: RpcEndpointRef = null
private val waitAppCompletion = conf.get("spark.submit.waitAppCompletion", "false") == "true"
private val waitAppCompletion = conf.getBoolean("spark.submit.waitAppCompletion", false)
private val REPORT_DRIVER_STATUS_INTERVAL = 1000


Expand Down