Skip to content

[SPARK-24755][Core] Executor loss can cause task to not be resubmitted #21729

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
hthuynh2 wants to merge 7 commits into from
Closed

[SPARK-24755][Core] Executor loss can cause task to not be resubmitted #21729

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
093e39c
SPARK-24755 Executor loss can cause task to not be resubmitted
Jul 8, 2018
9f0e0ae
Fix indentation and comments
Jul 16, 2018
b2affd2
Remove extra empty line
Jul 16, 2018
20a032c
Fix another indentation
Jul 16, 2018
a67bebc
fix scala style error
Jul 16, 2018
f9ed226
resolve conflict
Jul 18, 2018
6316e5b
fix indentation
Jul 18, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove extra empty line
  • Loading branch information
Hieu Huynh authored and Hieu Huynh committed Jul 16, 2018
commit b2affd221a509557cf616ba5facbe05cbd8a144f
3 changes: 1 addition & 2 deletions core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,8 +83,7 @@ private[spark] class TaskSetManager(
// be re-run because the missing map data needs to be regenerated first.
val successful = new Array[Boolean](numTasks)
private val numFailures = new Array[Int](numTasks)



// Add the tid of task into this HashSet when the task is killed by other attempt tasks.
// This happened while we set the `spark.speculation` to true. The task killed by others
// should not resubmit while executor lost.
Expand Down