Skip to content

Commit f77e574

Browse files
committed
Disable spark.shuffle.reduceLocality.enabled by default.
1 parent b265e28 commit f77e574

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -138,7 +138,7 @@ class DAGScheduler(
138138

139139
// Flag to control if reduce tasks are assigned preferred locations
140140
private val shuffleLocalityEnabled =
141-
sc.getConf.getBoolean("spark.shuffle.reduceLocality.enabled", true)
141+
sc.getConf.getBoolean("spark.shuffle.reduceLocality.enabled", false)
142142
// Number of map, reduce tasks above which we do not assign preferred locations
143143
// based on map output sizes. We limit the size of jobs for which assign preferred locations
144144
// as computing the top locations by size becomes expensive.

0 commit comments

Comments
 (0)