[SPARK-19753][CORE] Un-register all shuffle output on a host in case of slave lost or fetch failure#18150

Closed

sitalkedia wants to merge 16 commits intoapache:masterfrom

sitalkedia:cleanup_shuffle

Commits on Jun 13, 2017

[SPARK-19753][CORE] All shuffle files on a host should be removed in case of fetch failure or slave lost
Sital Kedia
committed
Do not un-register shuffle files in case of executor lost
Sital Kedia
committed
no-op when external shuffle service is disabled
Sital Kedia
committed
fix check style
Sital Kedia
committed
Addressed review comments and fixed a bug
Sital Kedia
committed
Fix build
Sital Kedia
committed
Fix test failures
Sital Kedia
committed
refactoring & comments

squito
authored and
Sital Kedia
committed
Review comments
Sital Kedia
committed
Minor changes as per review comments
Sital Kedia
committed
Make the behaviour configurable and minor review comments
Sital Kedia
committed
Minor changes
Sital Kedia
committed
set the behavior to false by defaut
Sital Kedia
committed
Fix test
Sital Kedia
committed

Commits on Jun 14, 2017

Rebase with master
Sital Kedia
committed
remove extra while space
Sital Kedia
committed