[SPARK-32916][SHUFFLE][test-maven][test-hadoop2.7] Ensure the number of chunks in meta file and index file are equal#30433

Closed

otterc wants to merge 6 commits intoapache:masterfrom

linkedin:SPARK-32916-followup

Commits on Dec 1, 2020

Ensure the number of chunks in meta file and index file are equal
otterc
committed

Commits on Dec 3, 2020

Commits on Dec 8, 2020

Fixed log statement and comment
otterc
committed

Commits on Dec 9, 2020

Fail pending blocks before writing when number of IOExceptions have exceeded threshold
otterc
committed
Reuse abortIfNecessary while creating the callback
otterc
committed