Skip to content

[SPARK-10381] Fix mixup of taskAttemptNumber & attemptId in OutputCommitCoordinator #8544

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
JoshRosen wants to merge 9 commits into from
Closed

[SPARK-10381] Fix mixup of taskAttemptNumber & attemptId in OutputCommitCoordinator #8544

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
c6220fd
Add failing integration test.
JoshRosen Sep 1, 2015
a09814b
Fix bug by always using task attempt number.
JoshRosen Sep 1, 2015
0059c95
Add MiMa excludes.
JoshRosen Sep 1, 2015
81b86a1
Merge remote-tracking branch 'origin/master' into SPARK-10381
JoshRosen Sep 14, 2015
7af9c6b
Only add MiMa changes for master (will add others during backport)
JoshRosen Sep 15, 2015
035d660
More attempt -> attemptNumber renaming, per Andrew's suggestion.
JoshRosen Sep 15, 2015
0d40f83
Revert "Only add MiMa changes for master (will add others during back…
JoshRosen Sep 15, 2015
4dcb78a
Merge remote-tracking branch 'origin/master' into SPARK-10381
JoshRosen Sep 15, 2015
edbbf6f
Merge remote-tracking branch 'origin/master' into SPARK-10381
JoshRosen Sep 15, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'origin/master' into SPARK-10381
  • Loading branch information
@JoshRosen
JoshRosen committed Sep 15, 2015
commit 4dcb78a2ac77fbfd071b12cf5264d0af347595e7
16 changes: 13 additions & 3 deletions project/MimaExcludes.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,18 @@ object MimaExcludes {
def excludes(version: String) = version match {
case v if v.startsWith("1.6") =>
Seq(
MimaBuild.excludeSparkPackage("network")
) ++ Seq(
MimaBuild.excludeSparkPackage("deploy"),
MimaBuild.excludeSparkPackage("network"),
// These are needed if checking against the sbt build, since they are part of
// the maven-generated artifacts in 1.3.
excludePackage("org.spark-project.jetty"),
MimaBuild.excludeSparkPackage("unused"),
// SQL execution is considered private.
excludePackage("org.apache.spark.sql.execution")
) ++
MimaBuild.excludeSparkClass("streaming.flume.FlumeTestUtils") ++
MimaBuild.excludeSparkClass("streaming.flume.PollingFlumeTestUtils") ++
Seq(
// SPARK-10381 Fix types / units in private AskPermissionToCommitOutput RPC message.
// This class is marked as `private` but MiMa still seems to be confused by the change.
ProblemFilters.exclude[MissingMethodProblem](
Expand Down Expand Up @@ -700,4 +710,4 @@ object MimaExcludes {
MimaBuild.excludeSparkClass("mllib.regression.LinearRegressionWithSGD")
case _ => Seq()
}
}
}
You are viewing a condensed version of this merge commit. You can view the full changes here.