Skip to content

Driver HA support using WriteAheadLog #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
tdas wants to merge 12 commits into from
Closed

Driver HA support using WriteAheadLog #14

Changes from 1 commit
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
a33bf48
Initial version of ReceivedDataManager
tdas Oct 4, 2014
51183f6
Merge branch 'driver-ha' of github.com:tdas/spark into driver-ha
tdas Oct 4, 2014
a49fd1d
Fixed compilation errors.
tdas Oct 4, 2014
5eafb2e
Added checkpoint data of ReceiverInputDStream, improved WALManager, r…
tdas Oct 6, 2014
b86af2d
Improved WALSuite, and added ReceivedBlockHandlerSuite.
tdas Oct 7, 2014
4d9c830
Added ReceiverTrackerSuite
tdas Oct 8, 2014
9be5f22
Initial implementation of DriverFailureSuite unit test for testing wi…
tdas Oct 9, 2014
7ac7325
Merge remote-tracking branch 'origin/driver-ha' into driver-ha-working
tdas Oct 9, 2014
09cda57
Updated receiver input stream to use HDFSBackedBlockRDD.
tdas Oct 9, 2014
e390c71
Made WriteAheadLogWriter use local fileoutputstream for local file sy…
tdas Oct 9, 2014
6b61287
Added ReceivedBlockTracker to track all block metadata related action…
tdas Oct 21, 2014
acd9467
Moved around packages.
tdas Oct 21, 2014
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'driver-ha' of github.com:tdas/spark into driver-ha
  • Loading branch information
@tdas
tdas committed Oct 4, 2014
commit 51183f6532f6877d74009108e94216c1c989eb4f

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.