[SPARK-12896] [WIP] Send only accumulator updates to driver, not TaskMetrics#10857

Closed

andrewor14 wants to merge 44 commits intoapache:masterfrom

andrewor14:dont-send-task-metrics

Commits on Jan 18, 2016

Change types of some signatures
Andrew Or
committed
Boiler plate for all the new internal accums
Andrew Or
committed

Commits on Jan 19, 2016

Squashed commit of the following:
Andrew Or
committed
Implement TaskMetrics using Accumulators
Andrew Or
committed
Fix accums not set on the driver
Andrew Or
committed
Fix test compile
Andrew Or
committed
Make accum updates read from all registered accums
Andrew Or
committed
Fix metrics being double counted on driver
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Miscellaneous updates; make diff smaller
Andrew Or
committed
Fix JsonProtocolSuite
Andrew Or
committed
Fix SQLQuerySuite
Andrew Or
committed
Fix style
Andrew Or
committed
Fix MiMa
Andrew Or
committed
Add test on accum values being zero'ed out + cleanups
Andrew Or
committed
Add tests for TaskMetrics, which uncovered a bug
Andrew Or
committed
Minor test changes
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Fix style
Andrew Or
committed
Fix MiMa
Andrew Or
committed

Commits on Jan 20, 2016

Fix InputOutputMetricsSuite
Andrew Or
committed
Fix TaskContextSuite
Andrew Or
committed
Fix ReplayListenerSuite
Andrew Or
committed
Fix SparkListenerSuite
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into task-metrics-use-accums
Andrew Or
committed
Minor comment correction
Andrew Or
committed
Add test to verify internal accums are cleaned up
Andrew Or
committed
Add deprecated matching methods for Input/OutputMetrics
Andrew Or
committed
Merge branch 'task-metrics-use-accums' of github.com:andrewor14/spark into dont-send-task-metrics
Andrew Or
committed
Add "countFailedValues" flag in Accumulable[Info]
Andrew Or
committed
Send back accum updates only, not TaskMetrics
Andrew Or
committed
Fix test compile
Andrew Or
committed

Commits on Jan 21, 2016

Fix tests
Andrew Or
committed
Reconstruct TaskMetrics on driver
Andrew Or
committed
Send accum updates instead of TaskMetrics on heartbeat
Andrew Or
committed
Clean up a few TODOs that were introduced in SPARK-12895
Andrew Or
committed
Fix style
Andrew Or
committed
Fix JsonProtocolSuite
Andrew Or
committed
Add extra tests to AccumulatorSuite
Andrew Or
committed
Fix InternalAccumulatorSuite
Andrew Or
committed
Add more tests in TaskContextSuite
Andrew Or
committed
Fix PartitionBatchPruningSuite
Andrew Or
committed
Merge branch 'master' of github.com:apache/spark into dont-send-task-metrics
Andrew Or
committed
Fix MiMa
Andrew Or
committed