[SPARK-5931][CORE] Use consistent naming for time properties#5236

Closed

ilganeli wants to merge 60 commits intoapache:masterfrom

ilganeli:SPARK-5931

Commits on Mar 27, 2015

[SPARK-5931] Updated Utils and JavaUtils classes to add helper methods to handle time strings. Updated time strings in a few places to properly parse time
Ilya Ganelin
committed
Updated usage of spark.core.connection.ack.wait.timeout
Ilya Ganelin
committed
Updated usage of spark.akka.timeout
Ilya Ganelin
committed
Updated usage of spark.storage.blockManagerSlaveTimeout
Ilya Ganelin
committed
Updated spark.shuffle.io.retryWait
Ilya Ganelin
committed
updated spark.shuffle.sasl.timeout
Ilya Ganelin
committed
Updated usage of spark.cleaner.ttl
Ilya Ganelin
committed
updated spark.akka.heartbeat.interval
Ilya Ganelin
committed
Updated spark.locality.wait
Ilya Ganelin
committed
Updated spark.scheduler.maxRegisteredResourcesWaitingTime
Ilya Ganelin
committed
Updated spark.scheduler.revive.interval
Ilya Ganelin
committed
Upated spark.speculation.interval
Ilya Ganelin
committed
Updated spark.dynamicAllocation.executorIdleTimeout
Ilya Ganelin
committed
Updated spark.dynamicAllocation.schedulerBacklogTimeout
Ilya Ganelin
committed
Updated spark.core.connection.auth.wait.timeout
Ilya Ganelin
committed
Updated spark.streaming.blockInterval
Ilya Ganelin
committed
Updated configuration doc with note on specifying time properties
Ilya Ganelin
committed
Fixed misuse of time in streaming context test
Ilya Ganelin
committed

Commits on Mar 28, 2015

Commits on Mar 30, 2015

Reverting doc changes
Ilya Ganelin
committed
Merge branch 'SPARK-5931' of github.com:ilganeli/spark into SPARK-5931
Ilya Ganelin
committed
[SPARK-5931] Changed default behavior of time string conversion.
Ilya Ganelin
committed
Updated host revceiver
Ilya Ganelin
committed
Updated more files to clean up usage of default time strings
Ilya Ganelin
committed
Fixed remaining usages to be consistent. Updated Java-side time conversion
Ilya Ganelin
committed

Commits on Mar 31, 2015

Udpated time conversion to use map iterator instead of if fall through
Ilya Ganelin
committed
Updated Java code to add day, minutes, and hours
Ilya Ganelin
committed
Whitespace
Ilya Ganelin
committed
More whitespace
Ilya Ganelin
committed
Fixed bug where all time was being converted to us instead of the appropriate units
Ilya Ganelin
committed
Fixed conversion to US from seconds
Ilya Ganelin
committed
[SPARK-5931] Updated Java conversion to be similar to scala conversion. Updated conversions to clean up code a little using TimeUnit.convert. Added Unit tests
Ilya Ganelin
committed
replaced get or default since it's not present in this version of java
Ilya Ganelin
committed
Updated scala code to call into java
Ilya Ganelin
committed

Commits on Apr 1, 2015

Special handling of overlapping usffixes for java
Ilya Ganelin
committed
[SPARK-5931] Minor nit fixes'
Ilya Ganelin
committed

Commits on Apr 6, 2015

Resolved merge conflicts
Ilya Ganelin
committed
Updated suffix handling to handle overlap of units more gracefully
Ilya Ganelin
committed
Added cleaner computation of time conversions in tests
Ilya Ganelin
committed
Updated tests to fix small bugs
Ilya Ganelin
committed
Convert straight to seconds
Ilya Ganelin
committed
Nit
Ilya Ganelin
committed

Commits on Apr 7, 2015

Got rid of thrown exceptions
Ilya Ganelin
committed

Commits on Apr 8, 2015

Added time conversion for yarn.scheduler.heartbeat.interval-ms
Ilya Ganelin
committed
Fixed priority order and mixed up conversions in a couple spots
Ilya Ganelin
committed
Formatting fixes and added m for use as minute formatter
Ilya Ganelin
committed
Formatting error
Ilya Ganelin
committed
Now using regexes to simplify code in parseTimeString. Introduces getTimeAsSec and getTimeAsMs methods in SparkConf. Updated documentation
Ilya Ganelin
committed
Added fix for possible NPE
Ilya Ganelin
committed
Fixed error in exception handling
Ilya Ganelin
committed
Added test for zero
Ilya Ganelin
committed

Commits on Apr 9, 2015

Fixed handling of -1
Ilya Ganelin
committed
Fixed logic for invalid suffixes and addid matching test
Ilya Ganelin
committed

Commits on Apr 11, 2015

Minor nit fixes
Ilya Ganelin
committed

Commits on Apr 13, 2015

Minor fixes and doc updates
Ilya Ganelin
committed
Made the most recent round of changes
Ilya Ganelin
committed
Doc updates
Ilya Ganelin
committed
Fixing style errors
Ilya Ganelin
committed
Update configuration.md
Ilya Ganelin
committed