[SPARK-4666] Improve YarnAllocator's parsing of "memory overhead" param#3525

Closed

ryan-williams wants to merge 24 commits intoapache:masterfrom

ryan-williams:mem-overhead

Commits on Feb 10, 2015

rename: executorMemory -> executorMemoryMB
ryan-williams
committed
rename: amMemory -> amMemoryMB
ryan-williams
committed
rename: driverMemory -> driverMemoryMB
ryan-williams
committed
rename: DEFAULT_MEMORY -> DEFAULT_MEMORY_MB
ryan-williams
committed
rename: amMemoryOverhead -> amMemoryOverheadMB
ryan-williams
committed
rename: executorMemoryOverhead -> executorMemoryOverheadMB
ryan-williams
committed
rename: amMemoryOverhead -> amMemoryOverheadMB
ryan-williams
committed
rename: executorMemoryOverhead -> executorMemoryOverheadMB
ryan-williams
committed
rename: MEMORY_OVERHEAD_MIN -> MEMORY_OVERHEAD_MIN_MB
ryan-williams
committed
fix deprecation warning
ryan-williams
committed
rename: executorMemory -> executorMemoryMB
ryan-williams
committed
rename: executorMemory -> executorMemoryMB
ryan-williams
committed
rename: memoryOverhead -> memoryOverheadMB
ryan-williams
committed
rename: memory -> memoryMB
ryan-williams
committed
rename: mem -> memMB
ryan-williams
committed
memoryStringToMb can have default scale specified
ryan-williams
committed
move getMaxResultSize from Utils to SparkConf
ryan-williams
committed
privatize amMemoryOverheadConf
ryan-williams
committed
refactor memory-size order-of-magnitude constants
ryan-williams
committed
add memory-string-parsing helpers to Utils
ryan-williams
committed
add `getMemory`, `getMB` helpers to SparkConf
ryan-williams
committed
use SparkConf.getMB helper in Yarn memory parsing
ryan-williams
committed
update docs about YARN memory overhead parameters
ryan-williams
committed
code review feedback
ryan-williams
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SPARK-4666] Improve YarnAllocator's parsing of "memory overhead" param#3525

[SPARK-4666] Improve YarnAllocator's parsing of "memory overhead" param#3525
ryan-williams wants to merge 24 commits intoapache:masterfrom
ryan-williams:mem-overhead

Commits on Feb 10, 2015

rename: executorMemory -> executorMemoryMB

rename: amMemory -> amMemoryMB

rename: driverMemory -> driverMemoryMB

rename: DEFAULT_MEMORY -> DEFAULT_MEMORY_MB

rename: amMemoryOverhead -> amMemoryOverheadMB

rename: executorMemoryOverhead -> executorMemoryOverheadMB

rename: amMemoryOverhead -> amMemoryOverheadMB

rename: executorMemoryOverhead -> executorMemoryOverheadMB

rename: MEMORY_OVERHEAD_MIN -> MEMORY_OVERHEAD_MIN_MB

fix deprecation warning

rename: executorMemory -> executorMemoryMB

rename: executorMemory -> executorMemoryMB

rename: memoryOverhead -> memoryOverheadMB

rename: memory -> memoryMB

rename: mem -> memMB

memoryStringToMb can have default scale specified

move getMaxResultSize from Utils to SparkConf

privatize amMemoryOverheadConf

refactor memory-size order-of-magnitude constants

add memory-string-parsing helpers to Utils

add `getMemory`, `getMB` helpers to SparkConf

use SparkConf.getMB helper in Yarn memory parsing

update docs about YARN memory overhead parameters

code review feedback

[SPARK-4666] Improve YarnAllocator's parsing of "memory overhead" param#3525ryan-williams wants to merge 24 commits intoapache:masterapache/spark:masterfrom ryan-williams:mem-overheadryan-williams/spark:mem-overheadCopy head branch name to clipboard

Commits

Commits on Feb 10, 2015

[SPARK-4666] Improve YarnAllocator's parsing of "memory overhead" param#3525
ryan-williams wants to merge 24 commits intoapache:masterfrom
ryan-williams:mem-overhead