Skip to content

[SPARK-529] [core] [yarn] Add type-safe config keys to SparkConf. #10205

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
vanzin wants to merge 36 commits into from
Closed

[SPARK-529] [core] [yarn] Add type-safe config keys to SparkConf. #10205

Changes from 1 commit
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
8b00d76
[RFC] Add type-safe config keys to SparkConf.
Dec 7, 2015
85ab5f1
Silence mima.
Dec 8, 2015
bda7e2b
Fix HiveContext.
Dec 9, 2015
93736c2
Add entry for spark.executor.instances.
Dec 9, 2015
c858fa8
Move code around, create object for core config keys.
Dec 11, 2015
c1de25f
Implement Andrew's suggestion (`import foo.config._`).
Dec 14, 2015
c07293f
Merge branch 'master' into conf-opts
Dec 30, 2015
6b6eb27
Reorder / regroup YARN configs.
Dec 30, 2015
86296fd
Move mima excludes to new, correct place.
Jan 5, 2016
d378ced
Merge branch 'master' into conf-opts
Jan 5, 2016
e91c91a
Fix typo.
Jan 5, 2016
db4a8ae
Merge branch 'master' into conf-opts
Jan 6, 2016
9878c39
Merge branch 'master' into conf-opts
Jan 7, 2016
c3d1b4a
Merge branch 'master' into conf-opts
Jan 25, 2016
d8ca3e1
Allow negative values in bytesConf.
Jan 25, 2016
e7f775a
Fix scalastyle.
Jan 26, 2016
b3a3b18
Fix broken merge.
Jan 26, 2016
3fd9c5e
Merge branch 'master' into conf-opts
Feb 4, 2016
d96d92d
Merge branch 'master' into conf-opts
Feb 18, 2016
6f7a6d7
Revert unneeded changes.
Feb 19, 2016
e5604d3
Merge branch 'master' into conf-opts
Feb 24, 2016
e2ec60e
Feedback.
Feb 24, 2016
0bbee02
Use a builder to construct config options.
Feb 26, 2016
69142ab
Merge branch 'master' into conf-opts
Feb 26, 2016
0d96e3a
Fix borked merge.
Feb 27, 2016
03dc641
Allow transformation of config data.
Feb 27, 2016
0f0147c
Fix a NPE.
Feb 28, 2016
885d4a6
Change the way seq configs are defined.
Feb 28, 2016
34fed1c
Merge branch 'master' into conf-opts
Feb 28, 2016
3a3968d
Merge branch 'master' into conf-opts
Feb 28, 2016
3d15e54
Use orNull.
Feb 28, 2016
b6928ea
Merge branch 'master' into conf-opts
Feb 29, 2016
fc48cf0
Revert sql changes (to be submitted separately).
Feb 29, 2016
be1daed
Move new classes to an "internal" package.
Mar 1, 2016
dbfed7d
Merge branch 'master' into conf-opts
Mar 7, 2016
31156aa
Add some more javadocs.
Mar 7, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Use orNull.
  • Loading branch information
Marcelo Vanzin committed Feb 28, 2016
commit 3d15e54682b394741ace4f3adb3e406893bd29e4
2 changes: 1 addition & 1 deletion core/src/main/scala/org/apache/spark/config/ConfigBuilder.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ private[spark] class TypedConfigBuilder[T](
import ConfigHelpers._

def this(parent: ConfigBuilder, converter: String => T) = {
this(parent, converter, Option(_).map(_.toString).getOrElse(null))
this(parent, converter, Option(_).map(_.toString).orNull)
}

def transform(fn: T => T): TypedConfigBuilder[T] = {
Expand Down