[SPARK-8598] [MLlib] Implementation of 1-sample, two-sided, Kolmogorov Smirnov Test for RDDs#6994

Closed

josepablocam wants to merge 27 commits intoapache:masterfrom

josepablocam:master

Commits on Jun 24, 2015

created test result class for ks test
jose.cambronero
committed
created KS test class
jose.cambronero
committed
added user facing ks test functions
jose.cambronero
committed
added kstest testing in HypothesisTestSuite
jose.cambronero
committed
made small changes to pass style check
jose.cambronero
committed
changed style and some comments based on feedback from pull request
jose.cambronero
committed
removed ksTestOpt from API and changed comments in HypothesisTestSuite accordingly
jose.cambronero
committed

Commits on Jun 25, 2015

Commits on Jun 26, 2015

specified what distributions are available for the convenience method ksTest(data, name) (solely standard normal)
jose.cambronero
committed
Style changes as per comments and added implementation note explaining the distributed approach.
jose.cambronero
committed
renamed ks1 sample test for clarity
jose.cambronero
committed
additional style changes incorporated and added documentation to mllib statistics docs
jose.cambronero
committed

Commits on Jun 29, 2015

reindent multi-line lambdas, prior intepretation of style guide was wrong on my part
jose.cambronero
committed

Commits on Jul 7, 2015

Commits on Jul 8, 2015

changed ksTest(data, distName) to ksTest(data, distName, params*) after api discussions. Changed tests and docs accordingly
jose.cambronero
committed

Commits on Jul 9, 2015

initialize to stdnormal when no params passed (and log). Change unit tests to approximate equivalence rather than strict
jose.cambronero
committed
style and doc changes. Factored out ks test into 2 separate tests
jose.cambronero
committed
refactor code to account for serializable RealDistribution. Reuse testOneSample( _, cdf)
jose.cambronero
committed
changed ksTest in public API to kolmogorovSmirnovTest for clarity
jose.cambronero
committed
kstTest -> kolmogorovSmirnovTest in statistics.md
jose.cambronero
committed

Commits on Jul 11, 2015

renamed KSTestResult to KolmogorovSmirnovTestResult, to stay consistent with method name
jose.cambronero
committed

Commits on Jul 13, 2015

Merge remote-tracking branch 'upstream/master'
jose.cambronero
committed