Skip to content

[SPARK-18282][ML][PYSPARK] Add python clustering summaries for GMM and BKM #15777

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
sethah wants to merge 7 commits into from
Closed

[SPARK-18282][ML][PYSPARK] Add python clustering summaries for GMM and BKM #15777

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
edc2c44
add python clustering summaries and tests
sethah Nov 4, 2016
c3859da
update __all__
sethah Nov 5, 2016
f599175
use Option.apply and add tests to scala for hasSummary
sethah Nov 14, 2016
6f89617
correct BKM summary return type
sethah Nov 16, 2016
952d24a
add doc tests and change set summary input to option
sethah Nov 17, 2016
428348d
rebase
sethah Nov 17, 2016
d6caa02
update setSummary for other algos
sethah Nov 21, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
correct BKM summary return type
  • Loading branch information
@sethah
sethah committed Nov 17, 2016
commit 6f89617970eb09425b0beecfaca7ac48f1ff8827
3 changes: 1 addition & 2 deletions python/pyspark/ml/clustering.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@
from pyspark.ml.common import inherit_doc

__all__ = ['BisectingKMeans', 'BisectingKMeansModel', 'BisectingKMeansSummary',
'ClusteringSummary',
'KMeans', 'KMeansModel',
'GaussianMixture', 'GaussianMixtureModel', 'GaussianMixtureSummary',
'LDA', 'LDAModel', 'LocalLDAModel', 'DistributedLDAModel']
Expand Down Expand Up @@ -469,7 +468,7 @@ def summary(self):
training set. An exception is thrown if no summary exists.
"""
if self.hasSummary:
return GaussianMixtureSummary(self._call_java("summary"))
return BisectingKMeansSummary(self._call_java("summary"))
else:
raise RuntimeError("No training summary available for this %s" %
self.__class__.__name__)
Expand Down