Skip to content

[SPARK-11940][PYSPARK][ML] Python API for ml.clustering.LDA PR2 #12723

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jkbradley wants to merge 9 commits into from
Closed

[SPARK-11940][PYSPARK][ML] Python API for ml.clustering.LDA PR2 #12723

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
c0367f4
[SPARK-11940][PYSPARK] Python API for ml.clustering.LDA
zjffdu Dec 4, 2015
417de17
address comments
zjffdu Apr 20, 2016
66f265f
code style fix
zjffdu Apr 20, 2016
09d5ca7
address comments
zjffdu Apr 22, 2016
4f9bdaa
added type converter and used set instead of paramMap directly
jkbradley Apr 26, 2016
0d12924
remaining PR cleanups, plus fixing use of :py:attr:
jkbradley Apr 27, 2016
4f807e8
Added persistence to LDA in Python
jkbradley Apr 27, 2016
46979e8
Added keepLastCheckpoint Param to python LDA. Added Experimental, in…
jkbradley Apr 27, 2016
f37c1c1
added save/load to doc test in Python LDA
jkbradley Apr 28, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
added save/load to doc test in Python LDA
  • Loading branch information
@jkbradley
jkbradley committed Apr 28, 2016
commit f37c1c1d4e0c15ccc7182b8ee074d77bab5b89bd
9 changes: 9 additions & 0 deletions python/pyspark/ml/clustering.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -657,6 +657,15 @@ class LDA(JavaEstimator, HasFeaturesCol, HasMaxIter, HasSeed, HasCheckpointInter
...
>>> model.topicsMatrix()
DenseMatrix(2, 2, [0.496, 0.504, 0.504, 0.496], 0)
>>> lda_path = temp_path + "/lda"
>>> lda.save(lda_path)
>>> sameLDA = LDA.load(lda_path)
>>> distributed_model_path = temp_path + "/lda_distributed_model"
>>> model.save(distributed_model_path)
>>> sameModel = DistributedLDAModel.load(distributed_model_path)
>>> local_model_path = temp_path + "/lda_local_model"
>>> localModel.save(local_model_path)
>>> sameLocalModel = LocalLDAModel.load(local_model_path)

.. versionadded:: 2.0.0
"""
Expand Down