Skip to content

[SPARK-6259][MLlib] Python API for LDA #6791

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
yu-iskw wants to merge 15 commits into from
Closed

[SPARK-6259][MLlib] Python API for LDA #6791

Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
25ef2ac
Resolve conflicts with rebasing
yu-iskw Jul 2, 2015
68f0653
Support some parameters for `ALS.train()` in Python
yu-iskw Jun 12, 2015
77fd1b7
Not use LabeledPoint
yu-iskw Jun 19, 2015
8117e18
Fix the validation problems by `lint-scala`
yu-iskw Jun 23, 2015
39514ec
Modify how to cast the input data
yu-iskw Jun 23, 2015
2278829
Fix the indentation
yu-iskw Jun 23, 2015
73412c3
Fix the typo
yu-iskw Jun 23, 2015
57ac03d
Remove the unnecessary import in Python unit testing
yu-iskw Jun 23, 2015
98f645a
Remove the interface for `describeTopics`. Because it is not implemen…
yu-iskw Jun 23, 2015
faa9764
Add some comments for the LDA paramters
yu-iskw Jun 23, 2015
9f8bed8
Simplify casting
yu-iskw Jul 2, 2015
083e226
Add the comment about the supported values and the default value of `…
yu-iskw Jul 2, 2015
d7a332a
Remove the doc comment about the optimizer's default value
yu-iskw Jul 9, 2015
28bd165
Change the place of testing code
yu-iskw Jul 14, 2015
6855f59
LDA inherits object
yu-iskw Jul 14, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Simplify casting
  • Loading branch information
@yu-iskw
yu-iskw committed Jul 15, 2015
commit 9f8bed8c97c1931f2ff5b69f17cd2513f5e73a16
6 changes: 2 additions & 4 deletions mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -526,10 +526,8 @@ private[python] class PythonMLLibAPI extends Serializable {

val documents = data.rdd.map(_.asScala.toArray).map { r =>
r(0) match {
case i: java.lang.Integer =>
(r(0).asInstanceOf[java.lang.Integer].toLong, r(1).asInstanceOf[Vector])
case i: java.lang.Long =>
(r(0).asInstanceOf[java.lang.Long].toLong, r(1).asInstanceOf[Vector])
case i: java.lang.Integer => (i.toLong, r(1).asInstanceOf[Vector])
case i: java.lang.Long => (i.toLong, r(1).asInstanceOf[Vector])
case _ => throw new IllegalArgumentException("input values contains invalid type value.")
}
}
Expand Down