Skip to content

[SPARK-9883][MLlib] Distance to each kmean cluster given a point #8849

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
BertrandDechoux wants to merge 9 commits into from
Closed

[SPARK-9883][MLlib] Distance to each kmean cluster given a point #8849

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
968d687
[SPARK-9883][MLlib] Distance to each kmean cluster given a point
BertrandDechoux Sep 21, 2015
7a746d1
fix compilation + add @Since for KMeansModel new methods
BertrandDechoux Sep 21, 2015
178fe93
[SPARK-9883][MLlib] document KMeansModel new methods
BertrandDechoux Sep 21, 2015
beed882
[SPARK-9883][MLlib] scalastyle compliant
BertrandDechoux Sep 21, 2015
7a17818
[SPARK-9883][MLlib] use cluster index instead of cluster point when p…
BertrandDechoux Sep 22, 2015
7f46fcb
[SPARK-9883][MLlib] strict non laziness when providing distances fro…
BertrandDechoux Sep 22, 2015
d97d8f8
[SPARK-9883][MLlib] clean code
BertrandDechoux Sep 22, 2015
a193011
[SPARK-9883][MLlib] simple test
BertrandDechoux Sep 22, 2015
159608a
[SPARK-9883][MLlib] fix scala style
BertrandDechoux Sep 22, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix compilation + add @SInCE for KMeansModel new methods
  • Loading branch information
@BertrandDechoux
BertrandDechoux committed Sep 21, 2015
commit 7a746d1a07c1c38ffb2ed76948008a90d2286393
5 changes: 3 additions & 2 deletions mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeansModel.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -77,12 +77,13 @@ class KMeansModel @Since("1.1.0") (@Since("1.0.0") val clusterCenters: Array[Vec
def predict(points: JavaRDD[Vector]): JavaRDD[java.lang.Integer] =
predict(points.rdd).toJavaRDD().asInstanceOf[JavaRDD[java.lang.Integer]]

/** */
def distanceToCenters(point: Vector): (Int, Double) = {
@Since("1.5.0")
def distanceToCenters(point: Vector): Iterable[(VectorWithNorm, Double)] = {
val pointWithNorm = new VectorWithNorm(point)
clusterCentersWithNorm.map(c => (c, KMeans.fastSquaredDistance(c, pointWithNorm)))
}

@Since("1.5.0")
def distanceToCenters(points: RDD[Vector]): RDD[(Vector, Iterable[(VectorWithNorm, Double)])] ={
val centersWithNorm = clusterCentersWithNorm
val bcCentersWithNorm = points.context.broadcast(centersWithNorm)
Expand Down