Skip to content

[SPARK-18206][ML]Add instrumentation for MLP,NB,LDA,AFT,GLM,Isotonic,LiR #15671

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
zhengruifeng wants to merge 21 commits into from
Closed

[SPARK-18206][ML]Add instrumentation for MLP,NB,LDA,AFT,GLM,Isotonic,LiR #15671

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
25258ae
create pr
zhengruifeng Oct 26, 2016
2bc4e29
fix nits
zhengruifeng Oct 27, 2016
b0b2cc3
add instr for regression
zhengruifeng Oct 28, 2016
41aff47
add instr for algos
zhengruifeng Oct 28, 2016
5dc6b43
update
zhengruifeng Oct 28, 2016
457196a
remove cla.params
zhengruifeng Oct 28, 2016
22c9f0c
add numfea in rf and dt
zhengruifeng Oct 28, 2016
ff49d70
revert OvR
zhengruifeng Oct 28, 2016
e2a1546
revert trees
zhengruifeng Oct 29, 2016
867f08b
list params; correct logSuccess place; update comment of logSuccess
zhengruifeng Nov 1, 2016
d129416
select params in gbt and rf
zhengruifeng Nov 2, 2016
e62a688
fix glr,aft,lir
zhengruifeng Nov 3, 2016
19828e1
fix style
zhengruifeng Nov 4, 2016
6e27321
update als
zhengruifeng Nov 30, 2016
6d48759
fix conflict
zhengruifeng Nov 30, 2016
c172efc
fix glr
zhengruifeng Dec 30, 2016
00b91fd
fix style
zhengruifeng Dec 30, 2016
c8693d8
update
zhengruifeng Jan 5, 2017
e6b4615
Merge branch 'master' into lir_instr
zhengruifeng Jan 9, 2017
7f00d36
log quantileProbabilities.size
zhengruifeng Jan 13, 2017
c8188b0
del docConcentration
zhengruifeng Jan 13, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
revert OvR
  • Loading branch information
@zhengruifeng
zhengruifeng committed Jan 5, 2017
commit ff49d7018fd039fa89875670a0e701c3aa2aac64
7 changes: 0 additions & 7 deletions mllib/src/main/scala/org/apache/spark/ml/classification/OneVsRest.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -317,10 +317,6 @@ final class OneVsRest @Since("1.4.0") (
}
val numClasses = MetadataUtils.getNumClasses(labelSchema).fold(computeNumClasses())(identity)

val instr = Instrumentation.create(this, dataset)
instr.logParams(params : _*)
instr.logNumClasses(numClasses)

val multiclassLabeled = dataset.select($(labelCol), $(featuresCol))

// persist if underlying dataset is not persistent.
Expand Down Expand Up @@ -356,9 +352,6 @@ final class OneVsRest @Since("1.4.0") (
case attr: Attribute => attr
}
val model = new OneVsRestModel(uid, labelAttribute.toMetadata(), models).setParent(this)

instr.logNumFeatures(models.head.numFeatures)
instr.logSuccess(model)
copyValues(model)
}

Expand Down