Skip to content

[SPARK-10117][MLLIB] Implement SQL data source API for reading LIBSVM data #8537

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Lewuathe wants to merge 21 commits into from
Closed

[SPARK-10117][MLLIB] Implement SQL data source API for reading LIBSVM data #8537

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
99accaa
[SPARK-10117] Implement SQL data source API for reading LIBSVM data
Lewuathe Aug 31, 2015
7056d4a
Merge branch 'master' into SPARK-10117
Lewuathe Sep 2, 2015
40d3027
Add Java test
Lewuathe Sep 2, 2015
3fd8dce
[SPARK-10117] Implement SQL data source API for reading LIBSVM data
Lewuathe Aug 31, 2015
70ee4dd
Add Java test
Lewuathe Sep 2, 2015
aef9564
Fix
Lewuathe Sep 3, 2015
a97ee97
Fix some points
Lewuathe Sep 3, 2015
62010af
Merge branch 'master' into SPARK-10117
Lewuathe Sep 3, 2015
7d693c2
Resolv conflict
Lewuathe Sep 3, 2015
2c12894
Remove unnecessary tag
Lewuathe Sep 3, 2015
b56a948
Merge branch 'master' into SPARK-10117
Lewuathe Sep 4, 2015
8660d0e
Fix Java unit test
Lewuathe Sep 4, 2015
5ab62ab
Merge branch 'master' into SPARK-10117
Lewuathe Sep 6, 2015
4f40891
Improve test suites
Lewuathe Sep 6, 2015
0ea1c1c
LibSVMRelation is registered into META-INF
Lewuathe Sep 7, 2015
ba3657c
Merge branch 'master' into SPARK-10117
Lewuathe Sep 8, 2015
1fdd2df
Merge branch 'SPARK-10117' of github.com:Lewuathe/spark into SPARK-10117
Lewuathe Sep 8, 2015
9ce63c7
Rewrite service loader file
Lewuathe Sep 8, 2015
21600a4
Merge branch 'master' into SPARK-10117
Lewuathe Sep 9, 2015
11d513f
Fix some reviews
Lewuathe Sep 9, 2015
986999d
Change unit test phrase
Lewuathe Sep 9, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix Java unit test
  • Loading branch information
@Lewuathe
Lewuathe committed Sep 4, 2015
commit 8660d0e2a815b367cc9f34251926e315bc95f9c1
2 changes: 1 addition & 1 deletion mllib/src/test/java/org/apache/spark/ml/source/JavaLibSVMRelationSuite.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ public void tearDown() {

@Test
public void verifyLibSVMDF() {
dataset = jsql.read().format("libsvm").load();
dataset = jsql.read().format("org.apache.spark.ml.source.libsvm").load(path.getPath());
Copy link
Contributor

@mengxr mengxr Sep 4, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add option("vectorType", "dense")?

Assert.assertEquals("label", dataset.columns()[0]);
Assert.assertEquals("features", dataset.columns()[1]);
Row r = dataset.first();
Expand Down