Skip to content

[SPARK-8840][SparkR] Add float coercion on SparkR #7280

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
viirya wants to merge 8 commits into from
Closed

[SPARK-8840][SparkR] Add float coercion on SparkR #7280

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
0dcc992
Add float coercion on SparkR.
viirya Jul 8, 2015
8db3244
schema also needs to support float. add test case.
viirya Jul 8, 2015
6f9159d
Add another test case.
viirya Jul 9, 2015
52b5294
Merge remote-tracking branch 'upstream/master' into add_r_float_coercion
viirya Jul 9, 2015
30c2a40
Update test case.
viirya Jul 9, 2015
733015a
Add test case for DataFrame with float type.
viirya Jul 10, 2015
dbf0c1b
Implicitly convert Double to Float based on provided schema.
viirya Jul 14, 2015
c86dc0e
For comments.
viirya Jul 15, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add another test case.
  • Loading branch information
@viirya
viirya committed Jul 9, 2015
commit 6f9159dac8126cb1b714f9d37ed59aa932d5fad8
10 changes: 10 additions & 0 deletions R/pkg/inst/tests/test_sparkSQL.R
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -116,6 +116,16 @@ test_that("create DataFrame from RDD", {
expect_equal(count(df), 3)
expect_equal(columns(df), c("name", "age", "height"))
expect_equal(dtypes(df), list(c("name", "string"), c("age", "double"), c("height", "double")))

hiveCtx <- tryCatch({
newJObject("org.apache.spark.sql.hive.test.TestHiveContext", ssc)
}, error = function(err) {
skip("Hive is not build with SparkSQL, skipped")
})
sql(hiveCtx, "CREATE TABLE people (name string, age double, height float) row format delimited fields terminated by ','")
insertInto(df, "people")
expect_equal(sql(hiveCtx, "SELECT age from people"), c(19, 23, 18))
expect_equal(sql(hiveCtx, "SELECT height from people"), c(164.10, 181.4, 173.7))
})

test_that("convert NAs to null type in DataFrames", {
Expand Down