Skip to content

[SPARK-8777] [SQL] Add random data generator test utilities to Spark SQL #7176

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
JoshRosen wants to merge 8 commits into from
Closed

[SPARK-8777] [SQL] Add random data generator test utilities to Spark SQL #7176

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
d2b4a4a
Add random data generator test utilities to Spark SQL.
JoshRosen Jul 2, 2015
ab76cbd
Move code to Catalyst package.
JoshRosen Jul 2, 2015
5acdd5c
Infinity and NaN are interesting.
JoshRosen Jul 2, 2015
b55875a
Generate doubles and floats over entire possible range.
JoshRosen Jul 2, 2015
0c20905
Initial attempt at using ScalaCheck.
JoshRosen Jul 2, 2015
89d86b1
Bump ScalaCheck version.
JoshRosen Jul 3, 2015
e0d7d49
Bump ScalaCheck version in LICENSE
JoshRosen Jul 3, 2015
f71634d
Roll back ScalaCheck usage
JoshRosen Jul 3, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Move code to Catalyst package.
  • Loading branch information
@JoshRosen
JoshRosen committed Jul 2, 2015
commit ab76cbd89bf800d590b7833f5a25c62df4ec2a95
6 changes: 2 additions & 4 deletions .../spark/sql/test/RandomDataGenerator.scala → ...pache/spark/sql/RandomDataGenerator.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,14 +15,12 @@
* limitations under the License.
*/

package org.apache.spark.sql.test
package org.apache.spark.sql

import org.apache.spark.sql.Row
import org.apache.spark.sql.types._

import scala.util.Random

import org.apache.spark.sql.types._

/**
* Random data generators for Spark SQL DataTypes. These generators do not generate uniformly random
* values; instead, they're biased to return "interesting" values (such as maximum / minimum values)
Expand Down
4 changes: 2 additions & 2 deletions ...k/sql/test/RandomDataGeneratorSuite.scala → .../spark/sql/RandomDataGeneratorSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,11 +15,11 @@
* limitations under the License.
*/

package org.apache.spark.sql.test
package org.apache.spark.sql

import org.apache.spark.SparkFunSuite
import org.apache.spark.sql.catalyst.CatalystTypeConverters
import org.apache.spark.sql.types.{StructField, StructType, MapType, DataType}
import org.apache.spark.sql.types._

/**
* Tests of [[RandomDataGenerator]].
Expand Down
4 changes: 1 addition & 3 deletions ...he/spark/sql/test/DataTypeTestUtils.scala → ...e/spark/sql/types/DataTypeTestUtils.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,9 +15,7 @@
* limitations under the License.
*/

package org.apache.spark.sql.test

import org.apache.spark.sql.types._
package org.apache.spark.sql.types

/**
* Utility functions for working with DataTypes in tests.
Expand Down