Skip to content

SPARK-3329: [SQL] Don't depend on Hive SET pair ordering. #2220

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
willb wants to merge 3 commits into from
Closed

SPARK-3329: [SQL] Don't depend on Hive SET pair ordering. #2220

Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
cf11b0e
Fix flakey HiveQuerySuite test
aarondav Jul 21, 2014
6525d8e
Handle cases where SET returns Rows of (single) strings
willb Sep 2, 2014
3b3e205
Collapse collectResults case match in HiveQuerySuite
willb Sep 3, 2014
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Handle cases where SET returns Rows of (single) strings
  • Loading branch information
@willb
willb committed Sep 2, 2014
commit 6525d8ef79645abe3ed26e4e2ac6aa09bcd0b203
11 changes: 8 additions & 3 deletions sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -520,9 +520,14 @@ class HiveQuerySuite extends HiveComparisonTest {
val testKey = "spark.sql.key.usedfortestonly"
val testVal = "test.val.0"
val nonexistentKey = "nonexistent"
def collectResults(rdd: SchemaRDD): Set[(String, String)] =
rdd.collect().map { case Row(key: String, value: String) => key -> value }.toSet

val KV = "([^=]+)=([^=]*)".r
def collectResults(rdd: SchemaRDD): Set[(String, String)] =
rdd.collect().map {
case Row(key: String, value: String) => key -> value
case Row(kv: String) => kv match {
case KV(key, value) => key -> value
Copy link
Contributor

@marmbrus marmbrus Sep 3, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor style nit: this could just be: case Row(KV(key,value)) => ... I believe.

}
}.toSet
clear()

// "set" itself returns all config variables currently specified in SQLConf.
Expand Down