Skip to content

Conversation

@cloud-fan
Copy link
Contributor

We should skip unresolved LogicalPlans for PullOutNondeterministic, as calling output on unresolved LogicalPlan will produce confusing error message.

@cloud-fan
Copy link
Contributor Author

cc @marmbrus @rxin

@SparkQA
Copy link

SparkQA commented Aug 14, 2015

Test build #40880 has finished for PR 8203 at commit 7593080.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • implicit class StringToColumn(val sc: StringContext)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you please move this to AnalysisErrorSuite?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The UnresolvedAlias is only introduced when parsing SQL or DataFrame, so if we move this test into AnalysisErrorSuite, we need to add the UnresolvedAliases manually, is that OK?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or construct the plan by hand? Or we could maybe start a dataframe error
suite.
On Aug 14, 2015 8:26 PM, "Wenchen Fan" [email protected] wrote:

In sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
#8203 (comment):

  • sqlContext.dropTempTable("1one")
  • test("SPARK-9955: correct error message for aggregate") {
  • val e = intercept[AnalysisException] {
  •  sql("select key, max(value) from testData where bad_column > 1 group by key")
    

The UnresolvedAlias is only introduced when parsing SQL or DataFrame, so
if we move this test into AnalysisErrorSuite, we need to add the
UnresolvedAliases manually, is that OK?


Reply to this email directly or view it on GitHub
https://github.com/apache/spark/pull/8203/files#r37132757.

@SparkQA
Copy link

SparkQA commented Aug 15, 2015

Test build #40951 has finished for PR 8203 at commit 1c67ca7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@marmbrus
Copy link
Contributor

Thanks! Merging to master and branch-1.5

asfgit pushed a commit that referenced this pull request Aug 15, 2015
We should skip unresolved `LogicalPlan`s for `PullOutNondeterministic`, as calling `output` on unresolved `LogicalPlan` will produce confusing error message.

Author: Wenchen Fan <[email protected]>

Closes #8203 from cloud-fan/error-msg and squashes the following commits:

1c67ca7 [Wenchen Fan] move test
7593080 [Wenchen Fan] correct error message for aggregate

(cherry picked from commit 5705672)
Signed-off-by: Michael Armbrust <[email protected]>
@asfgit asfgit closed this in 5705672 Aug 15, 2015
CodingCat pushed a commit to CodingCat/spark that referenced this pull request Aug 17, 2015
We should skip unresolved `LogicalPlan`s for `PullOutNondeterministic`, as calling `output` on unresolved `LogicalPlan` will produce confusing error message.

Author: Wenchen Fan <[email protected]>

Closes apache#8203 from cloud-fan/error-msg and squashes the following commits:

1c67ca7 [Wenchen Fan] move test
7593080 [Wenchen Fan] correct error message for aggregate
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants