Skip to content

Conversation

@wangyum
Copy link
Member

@wangyum wangyum commented Aug 19, 2017

What changes were proposed in this pull request?

SPARK-17701 removed metadata function, this PR removed the Docker-based Integration module that has been relevant to SparkPlan.metadata.

How was this patch tested?

manual tests

@SparkQA
Copy link

SparkQA commented Aug 19, 2017

Test build #80872 has finished for PR 19000 at commit 6f92ccb.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@gatorsmile gatorsmile left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just ran the docker test in my local environment. It works well.

@gatorsmile
Copy link
Member

LGTM

@gatorsmile
Copy link
Member

Thanks! Merging to master.

@asfgit asfgit closed this in 72b738d Aug 19, 2017
// The "PushedFilters" part should be exist in Datafrome's
// physical plan and the existence of right literals in
// "PushedFilters" is used to prove that the predicates
// pushing down have been effective.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since you removed the checking for the filter pushdown verification, please add them back in the follow-up PR. Thanks!

Example is https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala#L262-L271

asfgit pushed a commit that referenced this pull request Aug 21, 2017
## What changes were proposed in this pull request?

The previous PR(#19000) removed filter pushdown verification, This PR add them back.

## How was this patch tested?
manual tests

Author: Yuming Wang <[email protected]>

Closes #19002 from wangyum/SPARK-21790-follow-up.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants