Skip to content

Conversation

@marmbrus
Copy link
Contributor

This is more uniform with the rest of SQL configuration and allows it to be turned on and off without restarting the SparkContext. In this PR I also turn off filter pushdown by default due to a number of outstanding issues (in particular SPARK-4258). When those are fixed we should turn it back on by default.

@SparkQA
Copy link

SparkQA commented Nov 14, 2014

Test build #23338 has started for PR 3258 at commit 75afd39.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 14, 2014

Test build #23338 has finished for PR 3258 at commit 75afd39.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23338/
Test FAILed.

@SparkQA
Copy link

SparkQA commented Nov 14, 2014

Test build #23340 has started for PR 3258 at commit 15e9a98.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 14, 2014

Test build #23340 has finished for PR 3258 at commit 15e9a98.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23340/
Test PASSed.

@SparkQA
Copy link

SparkQA commented Nov 14, 2014

Test build #23395 has started for PR 3258 at commit 5655bfe.

  • This patch merges cleanly.

asfgit pushed a commit that referenced this pull request Nov 14, 2014
This is more uniform with the rest of SQL configuration and allows it to be turned on and off without restarting the SparkContext.  In this PR I also turn off filter pushdown by default due to a number of outstanding issues (in particular SPARK-4258).  When those are fixed we should turn it back on by default.

Author: Michael Armbrust <[email protected]>

Closes #3258 from marmbrus/parquetFilters and squashes the following commits:

5655bfe [Michael Armbrust] Remove extra line.
15e9a98 [Michael Armbrust] Enable filters for tests
75afd39 [Michael Armbrust] Fix comments
78fa02d [Michael Armbrust] off by default
e7f9e16 [Michael Armbrust] First draft of correctly configuring parquet filter pushdown

(cherry picked from commit e47c387)
Signed-off-by: Michael Armbrust <[email protected]>
@asfgit asfgit closed this in e47c387 Nov 14, 2014
@SparkQA
Copy link

SparkQA commented Nov 15, 2014

Test build #23395 has finished for PR 3258 at commit 5655bfe.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23395/
Test PASSed.

@marmbrus marmbrus deleted the parquetFilters branch November 19, 2014 02:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants