Skip to content

Conversation

@dcoliversun
Copy link
Contributor

What changes were proposed in this pull request?

This PR aims to supplement undocumented avro configurations in documentation.

Why are the changes needed?

Help users to confirm configuration through documentation instead of code.

Does this PR introduce any user-facing change?

Yes, more configurations in documentation

How was this patch tested?

Pass the GA

@github-actions github-actions bot added the DOCS label Oct 8, 2022
Copy link
Contributor Author

@dcoliversun dcoliversun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @HyukjinKwon @dongjoon-hyun
It would be good if you have a time to review this PR :)

<td>3.0.0</td>
</tr>
<tr>
<td>spark.sql.avro.filterPushdown.enabled</td>
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

val AVRO_FILTER_PUSHDOWN_ENABLED = buildConf("spark.sql.avro.filterPushdown.enabled")
.doc("When true, enable filter pushdown to Avro datasource.")
.version("3.1.0")
.booleanConf
.createWithDefault(true)

@srowen
Copy link
Member

srowen commented Oct 9, 2022

Merged to master

@srowen srowen closed this in 4b8f0e5 Oct 9, 2022
@dcoliversun dcoliversun deleted the SPARK-40709 branch October 10, 2022 01:25
@AmplabJenkins
Copy link

Can one of the admins verify this patch?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants