Skip to content

Conversation

@amaliujia
Copy link
Contributor

@amaliujia amaliujia commented Oct 14, 2022

What changes were proposed in this pull request?

This PR syncs python generated proto files. The proto changes in this file is generated by https://github.com/apache/spark/blob/master/connector/connect/dev/generate_protos.sh.

Why are the changes needed?

Python client side proto files are out of sync. Other python related PRs needs to re-generate proto files which has caused troubles on code review.

We are looking for ways to automatically keep the python proto files in sync. Before that is done, we need to manually update the proto files.

Does this PR introduce any user-facing change?

No

How was this patch tested?

UT

@amaliujia
Copy link
Contributor Author

R: @zhengruifeng

Copy link
Contributor

@zhengruifeng zhengruifeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM pending CI

) -> proto.Aggregate.AggregateFunction:
exp, fun = m
measure = proto.Aggregate.Measure()
measure = proto.Aggregate.AggregateFunction()
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the only code change that is caused by the proto change. We are lacking of aggregate testing coverage thus there is no tests affected. I will follow up on the testing coverage but that is a different problem.

cc @zhengruifeng

@amaliujia amaliujia changed the title [SPARK-39375][CONNECT][FOLLOWUP] Sync python generated proto files [SPARK-40557][CONNECT][FOLLOWUP] Sync python generated proto files Oct 14, 2022
@HyukjinKwon HyukjinKwon changed the title [SPARK-40557][CONNECT][FOLLOWUP] Sync python generated proto files [SPARK-40557][CONNECT][FOLLOW-UP] Sync python generated proto files Oct 14, 2022
@zhengruifeng
Copy link
Contributor

Merged into master

@amaliujia amaliujia deleted the sync_python_proto branch October 14, 2022 04:05
SandishKumarHN pushed a commit to SandishKumarHN/spark that referenced this pull request Dec 12, 2022
### What changes were proposed in this pull request?

This PR syncs python generated proto files. The proto changes in this file is generated by https://github.com/apache/spark/blob/master/connector/connect/dev/generate_protos.sh.

### Why are the changes needed?

Python client side proto files are out of sync. Other python related PRs needs to re-generate proto files which has caused troubles on code review.

We are looking for ways to automatically keep the python proto files in sync. Before that is done, we need to manually update the proto files.

### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

UT

Closes apache#38244 from amaliujia/sync_python_proto.

Authored-by: Rui Wang <[email protected]>
Signed-off-by: Ruifeng Zheng <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants