Skip to content

[SPARK-47081][CONNECT] Support Query Execution Progress #45150

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
grundprinzip wants to merge 30 commits into from
Closed

[SPARK-47081][CONNECT] Support Query Execution Progress #45150

Changes from 1 commit
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
084d257
Initial draft
grundprinzip Feb 13, 2024
234b927
update
grundprinzip Feb 17, 2024
f78519e
update
grundprinzip Feb 18, 2024
962dfd4
fix race condition
grundprinzip Feb 18, 2024
4947e79
fix lint
grundprinzip Feb 18, 2024
228717f
lint
grundprinzip Feb 19, 2024
36d7924
lint
grundprinzip Feb 19, 2024
dfb29e4
fix
grundprinzip Feb 21, 2024
be08f53
more progress stuff
grundprinzip Mar 20, 2024
be7c445
Merge remote-tracking branch 'origin/master' into HEAD
grundprinzip Mar 20, 2024
1b1a61a
fix
grundprinzip Mar 22, 2024
aa924c0
fix
grundprinzip Mar 22, 2024
7cedd98
doc
grundprinzip Mar 22, 2024
e2063f2
fixing tests
grundprinzip Mar 23, 2024
84425c3
fixing lint
grundprinzip Mar 25, 2024
50e4cbd
fixing lint
grundprinzip Mar 27, 2024
677e70b
refactoring to expose stage information
grundprinzip Mar 28, 2024
71033d0
fix
grundprinzip Mar 28, 2024
5687f6c
fix
grundprinzip Mar 29, 2024
2d75941
fix tests and lint
grundprinzip Mar 30, 2024
30560d0
Merge remote-tracking branch 'origin/master' into HEAD
grundprinzip Mar 30, 2024
453bda9
lint
grundprinzip Mar 30, 2024
cc864c9
lint
grundprinzip Mar 30, 2024
ad4791e
review comments
grundprinzip Apr 1, 2024
b662410
lint
grundprinzip Apr 1, 2024
85caee5
merge
grundprinzip Apr 2, 2024
ac91982
doc update
grundprinzip Apr 2, 2024
deffbbc
doc update
grundprinzip Apr 2, 2024
415bdd8
doc update
grundprinzip Apr 2, 2024
6fcc36f
fix lint
grundprinzip Apr 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix
  • Loading branch information
@grundprinzip
grundprinzip committed Mar 29, 2024
commit 5687f6ce8e718987657b36de8a45a2c004f76ec2
4 changes: 3 additions & 1 deletion python/pyspark/sql/connect/shell/progress.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,9 @@ def __call__(
pass


def from_proto(proto: ExecutePlanResponse) -> typing.Tuple[Iterable[StageInfo], int]:
def from_proto(
proto: ExecutePlanResponse.ExecutionProgress,
) -> typing.Tuple[Iterable[StageInfo], int]:
result = []
for stage in proto.stages:
result.append(
Expand Down