Skip to content

[SPARK-48054][PYTHON][CONNECT][INFRA] Backward compatibility test for Spark Connect #46298

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
HyukjinKwon wants to merge 12 commits into from
Closed

[SPARK-48054][PYTHON][CONNECT][INFRA] Backward compatibility test for Spark Connect #46298

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
ca6b53f
CI change to revert
HyukjinKwon Apr 30, 2024
6e6b14e
Run tests
HyukjinKwon Apr 30, 2024
19a21b3
try
HyukjinKwon Apr 30, 2024
69b6949
fixup
HyukjinKwon Apr 30, 2024
5ac2fde
fixup
HyukjinKwon Apr 30, 2024
946cc00
run basic set of tests first
HyukjinKwon Apr 30, 2024
3db8eae
fixup
HyukjinKwon Apr 30, 2024
b00b659
fixup
HyukjinKwon Apr 30, 2024
ea4e61c
fixup
HyukjinKwon May 1, 2024
377f7ab
fixup
HyukjinKwon May 1, 2024
1829bd0
fixup
HyukjinKwon May 1, 2024
fc76f17
revert
HyukjinKwon May 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
revert
  • Loading branch information
@HyukjinKwon
HyukjinKwon committed May 3, 2024
commit fc76f171526501a4e27a036f1214570d93977bdc
2 changes: 1 addition & 1 deletion .github/workflows/build_main.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ name: "Build"
on:
push:
branches:
- 'nonexistent'
- '**'

jobs:
call-build-and-test:
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/build_python_connect35.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,16 +20,16 @@
name: Build / Spark Connect Python-only (master-server, 35-client, Python 3.11)

on:
push:
branches:
- '**'
schedule:
- cron: '0 21 * * *'
Copy link
Member

@dongjoon-hyun dongjoon-hyun May 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you. Ya, +1 for adding this and this looks not a heavy.

After adding this, please monitor once if it works expected in the total budget.

Copy link
Member Author

@HyukjinKwon HyukjinKwon May 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the pointer!


jobs:
# Build: build Spark and run the tests for specified modules using SBT
build:
name: "Build modules: pyspark-connect"
runs-on: ubuntu-latest
timeout-minutes: 100
if: github.repository == 'apache/spark'
steps:
- name: Checkout Spark repository
uses: actions/checkout@v4
Expand Down