Skip to content

[SPARK-32245][INFRA] Run Spark tests in Github Actions #29057

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
HyukjinKwon wants to merge 5 commits into from
Closed

[SPARK-32245][INFRA] Run Spark tests in Github Actions #29057

Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
561485a
Migrate PR builders from Jenkins to Github Actions
HyukjinKwon Jul 7, 2020
28bd0fc
Simply fallback for activate as well
HyukjinKwon Jul 10, 2020
f8ee706
Split SQL tests
HyukjinKwon Jul 11, 2020
94c10c0
Install test with '--user'
HyukjinKwon Jul 11, 2020
c3834b7
Add user-installed binary executables for testing purpose
HyukjinKwon Jul 11, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Add user-installed binary executables for testing purpose
  • Loading branch information
@HyukjinKwon
HyukjinKwon committed Jul 11, 2020
commit c3834b71918845a7fb8688bf9179c1e13798e17d
1 change: 1 addition & 0 deletions dev/run-pip-tests
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -114,6 +114,7 @@ for python in "${PYTHON_EXECS[@]}"; do
cd /

echo "Run basic sanity check on pip installed version with spark-submit"
export PATH="$(python3 -m site --user-base)/bin:$PATH"
spark-submit "$FWDIR"/dev/pip-sanity-check.py
echo "Run basic sanity check with import based"
python3 "$FWDIR"/dev/pip-sanity-check.py
Expand Down