[SPARK-8583] [SPARK-5482] [BUILD] Refactor python/run-tests to integrate with dev/run-tests module system#6967

Closed

JoshRosen wants to merge 28 commits intoapache:masterfrom

JoshRosen:run-tests-python-modules

Commits on Jun 24, 2015

First attempt at getting PySpark Kafka test to work in new runner script
JoshRosen
committed
Actually get the Kafka stuff to run properly
JoshRosen
committed
Two minor fixes
JoshRosen
committed
Fix the tests of dev/run-tests
JoshRosen
committed
Fixes to PySpark test module definitions
JoshRosen
committed
Add command-line options for running individual suites in python/run-tests
JoshRosen
committed
Update dev/run-tests to use new Python test runner flags
JoshRosen
committed
Add dev/sparktestsupport to pep8 checks
JoshRosen
committed
Fix lint check for Python 3
JoshRosen
committed

Commits on Jun 27, 2015

Fix universal_newlines for Python 3
JoshRosen
committed
Add python/run-tests.py to Python lint checks
JoshRosen
committed
Fix print for Python 2.x
JoshRosen
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SPARK-8583] [SPARK-5482] [BUILD] Refactor python/run-tests to integrate with dev/run-tests module system#6967

[SPARK-8583] [SPARK-5482] [BUILD] Refactor python/run-tests to integrate with dev/run-tests module system#6967
JoshRosen wants to merge 28 commits intoapache:masterfrom
JoshRosen:run-tests-python-modules

Commits on Jun 23, 2015

Move module definitions to separate file.

Move shell utility functions to own module.

Initial cut at Python test runner refactoring

Fix time division

PYTHONPATH fixes

Commits on Jun 24, 2015

First attempt at getting PySpark Kafka test to work in new runner script

Actually get the Kafka stuff to run properly

Two minor fixes

Fix the tests of dev/run-tests

Fixes to PySpark test module definitions

Add command-line options for running individual suites in python/run-tests

Update dev/run-tests to use new Python test runner flags

Add dev/sparktestsupport to pep8 checks

Fix lint check for Python 3

Commits on Jun 25, 2015

Use universal_newlines to fix dev/run-tests doctest failures on Python 3.

Python lint fixes.

Merge remote-tracking branch 'origin/master' into run-tests-python-modules

Fix passing of PYSPARK_PYTHON

Commits on Jun 26, 2015

Remove python2 flag, since the test runner script also works fine under Python 3

Fall back to PYSPARK_PYTHON when sys.executable is None (fixes a test)

Fix hashbang

Use which() to convert PYSPARK_PYTHON to an absolute path before shelling out to run tests

Skip MLLib tests for PyPy

Python 3 fix

Fix handling of module in python/run-tests

Commits on Jun 27, 2015

Fix universal_newlines for Python 3

Add python/run-tests.py to Python lint checks

Fix print for Python 2.x

[SPARK-8583] [SPARK-5482] [BUILD] Refactor python/run-tests to integrate with dev/run-tests module system#6967JoshRosen wants to merge 28 commits intoapache:masterapache/spark:masterfrom JoshRosen:run-tests-python-modulesJoshRosen/spark:run-tests-python-modulesCopy head branch name to clipboard

Commits

Commits on Jun 23, 2015

Commits on Jun 24, 2015

Commits on Jun 25, 2015

Commits on Jun 26, 2015

Commits on Jun 27, 2015

[SPARK-8583] [SPARK-5482] [BUILD] Refactor python/run-tests to integrate with dev/run-tests module system#6967
JoshRosen wants to merge 28 commits intoapache:masterfrom
JoshRosen:run-tests-python-modules