Skip to content
Closed
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
2f6c80d
Merge remote-tracking branch 'upstream/master' into outerJoinElimination
gatorsmile Dec 31, 2015
90576aa
outer join conversion
gatorsmile Jan 1, 2016
5adec63
[SPARK-10359][PROJECT-INFRA] Multiple fixes to dev/test-dependencies.…
JoshRosen Jan 1, 2016
192ab19
added test cases.
gatorsmile Jan 1, 2016
c9dbfcc
[SPARK-11743][SQL] Move the test for arrayOfUDT
viirya Jan 1, 2016
a59a357
[SPARK-3873][MLLIB] Import order fixes.
Jan 1, 2016
ad5b7cf
[SPARK-12409][SPARK-12387][SPARK-12391][SQL] Refactor filter pushdown…
viirya Jan 1, 2016
c04b53b
renaming
gatorsmile Jan 1, 2016
01a2986
[SPARK-12592][SQL][TEST] Don't mute Spark loggers in TestHive.reset()
liancheng Jan 1, 2016
6c20b3c
Disable test-dependencies.sh.
rxin Jan 1, 2016
0da7bd5
[SPARK-12286][SPARK-12290][SPARK-12294][SPARK-12284][SQL] always outp…
Jan 1, 2016
44ee920
Revert "[SPARK-12286][SPARK-12290][SPARK-12294][SPARK-12284][SQL] alw…
rxin Jan 2, 2016
970635a
[SPARK-12362][SQL][WIP] Inline Hive Parser
hvanhovell Jan 2, 2016
94f7a12
[SPARK-10180][SQL] JDBC datasource are not processing EqualNullSafe f…
HyukjinKwon Jan 2, 2016
15bd736
[SPARK-12481][CORE][STREAMING][SQL] Remove usage of Hadoop deprecated…
srowen Jan 2, 2016
65f9125
extend the condition to cover more cases in non null predicates.
gatorsmile Jan 3, 2016
513e3b0
[SPARK-12599][MLLIB][SQL] Remove the use of callUDF in MLlib
rxin Jan 3, 2016
6c5bbd6
Revert "Revert "[SPARK-12286][SPARK-12290][SPARK-12294][SPARK-12284][…
rxin Jan 3, 2016
9398644
added three more expressions: and, or and not
gatorsmile Jan 3, 2016
0bb07cb
style fix.
gatorsmile Jan 3, 2016
c5ff632
support non-local predicates and bug fix.
gatorsmile Jan 3, 2016
c3d5056
[SPARK-12327][SPARKR] fix code for lintr warning for commented code
felixcheung Jan 3, 2016
ee29dd2
scala style fix.
gatorsmile Jan 3, 2016
c82924d
[SPARK-12533][SQL] hiveContext.table() throws the wrong exception
thomastechs Jan 3, 2016
7b92922
Update MimaExcludes now Spark 1.6 is in Maven.
rxin Jan 4, 2016
b8410ff
[SPARK-12537][SQL] Add option to accept quoting of all character back…
Cazen Jan 4, 2016
13dab9c
[SPARK-12611][SQL][PYSPARK][TESTS] Fix test_infer_schema_to_local
holdenk Jan 4, 2016
7b7ea90
outer join conversion
gatorsmile Jan 1, 2016
7558e70
added test cases.
gatorsmile Jan 1, 2016
d3cbf46
renaming
gatorsmile Jan 1, 2016
2535cb1
extend the condition to cover more cases in non null predicates.
gatorsmile Jan 3, 2016
6c3f4b0
added three more expressions: and, or and not
gatorsmile Jan 3, 2016
fcd757c
style fix.
gatorsmile Jan 3, 2016
5bc7f52
support non-local predicates and bug fix.
gatorsmile Jan 3, 2016
34a0056
scala style fix.
gatorsmile Jan 3, 2016
ee7db1a
code refactoring and code merge
gatorsmile Jan 4, 2016
63d5d62
Merge remote-tracking branch 'origin/outerJoinConversion' into outerJ…
gatorsmile Jan 4, 2016
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[SPARK-10359][PROJECT-INFRA] Multiple fixes to dev/test-dependencies.…
…sh script

This patch includes multiple fixes for the `dev/test-dependencies.sh` script (which was introduced in #10461):

- Use `build/mvn --force` instead of `mvn` in one additional place.
- Explicitly set a zero exit code on success.
- Set `LC_ALL=C` to make `sort` results agree across machines (see https://stackoverflow.com/questions/28881/).
- Set `should_run_build_tests=True` for `build` module (this somehow got lost).

Author: Josh Rosen <[email protected]>

Closes #10543 from JoshRosen/dep-script-fixes.
  • Loading branch information
JoshRosen committed Jan 1, 2016
commit 5adec63a922d6f60cd6cb87ebdab61a17131ac1a
3 changes: 2 additions & 1 deletion dev/sparktestsupport/modules.py
Original file line number Diff line number Diff line change
Expand Up @@ -402,7 +402,8 @@ def contains_file(self, filename):
source_file_regexes=[
".*pom.xml",
"dev/test-dependencies.sh",
]
],
should_run_build_tests=True
)

ec2 = Module(
Expand Down
8 changes: 7 additions & 1 deletion dev/test-dependencies.sh
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,10 @@ set -e
FWDIR="$(cd "`dirname $0`"/..; pwd)"
cd "$FWDIR"

# Explicitly set locale in order to make `sort` output consistent across machines.
# See https://stackoverflow.com/questions/28881 for more details.
export LC_ALL=C

# TODO: This would be much nicer to do in SBT, once SBT supports Maven-style resolution.

# NOTE: These should match those in the release publishing script
Expand All @@ -37,7 +41,7 @@ HADOOP_PROFILES=(
# resolve Spark's internal submodule dependencies.

# See http://stackoverflow.com/a/3545363 for an explanation of this one-liner:
OLD_VERSION=$(mvn help:evaluate -Dexpression=project.version|grep -Ev '(^\[|Download\w+:)')
OLD_VERSION=$($MVN help:evaluate -Dexpression=project.version|grep -Ev '(^\[|Download\w+:)')
TEMP_VERSION="spark-$(date +%s | tail -c6)"

function reset_version {
Expand Down Expand Up @@ -100,3 +104,5 @@ for HADOOP_PROFILE in "${HADOOP_PROFILES[@]}"; do
exit 1
fi
done

exit 0