Skip to content
Merged
Changes from 1 commit
Commits
Show all changes
170 commits
Select commit Hold shift + click to select a range
2b8d89e
[SPARK-2523] [SQL] Hadoop table scan bug fixing
chenghao-intel Jul 28, 2014
255b56f
[SPARK-2479][MLlib] Comparing floating-point numbers using relative e…
Jul 28, 2014
a7a9d14
[SPARK-2410][SQL] Merging Hive Thrift/JDBC server (with Maven profile…
liancheng Jul 28, 2014
39ab87b
Use commons-lang3 in SignalLogger rather than commons-lang
aarondav Jul 28, 2014
16ef4d1
Excess judgment
watermen Jul 29, 2014
ccd5ab5
[SPARK-2580] [PySpark] keep silent in worker if JVM close the socket
davies Jul 29, 2014
92ef026
[SPARK-791] [PySpark] fix pickle itemgetter with cloudpickle
davies Jul 29, 2014
96ba04b
[SPARK-2726] and [SPARK-2727] Remove SortOrder and do in-place sort.
rxin Jul 29, 2014
20424da
[SPARK-2174][MLLIB] treeReduce and treeAggregate
mengxr Jul 29, 2014
fc4d057
Minor indentation and comment typo fixes.
staple Jul 29, 2014
800ecff
[STREAMING] SPARK-1729. Make Flume pull data from source, rather than…
harishreedharan Jul 29, 2014
0c5c6a6
[SQL]change some test lists
adrian-wang Jul 29, 2014
e364348
[SPARK-2730][SQL] When retrieving a value from a Map, GetItem evaluat…
yhuai Jul 29, 2014
f0d880e
[SPARK-2674] [SQL] [PySpark] support datetime type for SchemaRDD
davies Jul 29, 2014
dc96536
[SPARK-2082] stratified sampling in PairRDDFunctions that guarantees …
dorx Jul 29, 2014
c7db274
[SPARK-2393][SQL] Cost estimation optimization framework for Catalyst…
concretevitamin Jul 29, 2014
2c35666
MAINTENANCE: Automated closing of pull requests.
pwendell Jul 30, 2014
39b8193
[SPARK-2716][SQL] Don't check resolved for having filters.
marmbrus Jul 30, 2014
86534d0
[SPARK-2631][SQL] Use SQLConf to configure in-memory columnar caching
marmbrus Jul 30, 2014
22649b6
[SPARK-2305] [PySpark] Update Py4J to version 0.8.2.1
JoshRosen Jul 30, 2014
8446746
[SPARK-2054][SQL] Code Generation for Expression Evaluation
marmbrus Jul 30, 2014
2e6efca
[SPARK-2568] RangePartitioner should run only one job if data is bala…
mengxr Jul 30, 2014
077f633
[SQL] Handle null values in debug()
marmbrus Jul 30, 2014
4ce92cc
[SPARK-2260] Fix standalone-cluster mode, which was broken
andrewor14 Jul 30, 2014
7003c16
[SPARK-2179][SQL] Public API for DataTypes and Schema
yhuai Jul 30, 2014
7c5fc28
SPARK-2543: Allow user to set maximum Kryo buffer size
koertkuipers Jul 30, 2014
ee07541
SPARK-2748 [MLLIB] [GRAPHX] Loss of precision for small arguments to …
srowen Jul 30, 2014
774142f
[SPARK-2521] Broadcast RDD object (instead of sending it along with e…
rxin Jul 30, 2014
3bc3f18
[SPARK-2747] git diff --dirstat can miss sql changes and not run Hive…
rxin Jul 30, 2014
e3d85b7
Avoid numerical instability
naftaliharris Jul 30, 2014
fc47bb6
[SPARK-2544][MLLIB] Improve ALS algorithm resource usage
witgo Jul 30, 2014
ff511ba
[SPARK-2746] Set SBT_MAVEN_PROFILES only when it is not set explicitl…
rxin Jul 30, 2014
f2eb84f
Wrap FWDIR in quotes.
rxin Jul 30, 2014
95cf203
Wrap FWDIR in quotes in dev/check-license.
rxin Jul 30, 2014
0feb349
More wrapping FWDIR in quotes.
rxin Jul 30, 2014
2248891
[SQL] Fix compiling of catalyst docs.
marmbrus Jul 30, 2014
437dc8c
dev/check-license wrap folders in quotes.
rxin Jul 30, 2014
94d1f46
[SPARK-2024] Add saveAsSequenceFile to PySpark
kanzhang Jul 30, 2014
7c7ce54
Wrap JAR_DL in dev/check-license.
rxin Jul 30, 2014
1097327
Set AMPLAB_JENKINS_BUILD_PROFILE.
rxin Jul 30, 2014
2f4b170
Properly pass SBT_MAVEN_PROFILES into sbt.
rxin Jul 30, 2014
6ab96a6
SPARK-2749 [BUILD]. Spark SQL Java tests aren't compiling in Jenkins'…
srowen Jul 30, 2014
2ac37db
SPARK-2741 - Publish version of spark assembly which does not contain…
Jul 31, 2014
88a519d
[SPARK-2734][SQL] Remove tables from cache when DROP TABLE is run.
marmbrus Jul 31, 2014
e9b275b
SPARK-2341 [MLLIB] loadLibSVMFile doesn't handle regression datasets
srowen Jul 31, 2014
da50176
Update DecisionTreeRunner.scala
strat0sphere Jul 31, 2014
e966284
SPARK-2045 Sort-based shuffle
mateiz Jul 31, 2014
894d48f
[SPARK-2758] UnionRDD's UnionPartition should not reference parent RDDs
rxin Jul 31, 2014
118c1c4
Required AM memory is "amMem", not "args.amMemory"
maji2014 Jul 31, 2014
a7c305b
[SPARK-2340] Resolve event logging and History Server paths properly
andrewor14 Jul 31, 2014
4fb2593
[SPARK-2737] Add retag() method for changing RDDs' ClassTags.
JoshRosen Jul 31, 2014
5a110da
[SPARK-2497] Included checks for module symbols too.
ScrapCodes Jul 31, 2014
669e3f0
automatically set master according to `spark.master` in `spark-defaul…
CrazyJvm Jul 31, 2014
92ca910
[SPARK-2762] SparkILoop leaks memory in multi-repl configurations
thunterdb Jul 31, 2014
3072b96
[SPARK-2743][SQL] Resolve original attributes in ParquetTableScan
marmbrus Jul 31, 2014
72cfb13
[SPARK-2397][SQL] Deprecate LocalHiveContext
marmbrus Jul 31, 2014
f193312
SPARK-2028: Expose mapPartitionsWithInputSplit in HadoopRDD
aarondav Jul 31, 2014
f68105d
SPARK-2664. Deal with `--conf` options in spark-submit that relate to…
sryza Jul 31, 2014
4dbabb3
SPARK-2749 [BUILD] Part 2. Fix a follow-on scalastyle error
srowen Jul 31, 2014
e5749a1
SPARK-2646. log4j initialization not quite compatible with log4j 2.x
srowen Jul 31, 2014
dc0865b
[SPARK-2511][MLLIB] add HashingTF and IDF
mengxr Jul 31, 2014
49b3612
[SPARK-2523] [SQL] Hadoop table scan bug fixing (fix failing Jenkins …
yhuai Jul 31, 2014
e021362
Improvements to merge_spark_pr.py
JoshRosen Jul 31, 2014
cc82050
Docs: monitoring, streaming programming guide
kennyballou Jul 31, 2014
492a195
SPARK-2740: allow user to specify ascending and numPartitions for sor…
Jul 31, 2014
ef4ff00
SPARK-2282: Reuse Socket for sending accumulator updates to Pyspark
aarondav Jul 31, 2014
8f51491
[SPARK-2531 & SPARK-2436] [SQL] Optimize the BuildSide when planning …
concretevitamin Aug 1, 2014
d843014
[SPARK-2724] Python version of RandomRDDGenerators
dorx Aug 1, 2014
b124de5
[SPARK-2756] [mllib] Decision tree bug fixes
jkbradley Aug 1, 2014
9632719
[SPARK-2779] [SQL] asInstanceOf[Map[...]] should use scala.collection…
yhuai Aug 1, 2014
9998efa
SPARK-2766: ScalaReflectionSuite throw an llegalArgumentException i…
witgo Aug 1, 2014
b190083
[SPARK-2777][MLLIB] change ALS factors storage level to MEMORY_AND_DISK
mengxr Aug 1, 2014
c475540
[SPARK-2782][mllib] Bug fix for getRanks in SpearmanCorrelation
dorx Aug 1, 2014
2cdc3e5
[SPARK-2702][Core] Upgrade Tachyon dependency to 0.5.0
haoyuan Aug 1, 2014
1499101
SPARK-2632, SPARK-2576. Fixed by only importing what is necessary dur…
ScrapCodes Aug 1, 2014
cb9e7d5
SPARK-2738. Remove redundant imports in BlockManagerSuite
sryza Aug 1, 2014
8ff4417
[SPARK-2670] FetchFailedException should be thrown when local fetch h…
sarutak Aug 1, 2014
72e3369
SPARK-983. Support external sorting in sortByKey()
mateiz Aug 1, 2014
f1957e1
SPARK-2134: Report metrics before application finishes
Aug 1, 2014
284771e
[Spark 2557] fix LOCAL_N_REGEX in createTaskScheduler and make local-…
advancedxy Aug 1, 2014
a32f0fb
[SPARK-2103][Streaming] Change to ClassTag for KafkaInputDStream and …
jerryshao Aug 1, 2014
82d209d
SPARK-2768 [MLLIB] Add product, user recommend method to MatrixFactor…
srowen Aug 1, 2014
0dacb1a
[SPARK-1997] update breeze to version 0.8.1
witgo Aug 1, 2014
5328c0a
[HOTFIX] downgrade breeze version to 0.7
mengxr Aug 1, 2014
8d338f6
SPARK-2099. Report progress while task is running.
sryza Aug 1, 2014
c41fdf0
[SPARK-2179][SQL] A minor refactoring Java data type APIs (2179 follo…
yhuai Aug 1, 2014
4415722
[SQL][SPARK-2212]Hash Outer Join
chenghao-intel Aug 1, 2014
580c701
[SPARK-2729] [SQL] Forgot to match Timestamp type in ColumnBuilder
chutium Aug 1, 2014
c0b47ba
[SPARK-2767] [SQL] SparkSQL CLI doens't output error message if query…
chenghao-intel Aug 1, 2014
c82fe47
[SQL] Documentation: Explain cacheTable command
CrazyJvm Aug 1, 2014
eb5bdca
[SPARK-695] In DAGScheduler's getPreferredLocs, track set of visited …
staple Aug 1, 2014
baf9ce1
[SPARK-2490] Change recursive visiting on RDD dependencies to iterati…
viirya Aug 1, 2014
f5d9bea
SPARK-1612: Fix potential resource leaks
zsxwing Aug 1, 2014
b270309
[SPARK-2379] Fix the bug that streaming's receiver may fall into a de…
joyyoj Aug 1, 2014
78f2af5
SPARK-2791: Fix committing, reverting and state tracking in shuffle f…
aarondav Aug 1, 2014
d88e695
[SPARK-2786][mllib] Python correlations
dorx Aug 1, 2014
7058a53
[SPARK-2796] [mllib] DecisionTree bug fix: ordered categorical features
jkbradley Aug 1, 2014
880eabe
[SPARK-2010] [PySpark] [SQL] support nested structure in SchemaRDD
davies Aug 2, 2014
3822f33
[SPARK-2212][SQL] Hash Outer Join (follow-up bug fix).
yhuai Aug 2, 2014
0da07da
[SPARK-2116] Load spark-defaults.conf from SPARK_CONF_DIR if set
chu11 Aug 2, 2014
a38d3c9
[SPARK-2800]: Exclude scalastyle-output.xml Apache RAT checks
witgo Aug 2, 2014
e8e0fd6
[SPARK-2764] Simplify daemon.py process structure
JoshRosen Aug 2, 2014
f6a1899
Streaming mllib [SPARK-2438][MLLIB]
freeman-lab Aug 2, 2014
c281189
[SPARK-2550][MLLIB][APACHE SPARK] Support regularization and intercep…
miccagiann Aug 2, 2014
e25ec06
[SPARK-1580][MLLIB] Estimate ALS communication and computation costs.
tmyklebu Aug 2, 2014
fda4759
[SPARK-2801][MLlib]: DistributionGenerator renamed to RandomDataGener…
brkyvz Aug 2, 2014
4bc3bb2
StatCounter on NumPy arrays [PYSPARK][SPARK-2012]
freeman-lab Aug 2, 2014
adc8303
[SPARK-1470][SPARK-1842] Use the scala-logging wrapper instead of the…
witgo Aug 2, 2014
dab3796
Revert "[SPARK-1470][SPARK-1842] Use the scala-logging wrapper instea…
pwendell Aug 2, 2014
d934801
[SPARK-2316] Avoid O(blocks) operations in listeners
andrewor14 Aug 2, 2014
148af60
[SPARK-2454] Do not ship spark home to Workers
andrewor14 Aug 2, 2014
08c095b
[SPARK-1812] sql/catalyst - Provide explicit type information
avati Aug 2, 2014
25cad6a
HOTFIX: Fixing test error in maven for flume-sink.
pwendell Aug 2, 2014
44460ba
HOTFIX: Fix concurrency issue in FlumePollingStreamSuite.
pwendell Aug 2, 2014
87738bf
MAINTENANCE: Automated closing of pull requests.
pwendell Aug 2, 2014
e09e18b
[HOTFIX] Do not throw NPE if spark.test.home is not set
andrewor14 Aug 2, 2014
3f67382
[SPARK-2478] [mllib] DecisionTree Python API
jkbradley Aug 2, 2014
67bd8e3
[SQL] Set outputPartitioning of BroadcastHashJoin correctly.
yhuai Aug 2, 2014
91f9504
[SPARK-1981] Add AWS Kinesis streaming support
cfregly Aug 2, 2014
4c47711
SPARK-2804: Remove scalalogging-slf4j dependency
witgo Aug 2, 2014
158ad0b
[SPARK-2097][SQL] UDF Support
marmbrus Aug 2, 2014
198df11
[SPARK-2785][SQL] Remove assertions that throw when users try unsuppo…
marmbrus Aug 2, 2014
866cf1f
[SPARK-2729][SQL] Added test case for SPARK-2729
liancheng Aug 3, 2014
d210022
[SPARK-2797] [SQL] SchemaRDDs don't support unpersist()
yhuai Aug 3, 2014
1a80437
[SPARK-2739][SQL] Rename registerAsTable to registerTempTable
marmbrus Aug 3, 2014
33f167d
SPARK-2602 [BUILD] Tests steal focus under Java 6
srowen Aug 3, 2014
9cf429a
SPARK-2414 [BUILD] Add LICENSE entry for jquery
srowen Aug 3, 2014
3dc55fd
[Minor] Fixes on top of #1679
andrewor14 Aug 3, 2014
f8cd143
SPARK-2712 - Add a small note to maven doc that mvn package must happ…
javadba Aug 3, 2014
a0bcbc1
SPARK-2246: Add user-data option to EC2 scripts
Aug 3, 2014
2998e38
[SPARK-2197] [mllib] Java DecisionTree bug fix and easy-of-use
jkbradley Aug 3, 2014
236dfac
[SPARK-2784][SQL] Deprecate hql() method in favor of a config option,…
marmbrus Aug 3, 2014
ac33cbb
[SPARK-2814][SQL] HiveThriftServer2 throws NPE when executing native …
liancheng Aug 3, 2014
e139e2b
[SPARK-2783][SQL] Basic support for analyze in HiveContext
yhuai Aug 3, 2014
55349f9
[SPARK-1740] [PySpark] kill the python worker
davies Aug 3, 2014
6ba6c3e
[SPARK-2810] upgrade to scala-maven-plugin 3.2.0
avati Aug 4, 2014
5507dd8
Fix some bugs with spaces in directory name.
sarahgerweck Aug 4, 2014
ae58aea
SPARK-2272 [MLlib] Feature scaling which standardizes the range of in…
Aug 4, 2014
e053c55
[MLlib] [SPARK-2510]Word2Vec: Distributed Representation of Words
Aug 4, 2014
59f84a9
[SPARK-1687] [PySpark] pickable namedtuple
davies Aug 4, 2014
8e7d5ba
SPARK-2792. Fix reading too much or too little data from each stream …
mateiz Aug 4, 2014
9fd82db
[SPARK-1687] [PySpark] fix unit tests related to pickable namedtuple
davies Aug 4, 2014
05bf4e4
[SPARK-2323] Exception in accumulator update should not crash DAGSche…
rxin Aug 5, 2014
066765d
SPARK-2685. Update ExternalAppendOnlyMap to avoid buffer.remove()
mateiz Aug 5, 2014
4fde28c
SPARK-2711. Create a ShuffleMemoryManager to track memory for all spi…
mateiz Aug 5, 2014
a646a36
[SPARK-2857] Correct properties to set Master / Worker ports
andrewor14 Aug 5, 2014
9862c61
[SPARK-1779] Throw an exception if memory fractions are not between 0…
Aug 5, 2014
184048f
[SPARK-2856] Decrease initial buffer size for Kryo to 64KB.
rxin Aug 5, 2014
e87075d
[SPARK-1022][Streaming] Add Kafka real unit test
jerryshao Aug 5, 2014
2c0f705
SPARK-1528 - spark on yarn, add support for accessing remote HDFS
tgravescs Aug 5, 2014
1c5555a
SPARK-1890 and SPARK-1891- add admin and modify acls
tgravescs Aug 5, 2014
6e821e3
[SPARK-2860][SQL] Fix coercion of CASE WHEN.
marmbrus Aug 5, 2014
ac3440f
[SPARK-2859] Update url of Kryo project in related docs
gchen Aug 5, 2014
74f82c7
SPARK-2380: Support displaying accumulator values in the web UI
pwendell Aug 5, 2014
41e0a21
SPARK-1680: use configs for specifying environment variables on YARN
tgravescs Aug 5, 2014
cc491f6
[SPARK-2864][MLLIB] fix random seed in word2vec; move model to local
mengxr Aug 5, 2014
acff9a7
[SPARK-2503] Lower shuffle output buffer (spark.shuffle.file.buffer.k…
rxin Aug 5, 2014
1aad911
[SPARK-2550][MLLIB][APACHE SPARK] Support regularization and intercep…
miccagiann Aug 5, 2014
2643e66
SPARK-2869 - Fix tiny bug in JdbcRdd for closing jdbc connection
Aug 6, 2014
d94f599
[sql] rename project name in pom.xml of hive-thriftserver module
scwf Aug 6, 2014
d0ae3f3
[SPARK-2650][SQL] Try to partially fix SPARK-2650 by adjusting initia…
liancheng Aug 6, 2014
69ec678
[SPARK-2854][SQL] Finalize _acceptable_types in pyspark.sql
yhuai Aug 6, 2014
1d70c4f
[SPARK-2866][SQL] Support attributes in ORDER BY that aren't in SELECT
marmbrus Aug 6, 2014
82624e2
[SPARK-2806] core - upgrade to json4s-jackson 3.2.10
avati Aug 6, 2014
b70bae4
[SQL] Tighten the visibility of various SQLConf methods and renamed s…
rxin Aug 6, 2014
5a826c0
[SQL] Fix logging warn -> debug
marmbrus Aug 6, 2014
63bdb1f
SPARK-2294: fix locality inversion bug in TaskManager
CodingCat Aug 6, 2014
c7b5201
[MLlib] Use this.type as return type in k-means' builder pattern
Aug 6, 2014
ee7f308
[SPARK-1022][Streaming][HOTFIX] Fixed zookeeper dependency of Kafka
tdas Aug 6, 2014
09f7e45
[SPARK-2157] Enable tight firewall rules for Spark
andrewor14 Aug 6, 2014
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[SQL]change some test lists
1. there's no `hook_context.q` but a `hook_context_cs.q` in query folder
2. there's no `compute_stats_table.q` in query folder
3. there's no `having1.q` in query folder
4. `udf_E` and `udf_PI` appear twice in white list

Author: Daoyuan <[email protected]>

Closes apache#1634 from adrian-wang/testcases and squashes the following commits:

d7482ce [Daoyuan] change some test lists
  • Loading branch information
adrian-wang authored and marmbrus committed Jul 29, 2014
commit 0c5c6a63d19bed2a813a09309c46971ecdd173f0
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
override def blackList = Seq(
// These tests use hooks that are not on the classpath and thus break all subsequent execution.
"hook_order",
"hook_context",
"hook_context_cs",
"mapjoin_hook",
"multi_sahooks",
"overridden_confs",
Expand Down Expand Up @@ -289,7 +289,6 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
"compute_stats_empty_table",
"compute_stats_long",
"compute_stats_string",
"compute_stats_table",
"convert_enum_to_string",
"correlationoptimizer1",
"correlationoptimizer10",
Expand Down Expand Up @@ -395,7 +394,6 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
"groupby_sort_9",
"groupby_sort_test_1",
"having",
"having1",
"implicit_cast1",
"innerjoin",
"inoutdriver",
Expand Down Expand Up @@ -697,8 +695,6 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
"udf7",
"udf8",
"udf9",
"udf_E",
"udf_PI",
"udf_abs",
"udf_acos",
"udf_add",
Expand Down