Pulling functionality from apache spark#4

Merged

rekhajoshm merged 1454 commits intorekhajoshm:masterfrom

Sep 17, 2015

This pull request is big! We're only showing the most recent 250 commits

Commits on Aug 25, 2015

[SPARK-10210] [STREAMING] Filter out non-existent blocks before creating BlockRDD
tdas
committed
[SPARK-10177] [SQL] fix reading Timestamp in parquet from Hive

Davies Liu
authored and
liancheng
committed
[SPARK-10195] [SQL] Data sources Filter should not expose internal types

JoshRosen
authored and
rxin
committed
[SPARK-10197] [SQL] Add null check in wrapperFor (inside HiveInspectors).

yhuai
authored and
liancheng
committed
[DOC] add missing parameters in SparkContext.scala for scala doc

liyezhang556520
authored and
srowen
committed
Fixed a typo in DAGScheduler.

zzvara
authored and
srowen
committed
[SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters
srowen
committed
[SPARK-10198] [SQL] Turn off partition verification by default
marmbrus
committed
[SPARK-8531] [ML] Update ML user guide for MinMaxScaler

hhbyyh
authored and
jkbradley
committed
[SPARK-10230] [MLLIB] Rename optimizeAlpha to optimizeDocConcentration

Feynman Liang
authored and
jkbradley
committed
[SPARK-10231] [MLLIB] update @Since annotation for mllib.classification

mengxr
authored and
DB Tsai
committed
[SPARK-10048] [SPARKR] Support arbitrary nested Java array in serde.

Sun Rui
authored and
shivaram
committed
[SPARK-9800] Adds docs for GradientDescent$.runMiniBatchSGD alias

Feynman Liang
authored and
jkbradley
committed
[SPARK-10237] [MLLIB] update since versions in mllib.fpm
mengxr
committed
[SPARK-9797] [MLLIB] [DOC] StreamingLinearRegressionWithSGD.setConvergenceTol default value

Feynman Liang
authored and
jkbradley
committed
[SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util

mengxr
authored and
DB Tsai
committed
[SPARK-10245] [SQL] Fix decimal literals with precision < scale

Davies Liu
authored and
yhuai
committed
[SPARK-10215] [SQL] Fix precision of division (follow the rule in Hive)

Davies Liu
authored and
yhuai
committed

Commits on Aug 26, 2015

[SPARK-9888] [MLLIB] User guide for new LDA features

Feynman Liang
authored and
jkbradley
committed
[SPARK-10233] [MLLIB] update since version in mllib.evaluation
mengxr
committed
[SPARK-10238] [MLLIB] update since versions in mllib.linalg

mengxr
authored and
DB Tsai
committed
[SPARK-10240] [SPARK-10242] [MLLIB] update since versions in mlilb.random and mllib.stat
mengxr
committed
[SPARK-10234] [MLLIB] update since version in mllib.clustering
mengxr
committed
[SPARK-10243] [MLLIB] update since versions in mllib.tree
mengxr
committed
[SPARK-10235] [MLLIB] update since versions in mllib.regression

mengxr
authored and
DB Tsai
committed
[SPARK-10236] [MLLIB] update since versions in mllib.feature

mengxr
authored and
DB Tsai
committed
[SPARK-9316] [SPARKR] Add support for filtering using `[` (synonym for filter / select)

felixcheung
authored and
shivaram
committed
Closes #8443
rxin
committed
[SPARK-9665] [MLLIB] audit MLlib API annotations

mengxr
authored and
jkbradley
committed
HOTFIX: Increase PRB timeout
pwendell
committed
[SPARK-10241] [MLLIB] update since versions in mllib.recommendation
mengxr
committed
[SPARK-10305] [SQL] fix create DataFrame from Python class

Davies Liu
authored and
davies
committed

Commits on Aug 27, 2015

[SPARK-10308] [SPARKR] Add %in% to the exported namespace
shivaram
committed
[MINOR] [SPARKR] Fix some validation problems in SparkR

yu-iskw
authored and
shivaram
committed
[SPARK-9424] [SQL] Parquet programming guide updates for 1.5

liancheng
authored and
marmbrus
committed
[SPARK-9964] [PYSPARK] [SQL] PySpark DataFrameReader accept RDD of String for JSON

yanboliang
authored and
rxin
committed
[SPARK-10219] [SPARKR] Fix varargsToEnv and add test case
shivaram
committed
[SPARK-10251] [CORE] some common types are not registered for Kryo Serializat…

Ram Sriharsha
authored and
rxin
committed
[DOCS] [STREAMING] [KAFKA] Fix typo in exactly once semantics

moutai
authored and
srowen
committed
[SPARK-10254] [ML] Removes Guava dependencies in spark.ml.feature JavaTests

Feynman Liang
authored and
srowen
committed
[SPARK-10255] [ML] Removes Guava dependencies from spark.ml.param JavaTests

Feynman Liang
authored and
srowen
committed
[SPARK-10256] [ML] Removes guava dependency from spark.ml.classification JavaTests

Feynman Liang
authored and
srowen
committed
[SPARK-9613] [HOTFIX] Fix usage of JavaConverters removed in Scala 2.11

jaceklaskowski
authored and
srowen
committed
[SPARK-10257] [MLLIB] Removes Guava from all spark.mllib Java tests

Feynman Liang
authored and
srowen
committed
[SPARK-10182] [MLLIB] GeneralizedLinearModel doesn't unpersist cached data

SlavikBaranov
authored and
srowen
committed
[SPARK-9148] [SPARK-10252] [SQL] Update SQL Programming Guide
marmbrus
committed
[SPARK-10315] remove document on spark.akka.failure-detector.threshold

CodingCat
authored and
srowen
committed
[SPARK-9901] User guide for RowMatrix Tall-and-skinny QR

hhbyyh
authored and
mengxr
committed
[SPARK-9906] [ML] User guide for LogisticRegressionSummary

MechCoder
authored and
jkbradley
committed
[SPARK-9680] [MLLIB] [DOC] StopWordsRemovers user guide and Java compatibility test

Feynman Liang
authored and
mengxr
committed
[SPARK-10287] [SQL] Fixes JSONRelation refreshing on read path
yhuai
committed
[SPARK-10321] sizeInBytes in HadoopFsRelation

Davies Liu
authored and
marmbrus
committed

Commits on Aug 28, 2015

[SPARK-8505] [SPARKR] Add settings to kick `lint-r` from `./dev/run-test.py`

yu-iskw
authored and
shivaram
committed
[SPARK-9911] [DOC] [ML] Update Userguide for Evaluator

MechCoder
authored and
mengxr
committed
[SPARK-9905] [ML] [DOC] Adds LinearRegressionSummary user guide

Feynman Liang
authored and
mengxr
committed
[SPARK-SQL] [MINOR] Fixes some typos in HiveContext

liancheng
authored and
rxin
committed
[SPARK-10188] [PYSPARK] Pyspark CrossValidator with RMSE selects incorrect model

noel-smith
authored and
jkbradley
committed
[SPARK-10328] [SPARKR] Fix generic for na.omit
shivaram
committed
[SPARK-10260] [ML] Add @Since annotation to ml.clustering

yu-iskw
authored and
mengxr
committed
[SPARK-10295] [CORE] Dynamic allocation in Mesos does not release when RDDs are cached
srowen
committed
Fix DynamodDB/DynamoDB typo in Kinesis Integration doc

yosssi
authored and
srowen
committed
typo in comment

dharmeshkakadia
authored and
srowen
committed
[YARN] [MINOR] Avoid hard code port number in YarnShuffleService test

jerryshao
authored and
squito
committed
[SPARK-9890] [DOC] [ML] User guide for CountVectorizer

hhbyyh
authored and
mengxr
committed
[SPARK-8952] [SPARKR] - Wrap normalizePath calls with suppressWarnings

lresende
authored and
shivaram
committed
[SPARK-10325] Override hashCode() for public Row

JoshRosen
authored and
marmbrus
committed
[SPARK-9284] [TESTS] Allow all tests to run without an assembly.
Marcelo Vanzin
committed
[SPARK-10336][example] fix not being able to set intercept in LR example

Shuo Xiang
authored and
DB Tsai
committed
[SPARK-9671] [MLLIB] re-org user guide and add migration guide
mengxr
committed
[SPARK-10323] [SQL] fix nullability of In/InSet/ArrayContain

Davies Liu
authored and
davies
committed

Commits on Aug 29, 2015

[SPARK-9803] [SPARKR] Add subset and transform + tests

felixcheung
authored and
shivaram
committed
[SPARK-9910] [ML] User guide for train validation split

zapletal-martin
authored and
mengxr
committed
[SPARK-10350] [DOC] [SQL] Removed duplicated option description from SQL guide

witgo
authored and
marmbrus
committed
[SPARK-10289] [SQL] A direct write API for testing Parquet

liancheng
authored and
marmbrus
committed
[SPARK-10344] [SQL] Add tests for extraStrategies

marmbrus
authored and
yhuai
committed
[SPARK-10226] [SQL] Fix exclamation mark issue in SparkSQL

small-wang
authored and
marmbrus
committed
[SPARK-10330] Use SparkHadoopUtil TaskAttemptContext reflection methods in more places

JoshRosen
authored and
marmbrus
committed
[SPARK-10339] [SPARK-10334] [SPARK-10301] [SQL] Partitioned table scan can OOM driver and throw a better error message when users need to enable parquet schema merging

yhuai
authored and
marmbrus
committed

Commits on Aug 31, 2015

SPARK-9545, SPARK-9547: Use Maven in PRB if title contains "[test-maven]"
pwendell
committed
[SPARK-10351] [SQL] Fixes UTF8String.fromAddress to handle off-heap memory

Feynman Liang
authored and
rxin
committed
[SPARK-100354] [MLLIB] fix some apparent memory issues in k-means|| initializaiton
mengxr
committed
[SPARK-8730] Fixes - Deser objects containing a primitive class attribute

EugenCepoi
authored and
squito
committed
[SPARK-10369] [STREAMING] Don't remove ReceiverTrackingInfo when deregisterReceivering since we may reuse it later

zsxwing
authored and
tdas
committed
[SPARK-10170] [SQL] Add DB2 JDBC dialect support.

sureshthalamati
authored and
rxin
committed
[SPARK-9954] [MLLIB] use first 128 nonzeros to compute Vector.hashCode
mengxr
committed
[SPARK-8472] [ML] [PySpark] Python API for DCT

yanboliang
authored and
mengxr
committed
[SPARK-10341] [SQL] fix memory starving in unsafe SMJ

Davies Liu
authored and
rxin
committed
[SPARK-10349] [ML] OneVsRest use 'when ... otherwise' not UDF to generate new label at binary reduction

yanboliang
authored and
mengxr
committed
[SPARK-10355] [ML] [PySpark] Add Python API for SQLTransformer

yanboliang
authored and
mengxr
committed

Commits on Sep 1, 2015

Commits on Sep 2, 2015

[SPARK-7336] [HISTORYSERVER] Fix bug that applications status incorrect on JobHistory UI.

ArcherShao
authored and
Marcelo Vanzin
committed
[SPARK-10034] [SQL] add regression test for Sort on Aggregate

cloud-fan
authored and
marmbrus
committed
[SPARK-10389] [SQL] support order by non-attribute grouping expression on Aggregate

cloud-fan
authored and
marmbrus
committed
[SPARK-10004] [SHUFFLE] Perform auth checks when clients read shuffle data.
Marcelo Vanzin
committed
[SPARK-10417] [SQL] Iterating through Column results in infinite loop

0x0FFF
authored and
davies
committed

Commits on Sep 3, 2015

[SPARK-10422] [SQL] String column in InMemoryColumnarCache needs to override clone method

yhuai
authored and
davies
committed
[SPARK-9723] [ML] params getordefault should throw more useful error

holdenk
authored and
mengxr
committed
[SPARK-5945] Spark should not retry a stage infinitely on a FetchFailedException

Ilya Ganelin
authored and
Andrew Or
committed
[SPARK-8707] RDD#toDebugString fails if any cached RDD has invalid partitions

navis
authored and
Andrew Or
committed
Removed code duplication in ShuffleBlockFetcherIterator

eracah
authored and
Andrew Or
committed
[SPARK-10247] [CORE] improve readability of a test case in DAGSchedulerSuite

squito
authored and
Andrew Or
committed
[SPARK-10379] preserve first page in UnsafeShuffleExternalSorter

Davies Liu
authored and
Andrew Or
committed
[SPARK-10411] [SQL] Move visualization above explain output and hide explain by default

zsxwing
authored and
Andrew Or
committed
[SPARK-10332] [CORE] Fix yarn spark executor validation

holdenk
authored and
srowen
committed
[SPARK-9596] [SQL] treat hadoop classes as shared one in IsolatedClientLoader

WangTaoTheTonic
authored and
marmbrus
committed
[SPARK-8951] [SPARKR] support Unicode characters in collect()

CHOIJAEHONG
authored and
shivaram
committed
[SPARK-10432] spark.port.maxRetries documentation is unclear

Tom Graves
authored and
Andrew Or
committed
[SPARK-10431] [CORE] Fix intermittent test failure. Wait for event queue to be clear

robbins
authored and
Andrew Or
committed
[SPARK-9869] [STREAMING] Wait for all event notifications before asserting results

robbins
authored and
Andrew Or
committed
[SPARK-9672] [MESOS] Don’t include SPARK_ENV_LOADED when passing env vars

pashields
authored and
Andrew Or
committed
[SPARK-10430] [CORE] Added hashCode methods in AccumulableInfo and RDDOperationScope

Vinod K C
authored and
Andrew Or
committed
[SPARK-9591] [CORE] Job may fail for exception during getting remote block

jeanlyn
authored and
Andrew Or
committed
[SPARK-10435] Spark submit should fail fast for Mesos cluster mode with R
Andrew Or
committed
[SPARK-10421] [BUILD] Exclude curator artifacts from tachyon dependencies.
Marcelo Vanzin
committed

Commits on Sep 4, 2015

[SPARK-10003] Improve readability of DAGScheduler

Andrew Or
authored and
kayousterhout
committed
[MINOR] Minor style fix in SparkR
shivaram
committed
MAINTENANCE: Automated closing of pull requests.
marmbrus
committed
[SPARK-10176] [SQL] Show partially analyzed plans when checkAnswer fails to analyze

cloud-fan
authored and
Andrew Or
committed
[SPARK-10450] [SQL] Minor improvements to readability / style / typos etc.
Andrew Or
committed
[SPARK-9669] [MESOS] Support PySpark on Mesos cluster mode.

tnachen
authored and
Andrew Or
committed
[SPARK-10454] [SPARK CORE] wait for empty event queue

robbins
authored and
Andrew Or
committed
[SPARK-10311] [STREAMING] Reload appId and attemptId when app starts with checkpoint file in cluster mode

XuTingjun
authored and
tdas
committed

Commits on Sep 5, 2015

[SPARK-10402] [DOCS] [ML] Add defaults to the scaladoc for params in ml/

holdenk
authored and
jkbradley
committed
[SPARK-9925] [SQL] [TESTS] Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

yhuai
authored and
Andrew Or
committed
[HOTFIX] [SQL] Fixes compilation error

liancheng
authored and
rxin
committed
[SPARK-10440] [STREAMING] [DOCS] Update python API stuff in the programming guides and python docs

tdas
authored and
rxin
committed
[SPARK-10434] [SQL] Fixes Parquet schema of arrays that may contain null
liancheng
committed
[SPARK-10013] [ML] [JAVA] [TEST] remove java assert from java unit tests

holdenk
authored and
rxin
committed

Commits on Sep 7, 2015

[SPARK-9767] Remove ConnectionManager.
rxin
committed

Commits on Sep 8, 2015

[DOC] Added R to the list of languages with "high-level API" support in the…

Stephen Hopper
authored and
srowen
committed
Docs small fixes

jaceklaskowski
authored and
srowen
committed
[SPARK-9170] [SQL] Use OrcStructInspector to be case preserving when writing ORC files

viirya
authored and
liancheng
committed
[SPARK-10480] [ML] Fix ML.LinearRegressionModel.copy()

yanboliang
authored and
mengxr
committed
[SPARK-10316] [SQL] respect nondeterministic expressions in PhysicalOperation

cloud-fan
authored and
marmbrus
committed
[SPARK-10470] [ML] ml.IsotonicRegressionModel.copy should set parent

yanboliang
authored and
mengxr
committed
[SPARK-10441] [SQL] Save data correctly to json.

yhuai
authored and
marmbrus
committed
[SPARK-10468] [ MLLIB ] Verify schema before Dataframe select API call

Vinod K C
authored and
mengxr
committed
[SPARK-10492] [STREAMING] [DOCUMENTATION] Update Streaming documentation about rate limiting and backpressure
tdas
committed
[SPARK-10327] [SQL] Cache Table is not working while subquery has alias in its project list

chenghao-intel
authored and
marmbrus
committed
[HOTFIX] Fix build break caused by #8494
marmbrus
committed

Commits on Sep 9, 2015

[RELEASE] Add more contributors & only show names in release notes.
rxin
committed
[SPARK-10071] [STREAMING] Output a warning when writing QueueInputDStream and throw a better exception when reading QueueInputDStream

zsxwing
authored and
tdas
committed
[SPARK-9834] [MLLIB] implement weighted least squares via normal equation
mengxr
committed
[SPARK-10464] [MLLIB] Add WeibullGenerator for RandomDataGenerator

yanboliang
authored and
mengxr
committed
[SPARK-10373] [PYSPARK] move @since into pyspark from sql

Davies Liu
authored and
mengxr
committed
[SPARK-10094] Pyspark ML Feature transformers marked as experimental

noel-smith
authored and
mengxr
committed
[SPARK-9654] [ML] [PYSPARK] Add IndexToString to PySpark

holdenk
authored and
jkbradley
committed
[SPARK-10249] [ML] [DOC] Add Python Code Example to StopWordsRemover User Guide

hhbyyh
authored and
mengxr
committed
[SPARK-10227] fatal warnings with sbt on Scala 2.11

Luc Bourlier
authored and
srowen
committed
[SPARK-10117] [MLLIB] Implement SQL data source API for reading LIBSVM data

Lewuathe
authored and
mengxr
committed
[SPARK-10481] [YARN] SPARK_PREPEND_CLASSES make spark-yarn related jar could n…

zjffdu
authored and
Marcelo Vanzin
committed
[SPARK-10461] [SQL] make sure `input.primitive` is always variable name not code at `GenerateUnsafeProjection`

cloud-fan
authored and
davies
committed
[SPARK-9730] [SQL] Add Full Outer Join support for SortMergeJoin

viirya
authored and
davies
committed

Commits on Sep 10, 2015

[SPARK-9772] [PYSPARK] [ML] Add Python API for ml.feature.VectorSlicer

yanboliang
authored and
jkbradley
committed
[MINOR] [MLLIB] [ML] [DOC] fixed typo: label for negative result should be 0.0 (original: 1.0)

sparadiso
authored and
mengxr
committed
[SPARK-10497] [BUILD] [TRIVIAL] Handle both locations for JIRAError with python-jira

holdenk
authored and
srowen
committed
[SPARK-10065] [SQL] avoid the extra copy when generate unsafe array

cloud-fan
authored and
davies
committed
[SPARK-7142] [SQL] Minor enhancement to BooleanSimplification Optimizer rule

Yash Datta
authored and
marmbrus
committed
[SPARK-10301] [SPARK-10428] [SQL] Addresses comments of PR #8583 and #8509 for master

liancheng
authored and
davies
committed
[SPARK-10466] [SQL] UnsafeRow SerDe exception with data spill

chenghao-intel
authored and
Andrew Or
committed
[SPARK-10469] [DOC] Try and document the three options

holdenk
authored and
Andrew Or
committed
[SPARK-8167] Make tasks that fail from YARN preemption not fail job

mccheah
authored and
Andrew Or
committed
[SPARK-6350] [MESOS] Fine-grained mode scheduler respects mesosExecutor.cores

dragos
authored and
Andrew Or
committed
[SPARK-10514] [MESOS] waiting for min no of total cores acquired by Spark by implementing the sufficientResourcesRegistered method

SleepyThread
authored and
Andrew Or
committed
[SPARK-9990] [SQL] Create local hash join operator

zsxwing
authored and
Andrew Or
committed
[SPARK-10049] [SPARKR] Support collecting data of ArraryType in DataFrame.

Sun Rui
authored and
shivaram
committed
[SPARK-10443] [SQL] Refactor SortMergeOuterJoin to reduce duplication

Andrew Or
authored and
davies
committed
Add 1.5 to master branch EC2 scripts
shivaram
committed
[SPARK-7544] [SQL] [PySpark] pyspark.sql.types.Row implements __getitem__

yanboliang
authored and
davies
committed

Commits on Sep 11, 2015

[SPARK-9043] Serialize key, value and combiner classes in ShuffleDependency

massie
authored and
rxin
committed
[SPARK-10023] [ML] [PySpark] Unified DecisionTreeParams checkpointInterval between Scala and Python API.

yanboliang
authored and
mengxr
committed
[SPARK-10027] [ML] [PySpark] Add Python API missing methods for ml.feature

yanboliang
authored and
mengxr
committed
[SPARK-10472] [SQL] Fixes DataType.typeName for UDT
liancheng
committed
[SPARK-10556] Remove explicit Scala version for sbt project build files

ahirreddy
authored and
srowen
committed
[SPARK-10518] [DOCS] Update code examples in spark.ml user guide to use LIBSVM data source instead of MLUtils

y-shimizu
authored and
mengxr
committed
[SPARK-10026] [ML] [PySpark] Implement some common Params for regression in PySpark

yanboliang
authored and
mengxr
committed
[SPARK-9773] [ML] [PySpark] Add Python API for MultilayerPerceptronClassifier

yanboliang
authored and
mengxr
committed
[SPARK-10537] [ML] document LIBSVM source options in public API doc and some minor improvements
mengxr
committed
[MINOR] [MLLIB] [ML] [DOC] Minor doc fixes for StringIndexer and MetadataUtils

jkbradley
authored and
mengxr
committed
[SPARK-10540] [SQL] Ignore HadoopFsRelationTest's "test all data types" if it is too flaky
yhuai
committed
[SPARK-8530] [ML] add python API for MinMaxScaler

hhbyyh
authored and
jkbradley
committed
[SPARK-10546] Check partitionId's range in ExternalSorter#spill()

tedyu
authored and
srowen
committed
[PYTHON] Fixed typo in exception message

icaromedeiros
authored and
srowen
committed
[SPARK-10442] [SQL] fix string to boolean cast

cloud-fan
authored and
yhuai
committed
[SPARK-7142] [SQL] Minor enhancement to BooleanSimplification Optimizer rule. Incorporate review comments

Yash Datta
authored and
marmbrus
committed
[SPARK-9992] [SPARK-9994] [SPARK-9998] [SQL] Implement the local TopK, sample and intersect operators

zsxwing
authored and
Andrew Or
committed
[SPARK-9990] [SQL] Local hash join follow-ups
Andrew Or
committed
[SPARK-10564] ThreadingSuite: assertion failures in threads don't fail the test
Andrew Or
committed
[SPARK-9014] [SQL] Allow Python spark API to use built-in exponential operator

0x0FFF
authored and
davies
committed

Commits on Sep 13, 2015

[SPARK-10222] [GRAPHX] [DOCS] More thoroughly deprecate Bagel in favor of GraphX
srowen
committed

Commits on Sep 14, 2015

[SPARK-9720] [ML] Identifiable types need UID in toString methods

BertrandDechoux
authored and
srowen
committed
[SPARK-9899] [SQL] log warning for direct output committer with speculation enabled

cloud-fan
authored and
yhuai
committed
[SPARK-10584] [DOC] [SQL] Documentation about spark.sql.hive.metastore.version is wrong.

sarutak
authored and
yhuai
committed
[SPARK-10194] [MLLIB] [PYSPARK] SGD algorithms need convergenceTol parameter in Python

yanboliang
authored and
mengxr
committed
[SPARK-10573] [ML] IndexToString output schema should be StringType

Nick Pritchard
authored and
mengxr
committed
[SPARK-10522] [SQL] Nanoseconds of Timestamp in Parquet should be positive

Davies Liu
authored and
davies
committed
[SPARK-6981] [SQL] Factor out SparkPlanner and QueryExecution from SQLContext

evacchi
authored and
marmbrus
committed
[SPARK-9996] [SPARK-9997] [SQL] Add local expand and NestedLoopJoin operators

zsxwing
authored and
Andrew Or
committed
[SPARK-10594] [YARN] Remove reference to --num-executors, add --properties-file

erickt
authored and
Andrew Or
committed
[SPARK-10576] [BUILD] Move .java files out of src/main/scala

srowen
authored and
Andrew Or
committed
[SPARK-10549] scala 2.11 spark on yarn with security - Repl doesn't work

Tom Graves
authored and
Andrew Or
committed
[SPARK-10543] [CORE] Peak Execution Memory Quantile should be Per-task Basis

saurfang
authored and
Andrew Or
committed
[SPARK-10564] ThreadingSuite: assertion failures in threads don't fail the test (round 2)
Andrew Or
committed

Commits on Sep 15, 2015

[SPARK-9851] Support submitting map stages individually in DAGScheduler
mateiz
committed
[SPARK-10542] [PYSPARK] fix serialize namedtuple

Davies Liu
authored and
davies
committed
[SPARK-9793] [MLLIB] [PYSPARK] PySpark DenseVector, SparseVector implement __eq__ and __hash__ correctly

yanboliang
authored and
mengxr
committed
[SPARK-10273] Add @since annotation to pyspark.mllib.feature

noel-smith
authored and
mengxr
committed
[SPARK-10275] [MLLIB] Add @since annotation to pyspark.mllib.random

yu-iskw
authored and
mengxr
committed
Small fixes to docs

Jacek Laskowski
authored and
rxin
committed
[SPARK-10598] [DOCS]

insidedctm
authored and
rxin
committed
Update version to 1.6.0-SNAPSHOT.
rxin
committed
[SPARK-10491] [MLLIB] move RowMatrix.dspr to BLAS

hhbyyh
authored and
mengxr
committed
[SPARK-10300] [BUILD] [TESTS] Add support for test tags in run-tests.py.
Marcelo Vanzin
committed
[PYSPARK] [MLLIB] [DOCS] Replaced addversion with versionadded in mllib.random

noel-smith
authored and
mengxr
committed
Closes #8738
mengxr
committed
[DOCS] Small fixes to Spark on Yarn doc

Jacek Laskowski
authored and
srowen
committed
Revert "[SPARK-10300] [BUILD] [TESTS] Add support for test tags in run-tests.py."
Marcelo Vanzin
committed
[SPARK-10437] [SQL] Support aggregation expressions in Order By

viirya
authored and
marmbrus
committed
[SPARK-10475] [SQL] improve column prunning for Project on Sort

cloud-fan
authored and
marmbrus
committed
[SPARK-7685] [ML] Apply weights to different samples in Logistic Regression

DB Tsai
authored and
mengxr
committed
[SPARK-10548] [SPARK-10563] [SQL] Fix concurrent SQL executions
Andrew Or
committed
[SPARK-10612] [SQL] Add prepare to LocalNode.

rxin
authored and
Andrew Or
committed

Commits on Sep 16, 2015

[SPARK-10575] [SPARK CORE] Wrapped RDD.takeSample with Scope

vinodkc
authored and
Andrew Or
committed
[SPARK-10381] Fix mixup of taskAttemptNumber & attemptId in OutputCommitCoordinator
JoshRosen
committed
[SPARK-10613] [SPARK-10624] [SQL] Reduce LocalNode tests dependency on SQLContext
Andrew Or
committed
[SPARK-9078] [SQL] Allow jdbc dialects to override the query used to check the table.

sureshthalamati
authored and
yhuai
committed
[SPARK-10595] [ML] [MLLIB] [DOCS] Various ML guide cleanups

jkbradley
authored and
mengxr
committed
[SPARK-10516] [ MLLIB] Added values property in DenseVector

Vinod K C
authored and
mengxr
committed
[SPARK-10511] [BUILD] Reset git repository before packaging source distro

lresende
authored and
srowen
committed
[SPARK-10276] [MLLIB] [PYSPARK] Add @since annotation to pyspark.mllib.recommendation

yu-iskw
authored and
mengxr
committed
[SPARK-10589] [WEBUI] Add defense against external site framing
srowen
committed
[SPARK-10050] [SPARKR] Support collecting data of MapType in DataFrame.

Sun Rui
authored and
shivaram
committed
[SPARK-9794] [SQL] Fix datetime parsing in SparkSQL.

kevincox
authored and
rxin
committed
Tiny style fix for d39f15ea2b8bed5342d2f8e3c1936f915c470783.
rxin
committed