[SPARK-19320][MESOS][WIP]allow specifying a hard limit on number of gpus required in each spark executor when running on mesos#17235

Closed

yanji84 wants to merge 514 commits intoapache:masterfrom

yanji84:ji/hard_limit_on_gpu

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 12, 2017

[SPARK-19993][SQL] Caching logical plans containing subquery expressions does not work.

dilipbiswal
authored and
cloud-fan
committed
[MINOR][DOCS] Fix spacings in Structured Streaming Programming Guide

dongjinleekr
authored and
srowen
committed
[MINOR][DOCS] JSON APIs related documentation fixes

HyukjinKwon
authored and
srowen
committed
[SPARK-20298][SPARKR][MINOR] fixed spelling mistake "charactor"

bdwyer2
authored and
srowen
committed
[SPARK-20302][SQL] Short circuit cast when from and to types are structurally the same
rxin
committed
[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming

jtoka
authored and
srowen
committed
[SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on Jenkins

HyukjinKwon
authored and
srowen
committed
[SPARK-20303][SQL] Rename createTempFunction to registerFunction
gatorsmile
committed
[SPARK-20304][SQL] AssertNotNull should not include path in string representation

rxin
authored and
gatorsmile
committed
[SPARK-19570][PYSPARK] Allow to disable hive in pyspark shell

zjffdu
authored and
holdenk
committed
[SPARK-20301][FLAKY-TEST] Fix Hadoop Shell.runCommand flakiness in Structured Streaming tests

brkyvz
authored and
tdas
committed

Commits on Apr 13, 2017

[SPARK-15354][FLAKY-TEST] TopologyAwareBlockReplicationPolicyBehavior.Peers in 2 racks
cloud-fan
committed
[SPARK-20131][CORE] Don't use `this` lock in StandaloneSchedulerBackend.stop
zsxwing
committed
[SPARK-20189][DSTREAM] Fix spark kinesis testcases to remove deprecated createStream and use Builders

yashs360
authored and
srowen
committed
[SPARK-20265][MLLIB] Improve Prefix'span pre-processing efficiency

Syrux
authored and
srowen
committed
[SPARK-20284][CORE] Make {Des,S}erializationStream extend Closeable

Sergei Lebedev
authored and
srowen
committed
[SPARK-20233][SQL] Apply star-join filter heuristics to dynamic programming join enumeration

ioana-delaney
authored and
cloud-fan
committed
[SPARK-20232][PYTHON] Improve combineByKey docs

David Gingrich
authored and
holdenk
committed
[SPARK-20038][SQL] FileFormatWriter.ExecuteWriteTask.releaseResources() implementations to be re-entrant

steveloughran
authored and
squito
committed

Commits on Apr 14, 2017

[SPARK-20318][SQL] Use Catalyst type for min/max in ColumnStat for ease of estimation

wangzhenhua
authored and
cloud-fan
committed

Commits on Apr 15, 2017

[SPARK-20316][SQL] Val and Var should strictly follow the Scala syntax

ouyangxiaochen
authored and
srowen
committed

Commits on Apr 16, 2017

Commits on Apr 17, 2017

[SPARK-19828][R][FOLLOWUP] Rename asJsonArray to as.json.array in from_json function in R

HyukjinKwon
authored and
Felix Cheung
committed
[SPARK-20349][SQL] ListFunctions returns duplicate functions after using persistent functions
gatorsmile
committed
[SPARK-17647][SQL] Fix backslash escaping in 'LIKE' patterns.

jodersky
authored and
rxin
committed

Commits on Apr 18, 2017

Typo fix: distitrbuted -> distributed

ash211
authored and
rxin
committed
[TEST][MINOR] Replace repartitionBy with distribute in CollapseRepartitionSuite

jaceklaskowski
authored and
rxin
committed
[SPARK-17647][SQL][FOLLOWUP][MINOR] fix typo

felixcheung
authored and
Felix Cheung
committed
[SPARK-20344][SCHEDULER] Duplicate call in FairSchedulableBuilder.addTaskSetManager

snazy
authored and
srowen
committed
[SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to resolve build failure in SBT Hadoop 2.6 master on Jenkins

HyukjinKwon
authored and
srowen
committed
[SPARK-20366][SQL] Fix recursive join reordering: inside joins are not reordered

wangzhenhua
authored and
cloud-fan
committed
[SPARK-20354][CORE][REST-API] When I request access to the 'http: //ip:port/api/v1/applications' link, return 'sparkUser' is empty in REST API.

郭小龙 10207633
authored and
Marcelo Vanzin
committed
[SPARK-20360][PYTHON] reprs for interpreters

rgbkrk
authored and
holdenk
committed
[SPARK-20377][SS] Fix JavaStructuredSessionization example
tdas
committed

Commits on Apr 19, 2017

[SPARK-20254][SQL] Remove unnecessary data conversion for Dataset with primitive array

kiszk
authored and
cloud-fan
committed
[SPARK-20208][R][DOCS] Document R fpGrowth support

zero323
authored and
Felix Cheung
committed
[SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

koertkuipers
authored and
cloud-fan
committed
[SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering

viirya
authored and
cloud-fan
committed
[SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build

HyukjinKwon
authored and
srowen
committed
[SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts

koeninger
authored and
srowen
committed
[SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error
zsxwing
committed

Commits on Apr 20, 2017

[SPARK-20350] Add optimization rules to apply Complementation Laws.

ptkool
authored and
cloud-fan
committed
[MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message
zsxwing
committed
[SPARK-20398][SQL] range() operator should include cancellation reason when killed

ericl
authored and
rxin
committed
Fixed typos in docs

ymahajan
authored and
rxin
committed
[SPARK-20375][R] R wrappers for array and map

zero323
authored and
Felix Cheung
committed
[SPARK-20156][SQL][FOLLOW-UP] Java String toLowerCase "Turkish locale bug" in Database and Table DDLs

gatorsmile
authored and
srowen
committed
[SPARK-20405][SQL] Dataset.withNewExecutionId should be private

rxin
authored and
hvanhovell
committed
[SPARK-20409][SQL] fail early if aggregate function in GROUP BY

cloud-fan
authored and
hvanhovell
committed
[SPARK-20407][TESTS] ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test

bogdanrdc
authored and
hvanhovell
committed
[SPARK-20358][CORE] Executors failing stage on interrupted exception thrown by cancelled tasks

ericl
authored and
yhuai
committed
[SPARK-20334][SQL] Return a better error message when correlated predicates contain aggregate expression that has mixture of outer and local references.

dilipbiswal
authored and
hvanhovell
committed
[SPARK-20410][SQL] Make sparkConf a def in SharedSQLContext
hvanhovell
committed
[SPARK-20172][CORE] Add file permission check when listing files in FsHistoryProvider

jerryshao
authored and
Marcelo Vanzin
committed

Commits on Apr 21, 2017

[SPARK-20367] Properly unescape column names of partitioning columns parsed from paths.

juliuszsompolski
authored and
cloud-fan
committed
[SPARK-20329][SQL] Make timezone aware expression without timezone unresolved

hvanhovell
authored and
cloud-fan
committed
[SPARK-20281][SQL] Print the identical Range parameters of SparkContext APIs and SQL in explain

maropu
authored and
gatorsmile
committed
[SPARK-20420][SQL] Add events to the external catalog

hvanhovell
authored and
rxin
committed
Small rewording about history server use case

dud225
authored and
srowen
committed
[SPARK-20412] Throw ParseException from visitNonOptionalPartitionSpec instead of returning null values.

juliuszsompolski
authored and
cloud-fan
committed
[SPARK-20341][SQL] Support BigInt's value that does not fit in long value range

kiszk
authored and
cloud-fan
committed
[SPARK-20423][ML] fix MLOR coeffs centering when reg == 0

WeichenXu123
authored and
dbtsai
committed
[SPARK-20371][R] Add wrappers for collect_list and collect_set

zero323
authored and
Felix Cheung
committed
[SPARK-20401][DOC] In the spark official configuration document, the 'spark.driver.supervise' configuration parameter specification and default values are necessary.

郭小龙 10207633
authored and
srowen
committed

Commits on Apr 22, 2017

[SPARK-20386][SPARK CORE] modify the log info if the block exists on the slave already

eatoncys
authored and
srowen
committed
[SPARK-20430][SQL] Initialise RangeExec parameters in a driver side

maropu
authored and
gatorsmile
committed

Commits on Apr 23, 2017

[SPARK-20132][DOCS] Add documentation for column string functions

map222
authored and
holdenk
committed
[SPARK-20385][WEB-UI] Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui.

郭小龙 10207633
authored and
srowen
committed

Commits on Apr 24, 2017

[BUILD] Close stale PRs

maropu
authored and
srowen
committed
[SPARK-20439][SQL] Fix Catalog API listTables and getTable when failed to fetch table metadata

gatorsmile
authored and
cloud-fan
committed
[SPARK-18901][ML] Require in LR LogisticAggregator is redundant

wangmiao1981
authored and
yanboliang
committed
[SPARK-20438][R] SparkR wrappers for split and repeat

zero323
authored and
Felix Cheung
committed

Commits on Apr 25, 2017

[SPARK-20239][CORE] Improve HistoryServer's ACL mechanism

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT

JoshRosen
authored and
rxin
committed
[SPARK-20451] Filter out nested mapType datatypes from sort order in randomSplit

sameeragarwal
authored and
cloud-fan
committed
[SPARK-20455][DOCS] Fix Broken Docker IT Docs

original-brownbear
authored and
srowen
committed
[SPARK-20404][CORE] Using Option(name) instead of Some(name)

szhem
authored and
srowen
committed
[SPARK-18901][FOLLOWUP][ML] Require in LR LogisticAggregator is redundant

wangmiao1981
authored and
yanboliang
committed
[SPARK-20449][ML] Upgrade breeze version to 0.13.1

yanboliang
authored and
dbtsai
committed
[SPARK-5484][GRAPHX] Periodically do checkpoint in Pregel

ding
authored and
Felix Cheung
committed

Commits on Apr 26, 2017

[SPARK-18127] Add hooks and extension points to Spark

sameeragarwal
authored and
gatorsmile
committed
[SPARK-16548][SQL] Inconsistent error handling in JSON parsing SQL functions

Eric Wasserman
authored and
cloud-fan
committed
[SPARK-20437][R] R wrappers for rollup and cube

zero323
authored and
Felix Cheung
committed
[SPARK-20400][DOCS] Remove References to 3rd Party Vendor Tools

anabranch
authored and
srowen
committed
[SPARK-19812] YARN shuffle service fails to relocate recovery DB acro…

tgravescs
authored and
Tom Graves
committed
[MINOR][ML] Fix some PySpark & SparkR flaky tests
yanboliang
committed
[SPARK-20391][CORE] Rename memory related fields in ExecutorSummay

jerryshao
authored and
squito
committed
[SPARK-20473] Enabling missing types in ColumnVector.Array

michal-databricks
authored and
rxin
committed
[SPARK-20474] Fixing OnHeapColumnVector reallocation

michal-databricks
authored and
rxin
committed
[SPARK-12868][SQL] Allow adding jars from hdfs

weiqingy
authored and
Marcelo Vanzin
committed

Commits on Apr 27, 2017

[SPARK-20435][CORE] More thorough redaction of sensitive information

markgrover
authored and
Marcelo Vanzin
committed
[SPARK-20425][SQL] Support a vertical display mode for Dataset.show

maropu
authored and
gatorsmile
committed
[DOCS][MINOR] Add missing since to SparkR repeat_string note.

zero323
authored and
Felix Cheung
committed
[SPARK-20208][DOCS][FOLLOW-UP] Add FP-Growth to SparkR programming guide

zero323
authored and
Felix Cheung
committed
[SPARK-20483] Mesos Coarse mode may starve other Mesos frameworks

dgshep
authored and
dbtsai
committed
[SPARK-20421][CORE] Mark internal listeners as deprecated.
Marcelo Vanzin
committed
[SPARK-20426] Lazy initialization of FileSegmentManagedBuffer for shuffle service.

jinxing
authored and
Tom Graves
committed
[SPARK-20482][SQL] Resolving Casts is too strict on having time zone set

rednaxelafx
authored and
gatorsmile
committed
[SPARK-20487][SQL] `HiveTableScan` node is quite verbose in explained plan

tejasapatil
authored and
gatorsmile
committed
[SPARK-20483][MINOR] Test for Mesos Coarse mode may starve other Mesos frameworks

dgshep
authored and
dbtsai
committed
[SPARK-20047][ML] Constrained Logistic Regression

yanboliang
authored and
dbtsai
committed
[SPARK-20461][CORE][SS] Use UninterruptibleThread for Executor and fix the potential hang in CachedKafkaConsumer

zsxwing
authored and
tdas
committed
[SPARK-20452][SS][KAFKA] Fix a potential ConcurrentModificationException for batch Kafka DataFrame

zsxwing
authored and
tdas
committed

Commits on Apr 28, 2017

[SPARK-12837][CORE] Do not send the name of internal accumulator to executor side

cloud-fan
authored and
hvanhovell
committed
[SPARKR][DOC] Document LinearSVC in R programming guide

wangmiao1981
authored and
Felix Cheung
committed
[SPARK-20476][SQL] Block users to create a table that use commas in the column names

gatorsmile
authored and
cloud-fan
committed
[SPARK-14471][SQL] Aliases in SELECT could be used in GROUP BY

maropu
authored and
cloud-fan
committed
[SPARK-20465][CORE] Throws a proper exception when any temp directory could not be got

HyukjinKwon
authored and
srowen
committed
[SPARK-20496][SS] Bug in KafkaWriter Looks at Unanalyzed Plans

Bill Chambers
authored and
brkyvz
committed
[SPARK-20514][CORE] Upgrade Jetty to 9.3.11.v20160721

markgrover
authored and
Marcelo Vanzin
committed
[SPARK-20471] Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled but vectorized hashmap is enabled

heary-cao
authored and
gatorsmile
committed
[SPARK-19525][CORE] Add RDD checkpoint compression support

Aaditya Ramesh
authored and
zsxwing
committed

Commits on Apr 29, 2017

[SPARK-20487][SQL] Display `serde` for `HiveTableScan` node in explained plan

tejasapatil
authored and
gatorsmile
committed
[SPARK-20477][SPARKR][DOC] Document R bisecting k-means in R programming guide

wangmiao1981
authored and
Felix Cheung
committed
[SPARK-19791][ML] Add doc and example for fpgrowth

YY-OnCall
authored and
Felix Cheung
committed
[SPARK-20533][SPARKR] SparkR Wrappers Model should be private and value should be lazy

wangmiao1981
authored and
Felix Cheung
committed
[SPARK-20493][R] De-duplicate parse logics for DDL-like type strings in R

HyukjinKwon
authored and
Felix Cheung
committed
[SPARK-20442][PYTHON][DOCS] Fill up documentations for functions in Column API in PySpark

HyukjinKwon
authored and
holdenk
committed

Commits on Apr 30, 2017

[SPARK-20521][DOC][CORE] The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md

郭小龙 10207633
authored and
srowen
committed
[SPARK-20492][SQL] Do not print empty parentheses for invalid primitive types in parser

HyukjinKwon
authored and
hvanhovell
committed
[SPARK-20535][SPARKR] R wrappers for explode_outer and posexplode_outer

zero323
authored and
Felix Cheung
committed

Commits on May 1, 2017

[MINOR][DOCS][PYTHON] Adding missing boolean type for replacement value in fillna

Srinivasa Reddy Vundela
authored and
Felix Cheung
committed
[SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ! / not

zero323
authored and
Felix Cheung
committed
[SPARK-20541][SPARKR][SS] support awaitTermination without timeout

felixcheung
authored and
Felix Cheung
committed
[SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper for eqNullSafe

zero323
authored and
gatorsmile
committed
[SPARK-20534][SQL] Make outer generate exec return empty rows

hvanhovell
authored and
gatorsmile
committed
[SPARK-20517][UI] Fix broken history UI download link

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-20464][SS] Add a job group and description for streaming queries and fix cancellation of running jobs using the job group

kunalkhamar
authored and
zsxwing
committed
[SPARK-20540][CORE] Fix unstable executor requests.

rdblue
authored and
Marcelo Vanzin
committed

Commits on May 2, 2017

[SPARK-20459][SQL] JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

srowen
authored and
gatorsmile
committed
[SPARK-20463] Add support for IS [NOT] DISTINCT FROM.

ptkool
authored and
gatorsmile
committed
[SPARK-20548] Disable ReplSuite.newProductSeqEncoder with REPL defined class

sameeragarwal
authored and
hvanhovell
committed
[SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0

felixcheung
authored and
Felix Cheung
committed
[SPARK-20532][SPARKR] Implement grouping and grouping_id

zero323
authored and
Felix Cheung
committed
[SPARK-20537][CORE] Fixing OffHeapColumnVector reallocation

kiszk
authored and
cloud-fan
committed
[SPARK-20549] java.io.CharConversionException: Invalid UTF-32' in JsonToStructs

brkyvz
authored and
cloud-fan
committed
[SPARK-20300][ML][PYSPARK] Python API for ALSModel.recommendForAllUsers,Items
Nick Pentreath
committed
[SPARK-19235][SQL][TEST][FOLLOW-UP] Enable Test Cases in DDLSuite with Hive Metastore

gatorsmile
authored and
cloud-fan
committed
[SPARK-20490][SPARKR][DOC] add family tag for not function

felixcheung
authored and
Felix Cheung
committed
[SPARK-20421][CORE] Add a missing deprecation tag.
Marcelo Vanzin
committed

Commits on May 3, 2017

Commits on May 4, 2017

[SPARK-20584][PYSPARK][SQL] Python generic hint support

zero323
authored and
rxin
committed
[SPARK-20543][SPARKR] skip tests when running on CRAN

felixcheung
authored and
Felix Cheung
committed
[SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide, R example

felixcheung
authored and
Felix Cheung
committed
[SPARK-20585][SPARKR] R generic hint support

zero323
authored and
Felix Cheung
committed
[SPARK-20544][SPARKR] R wrapper for input_file_name

zero323
authored and
Felix Cheung
committed
[SPARK-20571][SPARKR][SS] Flaky Structured Streaming tests

felixcheung
authored and
Felix Cheung
committed
[SPARK-20047][FOLLOWUP][ML] Constrained Logistic Regression follow up
yanboliang
committed
[SPARK-20566][SQL] ColumnVector should support `appendFloats` for array

dongjoon-hyun
authored and
cloud-fan
committed

Commits on May 5, 2017

[SPARK-20574][ML] Allow Bucketizer to handle non-Double numeric column

Wayne Zhang
authored and
yanboliang
committed
[INFRA] Close stale PRs

HyukjinKwon
authored and
srowen
committed
[SPARK-19660][SQL] Replace the deprecated property name fs.default.name to fs.defaultFS that newly introduced

wangyum
authored and
srowen
committed
[SPARK-20546][DEPLOY] spark-class gets syntax error in posix mode

jyu00
authored and
srowen
committed
[SPARK-20495][SQL][CORE] Add StorageLevel to cacheTable API

phatak-dev
authored and
cloud-fan
committed
[SPARK-20613] Remove excess quotes in Windows executable

jarrettmeyer
authored and
Felix Cheung
committed
[SPARK-20381][SQL] Add SQL metrics of numOutputRows for ObjectHashAggregateExec

Yucai
authored and
gatorsmile
committed
[SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load
zsxwing
committed
[SPARK-20557][SQL] Support for db column type TIMESTAMP WITH TIME ZONE

JannikArndt
authored and
gatorsmile
committed
[SPARK-20616] RuleExecutor logDebug of batch results should show diff to start of batch

juliuszsompolski
authored and
rxin
committed

Commits on May 6, 2017

[SPARK-20614][PROJECT INFRA] Use the same log4j configuration with Jenkins in AppVeyor

HyukjinKwon
authored and
Felix Cheung
committed

Commits on May 7, 2017

[SPARK-20557][SQL] Support JDBC data type Time with Time Zone
gatorsmile
committed
[SPARK-18777][PYTHON][SQL] Return UDF from udf.register

zero323
authored and
gatorsmile
committed
[SPARK-20518][CORE] Supplement the new blockidsuite unit tests

heary-cao
authored and
srowen
committed
[SPARK-20484][MLLIB] Add documentation to ALS code

danielyli
authored and
srowen
committed
[SPARK-7481][BUILD] Add spark-hadoop-cloud module to pull in object store access.

steveloughran
authored and
srowen
committed
[SPARK-20543][SPARKR][FOLLOWUP] Don't skip tests on AppVeyor

felixcheung
authored and
Felix Cheung
committed
[MINOR][SQL][DOCS] Improve unix_timestamp's scaladoc (and typo hunting)

jaceklaskowski
authored and
gatorsmile
committed
[SPARK-20550][SPARKR] R wrapper for Dataset.alias

zero323
authored and
Felix Cheung
committed

Commits on May 8, 2017

[SPARK-16931][PYTHON][SQL] Add Python wrapper for bucketBy

zero323
authored and
cloud-fan
committed
[SPARK-12297][SQL] Hive compatibility for Parquet Timestamps

squito
authored and
ueshin
committed
[SPARK-20626][SPARKR] address date test warning with timezone on windows

felixcheung
authored and
Felix Cheung
committed
[SPARK-20380][SQL] Unable to set/unset table comment property using ALTER TABLE SET/UNSET TBLPROPERTIES ddl

sujith71955
authored and
gatorsmile
committed
[SPARKR][DOC] fix typo in vignettes

Wayne Zhang
authored and
Felix Cheung
committed
[SPARK-20519][SQL][CORE] Modify to prevent some possible runtime exceptions

10110346
authored and
srowen
committed
[SPARK-19956][CORE] Optimize a location order of blocks with topology information

ConeyLiu
authored and
cloud-fan
committed
[SPARK-20596][ML][TEST] Consolidate and improve ALS recommendAll test cases
Nick Pentreath
committed
[SPARK-20621][DEPLOY] Delete deprecated config parameter in 'spark-env.sh'

ConeyLiu
authored and
Marcelo Vanzin
committed
[SPARK-20605][CORE][YARN][MESOS] Deprecate not used AM and executor port configuration

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-20661][SPARKR][TEST] SparkR tableNames() test fails

falaki
authored and
yhuai
committed

Commits on May 9, 2017

[SPARK-20661][SPARKR][TEST][FOLLOWUP] SparkR tableNames() test fails

felixcheung
authored and
Felix Cheung
committed
[SPARK-11968][MLLIB] Optimize MLLIB ALS recommendForAll

Peng
authored and
Nick Pentreath
committed
[SPARK-20587][ML] Improve performance of ML ALS recommendForAll
Nick Pentreath
committed
[SPARK-20615][ML][TEST] SparseVector.argmax throws IndexOutOfBoundsException

Jon McLean
authored and
srowen
committed
[SPARK-20606][ML] ML 2.2 QA: Remove deprecated methods for ML
yanboliang
committed
[SPARK-20667][SQL][TESTS] Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

gatorsmile
authored and
cloud-fan
committed
[SPARK-20311][SQL] Support aliases for table value functions

maropu
authored and
cloud-fan
committed
[SPARK-20355] Add per application spark version on the history server headerpage

Sanket
authored and
Tom Graves
committed
[SPARK-20548][FLAKY-TEST] share one REPL instance among REPL test cases
cloud-fan
committed
[SPARK-20674][SQL] Support registering UserDefinedFunction as named UDF

rxin
authored and
gatorsmile
committed
[SPARK-19876][BUILD] Move Trigger.java to java source hierarchy

srowen
authored and
hvanhovell
committed
[SPARK-20627][PYSPARK] Drop the hadoop distirbution name from the Python version
holdenk
committed
Revert "[SPARK-12297][SQL] Hive compatibility for Parquet Timestamps"
rxin
committed
Revert "[SPARK-20311][SQL] Support aliases for table value functions"
yhuai
committed
[SPARK-20373][SQL][SS] Batch queries with 'Dataset/DataFrame.withWatermark()` does not execute

uncleGen
authored and
zsxwing
committed

Commits on May 10, 2017

[SPARK-17685][SQL] Make SortMergeJoinExec's currentVars is null when calling createJoinKey

wangyum
authored and
hvanhovell
committed
[SPARK-20590][SQL] Use Spark internal datasource if multiples are found for the same shorten name

HyukjinKwon
authored and
cloud-fan
committed
[SPARK-20686][SQL] PropagateEmptyRelation incorrectly handles aggregate without grouping

JoshRosen
authored and
cloud-fan
committed
[SPARK-20670][ML] Simplify FPGrowth transform

YY-OnCall
authored and
Felix Cheung
committed
[SPARK-20668][SQL] Modify ScalaUDF to handle nullability.

ueshin
authored and
gatorsmile
committed
[SPARK-20631][PYTHON][ML] LogisticRegression._checkThresholdConsistency should use values not Params

zero323
authored and
yanboliang
committed
[SPARK-20630][WEB UI] Fixed column visibility in Executor Tab

ajbozarth
authored and
srowen
committed
[SPARK-20637][CORE] Remove mention of old RDD classes from comments

michaelmior
authored and
srowen
committed
[SPARK-20393][WEBU UI] Strengthen Spark to prevent XSS vulnerabilities

n-marion
authored and
srowen
committed
[SPARK-20688][SQL] correctly check analysis for scalar sub-queries
cloud-fan
committed
[SPARK-20678][SQL] Ndv for columns not in filter condition should also be updated

wangzhenhua
authored and
cloud-fan
committed
[MINOR][BUILD] Fix lint-java breaks.

ConeyLiu
authored and
srowen
committed
[SPARK-19447] Remove remaining references to generated rows metric

ala
authored and
hvanhovell
committed
[SPARK-20689][PYSPARK] python doctest leaking bucketed table

felixcheung
authored and
gatorsmile
committed
[SPARK-20685] Fix BatchPythonEvaluation bug in case of single UDF w/ repeated arg.

JoshRosen
authored and
gatorsmile
committed

Commits on May 11, 2017

[SPARK-20606][ML] Revert "[] ML 2.2 QA: Remove deprecated methods for ML"
yanboliang
committed
[SPARK-17029] make toJSON not go through rdd form but operate on dataset always

Robert Kruszewski
authored and
cloud-fan
committed
[SPARK-20569][SQL] RuntimeReplaceable functions should not take extra parameters

cloud-fan
authored and
gatorsmile
committed
[SPARK-20311][SQL] Support aliases for table value functions

maropu
authored and
cloud-fan
committed
[SPARK-20416][SQL] Print UDF names in EXPLAIN

maropu
authored and
gatorsmile
committed
[SPARK-20600][SS] KafkaRelation should be pretty printed in web UI

jaceklaskowski
authored and
zsxwing
committed
[SPARK-20431][SQL] Specify a schema by using a DDL-formatted string

maropu
authored and
gatorsmile
committed

Commits on May 12, 2017

[SPARK-20399][SQL] Add a config to fallback string literal parsing consistent with old sql parser behavior

viirya
authored and
cloud-fan
committed
[SPARK-20665][SQL] Bround" and "Round" function return NULL

10110346
authored and
cloud-fan
committed
[SPARK-20718][SQL] FileSourceScanExec with different filter orders should be the same after canonicalization

wangzhenhua
authored and
cloud-fan
committed
[SPARK-20704][SPARKR] change CRAN test to run single thread

felixcheung
authored and
Felix Cheung
committed
[SPARK-20619][ML] StringIndexer supports multiple ways to order label

Wayne Zhang
authored and
Felix Cheung
committed
[SPARK-20639][SQL] Add single argument support for to_timestamp in SQL with documentation improvement

HyukjinKwon
authored and
cloud-fan
committed
[SPARK-20554][BUILD] Remove usage of scala.language.reflectiveCalls
srowen
committed
[SPARK-17424] Fix unsound substitution bug in ScalaReflection.

rdblue
authored and
cloud-fan
committed
[SPARK-20718][SQL][FOLLOWUP] Fix canonicalization for HiveTableScanExec

wangzhenhua
authored and
cloud-fan
committed
[SPARK-20710][SQL] Support aliases in CUBE/ROLLUP/GROUPING SETS

maropu
authored and
cloud-fan
committed
[SPARK-19951][SQL] Add string concatenate operator || to Spark SQL

maropu
authored and
gatorsmile
committed
[SPARK-20702][CORE] TaskContextImpl.markTaskCompleted should not hide the original error
zsxwing
committed
[SPARK-20714][SS] Fix match error when watermark is set with timeout = no timeout / processing timeout

tdas
authored and
zsxwing
committed
[SPARK-20594][SQL] The staging directory should be a child directory starts with "." to avoid being deleted if we set hive.exec.stagingdir under the table directory.

zuotingbing
authored and
gatorsmile
committed
[SPARK-20719][SQL] Support LIMIT ALL

gatorsmile
authored and
hvanhovell
committed

Commits on May 13, 2017

[SPARK-18772][SQL] Avoid unnecessary conversion try for special floats in JSON

HyukjinKwon
authored and
cloud-fan
committed
respect both gpu and maxgpu

Ji Yan
authored and
Ji Yan
committed
Merge branch 'ji/hard_limit_on_gpu' of https://github.com/yanji84/spark into ji/hard_limit_on_gpu

Ji Yan
authored and
Ji Yan
committed
fix syntax

Ji Yan
authored and
Ji Yan
committed

Commits on May 14, 2017

fix gpu offer

Ji Yan
authored and
Ji Yan
committed
syntax fix

Ji Yan
authored and
Ji Yan
committed

Commits on May 15, 2017

pass all tests

Ji Yan
authored and
Ji Yan
committed