[SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions#24006

Closed

Ngone51 wants to merge 716 commits intoapache:masterfrom

Ngone51:dev-23433-25250-branch-2.3

This pull request is big! We're only showing the most recent 250 commits

Commits on May 24, 2018

[SPARK-24364][SS] Prevent InMemoryFileIndex from failing if file path doesn't exist
HyukjinKwon
committed
[SPARK-24230][SQL] Fix SpecificParquetRecordReaderBase with dictionary filters.

rdblue
authored and
cloud-fan
committed
[SPARK-24378][SQL] Fix date_trunc function incorrect examples

wangyum
authored and
HyukjinKwon
committed

Commits on May 25, 2018

[MINOR] Add port SSL config in toString and scaladoc

mgaido91
authored and
Marcelo Vanzin
committed

Commits on May 26, 2018

[SPARK-19112][CORE][FOLLOW-UP] Add missing shortCompressionCodecNames to configuration.

wangyum
authored and
HyukjinKwon
committed

Commits on May 28, 2018

Commits on May 29, 2018

[SPARK-19613][SS][TEST] Random.nextString is not safe for directory namePrefix

dongjoon-hyun
authored and
HyukjinKwon
committed
[SPARK-23991][DSTREAMS] Fix data loss when WAL write fails in allocateBlocksToBatch

gaborgsomogyi
authored and
jerryshao
committed

Commits on May 30, 2018

[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set

maropu
authored and
cloud-fan
committed
[SPARK-23754][BRANCH-2.3][PYTHON] Re-raising StopIteration in client code

e-dorigatti
authored and
HyukjinKwon
committed
[SPARK-24384][PYTHON][SPARK SUBMIT] Add .py files correctly into PythonRunner in submit with client mode in spark-submit

HyukjinKwon
authored and
Marcelo Vanzin
committed

Commits on May 31, 2018

[WEBUI] Avoid possibility of script in query param keys

srowen
authored and
Marcelo Vanzin
committed
[SPARK-24414][UI] Calculate the correct number of tasks for a stage.
Marcelo Vanzin
committed

Commits on Jun 4, 2018

[SPARK-24455][CORE] fix typo in TaskSchedulerImpl comment

xueyu
authored and
HyukjinKwon
committed
[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set

cloud-fan
authored and
gatorsmile
committed

Commits on Jun 9, 2018

[SPARK-24468][SQL] Handle negative scale when adjusting precision for decimal operations

mgaido91
authored and
cloud-fan
committed

Commits on Jun 12, 2018

[SPARK-23732][DOCS] Fix source links in generated scaladoc.

Marcelo Vanzin
authored and
HyukjinKwon
committed
[SPARK-24502][SQL] flaky test: UnsafeRowSerializerSuite
cloud-fan
committed
[SPARK-24531][TESTS] Remove version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite

mgaido91
authored and
gatorsmile
committed
[SPARK-24506][UI] Add UI filters to tabs added after binding

mgaido91
authored and
Marcelo Vanzin
committed

Commits on Jun 13, 2018

[SPARK-23754][PYTHON][FOLLOWUP][BACKPORT-2.3] Move UDF stop iteration wrapping from driver to executor

e-dorigatti
authored and
HyukjinKwon
committed

Commits on Jun 14, 2018

[MINOR][CORE][TEST] Remove unnecessary sort in UnsafeInMemorySorterSuite

jiangxb1987
authored and
HyukjinKwon
committed
[SPARK-24495][SQL] EnsureRequirement returns wrong plan when reordering equal keys

mgaido91
authored and
gatorsmile
committed

Commits on Jun 15, 2018

[PYTHON] Fix typo in serializer exception

rberenguel
authored and
HyukjinKwon
committed
revert [SPARK-21743][SQL] top-most limit should not cause memory leak

cloud-fan
authored and
hvanhovell
committed
[SPARK-24531][TESTS] Replace 2.3.0 version with 2.3.1

mgaido91
authored and
Marcelo Vanzin
committed
[SPARK-24452][SQL][CORE] Avoid possible overflow in int add or multiple

kiszk
authored and
cloud-fan
committed

Commits on Jun 16, 2018

[SPARK-24216][SQL] Spark TypedAggregateExpression uses getSimpleName that is not safe in scala

Fangshi Li
authored and
cloud-fan
committed

Commits on Jun 18, 2018

Fix issue in 'docker-image-tool.sh'

fabriziocucci
authored and
mccheah
committed

Commits on Jun 19, 2018

Commits on Jun 20, 2018

[SPARK-24578][CORE] Cap sub-region's size of returned nio buffer

WenboZhao
authored and
zsxwing
committed

Commits on Jun 21, 2018

[SPARK-24589][CORE] Correctly identify tasks in output commit coordinator.

Marcelo Vanzin
authored and
tgravescs
committed
[SPARK-24588][SS] streaming join should require HashClusteredPartitioning from children

cloud-fan
authored and
gatorsmile
committed

Commits on Jun 25, 2018

[SPARK-24552][CORE][SQL][BRANCH-2.3] Use unique id instead of attempt number for writes .
Marcelo Vanzin
committed

Commits on Jun 27, 2018

[SPARK-24613][SQL] Cache with UDF could not be matched with subsequent dependent caches

maryannxue
authored and
gatorsmile
committed

Commits on Jun 28, 2018

[SPARK-24603][SQL] Fix findTightestCommonType reference in comments

Fokko Driesprong
authored and
HyukjinKwon
committed

Commits on Jun 30, 2018

Commits on Jul 2, 2018

[SPARK-24507][DOCUMENTATION] Update streaming guide

rekhajoshm
authored and
HyukjinKwon
committed

Commits on Jul 3, 2018

[SPARK-24385][SQL] Resolve self-join condition ambiguity for EqualNullSafe

mgaido91
authored and
cloud-fan
committed

Commits on Jul 6, 2018

[SPARK-24535][SPARKR] fix tests on java check error

felixcheung
authored and
Felix Cheung
committed

Commits on Jul 7, 2018

[SPARK-24739][PYTHON] Make PySpark compatible with Python 3.7
HyukjinKwon
committed

Commits on Jul 8, 2018

Commits on Jul 13, 2018

[SPARK-24781][SQL] Using a reference from Dataset in Filter/Sort might not work

viirya
authored and
gatorsmile
committed

Commits on Jul 15, 2018

Commits on Jul 16, 2018

[SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

srowen
authored and
HyukjinKwon
committed

Commits on Jul 17, 2018

[SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive
srowen
committed

Commits on Jul 18, 2018

[SPARK-24677][CORE] Avoid NoSuchElementException from MedianHeap

cxzl25
authored and
tgravescs
committed

Commits on Jul 19, 2018

[SPARK-24755][CORE] Executor loss can cause task to not be resubmitted

Hieu Huynh
authored and
tgravescs
committed

Commits on Jul 20, 2018

[SPARK-23731][SQL] Make FileSourceScanExec canonicalizable after being (de)serialized

HyukjinKwon
authored and
cloud-fan
committed

Commits on Jul 21, 2018

[SPARK-24879][SQL] Fix NPE in Hive partition pruning filter pushdown

PenguinToast
authored and
gatorsmile
committed

Commits on Jul 23, 2018

[SQL][HIVE] Correct an assert message in function makeRDDForTable

SongYadong
authored and
HyukjinKwon
committed

Commits on Jul 24, 2018

[SPARK-22499][FOLLOWUP][SQL] Reduce input string expressions for Least and Greatest to reduce time in its test
HyukjinKwon
committed

Commits on Jul 25, 2018

[SPARK-24891][SQL] Fix HandleNullInputsForUDF rule

maryannxue
authored and
gatorsmile
committed
[SPARK-24891][FOLLOWUP][HOT-FIX][2.3] Fix the Compilation Errors

gatorsmile
authored and
HyukjinKwon
committed

Commits on Jul 26, 2018

[SPARK-24867][SQL] Add AnalysisBarrier to DataFrameWriter
gatorsmile
committed

Commits on Jul 27, 2018

[SPARK-24927][BUILD][BRANCH-2.3] The scope of snappy-java cannot be "provided"

liancheng
authored and
gatorsmile
committed

Commits on Jul 29, 2018

[SPARK-24809][SQL] Serializing LongToUnsafeRowMap in executor may result in data error

liutang123
authored and
gatorsmile
committed

Commits on Jul 30, 2018

Commits on Jul 31, 2018

[SPARK-24536] Validate that an evaluated limit clause cannot be null

mauropalsgraaf
authored and
gatorsmile
committed

Commits on Aug 1, 2018

[SPARK-24976][PYTHON] Allow None for Decimal type conversion (specific to PyArrow 0.9.0)

HyukjinKwon
authored and
BryanCutler
committed

Commits on Aug 3, 2018

[PYSPARK] Updates to Accumulators

LucaCanali
authored and
squito
committed

Commits on Aug 4, 2018

[SPARK-24987][SS] - Fix Kafka consumer leak when no new offsets for TopicPartition

Yuval Itzchakov
authored and
koeninger
committed
[SPARK-25015][BUILD] Update Hadoop 2.7 to 2.7.7
srowen
committed

Commits on Aug 8, 2018

[SPARK-24948][SHS][BACKPORT-2.3] Delegate check access permissions to the file system

mgaido91
authored and
jerryshao
committed

Commits on Aug 9, 2018

Commits on Aug 13, 2018

Commits on Aug 18, 2018

[MINOR][DOC][SQL] use one line for annotation arg value

mengxr
authored and
HyukjinKwon
committed

Commits on Aug 20, 2018

[SPARK-25144][SQL][TEST][BRANCH-2.3] Free aggregate map when task ends

authored and
HyukjinKwon
committed
[DOCS] Fixed NDCG formula issues

yueguoguo
authored and
srowen
committed

Commits on Aug 21, 2018

Commits on Aug 24, 2018

Commits on Aug 27, 2018

[SPARK-25164][SQL] Avoid rebuilding column and path list for each column in parquet reader

bersprockets
authored and
gatorsmile
committed

Commits on Aug 28, 2018

[SPARK-24704][WEBUI] Fix the order of stages in the DAG graph

stanzhai
authored and
Marcelo Vanzin
committed

Commits on Aug 30, 2018

[SPARK-25273][DOC] How to install testthat 1.0.2

MaxGekk
authored and
HyukjinKwon
committed
[SPARK-24909][CORE] Always unregister pending partition on task completion.

Thomas Graves
authored and
tgravescs
committed

Commits on Sep 5, 2018

[SPARK-25231] Fix synchronization of executor heartbeat receiver in TaskSchedulerImpl

pgandhi
authored and
tgravescs
committed

Commits on Sep 6, 2018

[SPARK-25313][BRANCH-2.3][SQL] Fix regression in FileFormatWriter output names

gengliangwang
authored and
cloud-fan
committed
[SPARK-25072][PYSPARK] Forbid extra value for custom Row

authored and
BryanCutler
committed

Commits on Sep 7, 2018

Commits on Sep 9, 2018

[SPARK-25368][SQL] Incorrect predicate pushdown returns wrong result

wangyum
authored and
gatorsmile
committed

Commits on Sep 10, 2018

Revert "[SPARK-25072][PYSPARK] Forbid extra value for custom Row"
gatorsmile
committed

Commits on Sep 11, 2018

[SPARK-25313][SQL][FOLLOW-UP][BACKPORT-2.3] Fix InsertIntoHiveDirCommand output schema in Parquet issue

wangyum
authored and
dongjoon-hyun
committed
[SPARK-24889][CORE] Update block info when unpersist rdds

viirya
authored and
Marcelo Vanzin
committed

Commits on Sep 12, 2018

[SPARK-25371][SQL][BACKPORT-2.3] struct() should allow being called with 0 args

mgaido91
authored and
cloud-fan
committed
[SPARK-25402][SQL] Null handling in BooleanSimplification

gatorsmile
authored and
cloud-fan
committed

Commits on Sep 13, 2018

Commits on Sep 16, 2018

Commits on Sep 20, 2018

Commits on Sep 24, 2018

[SPARK-25502][CORE][WEBUI] Empty Page when page number exceeds the reatinedTask size.

shahidki31
authored and
Marcelo Vanzin
committed
[SPARKR] Match pyspark features in SparkR communication protocol
HyukjinKwon
committed

Commits on Sep 25, 2018

[SPARK-25503][CORE][WEBUI] Total task message in stage page is ambiguous

shahidki31
authored and
dongjoon-hyun
committed

Commits on Sep 26, 2018

[SPARK-25425][SQL][BACKPORT-2.3] Extra options should override session options in DataSource V2

MaxGekk
authored and
dongjoon-hyun
committed
[SPARK-25509][CORE] Windows doesn't support POSIX permissions

Rong Tang
authored and
srowen
committed

Commits on Sep 27, 2018

[SPARK-25454][SQL] add a new config for picking minimum precision for integral literals

cloud-fan
authored and
gatorsmile
committed
[SPARK-25536][CORE] metric value for METRIC_OUTPUT_RECORDS_WRITTEN is incorrect

shahidki31
authored and
dongjoon-hyun
committed
[SPARK-25533][CORE][WEBUI] AppSummary should hold the information about succeeded Jobs and completed stages only

shahidki31
authored and
Marcelo Vanzin
committed

Commits on Sep 29, 2018

[SPARK-25570][SQL][TEST] Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

dongjoon-hyun
authored and
HyukjinKwon
committed

Commits on Sep 30, 2018

[SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator

zsxwing
authored and
gatorsmile
committed
[CORE][MINOR] Fix obvious error and compiling for Scala 2.12.7

da-liii
authored and
srowen
committed

Commits on Oct 3, 2018

[SPARK-25583][DOC][BRANCH-2.3] Add history-server related configuration in the documentation.

shahidki31
authored and
dongjoon-hyun
committed

Commits on Oct 11, 2018

[SPARK-25674][SQL] If the records are incremented by more than 1 at a time,the number of bytes might rarely ever get updated

10110346
authored and
srowen
committed

Commits on Oct 13, 2018

Commits on Oct 14, 2018

[SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataSourceCommandSuite
dongjoon-hyun
committed

Commits on Oct 16, 2018

[SPARK-25714][BACKPORT-2.3] Fix Null Handling in the Optimizer rule BooleanSimplification

gatorsmile
authored and
cloud-fan
committed
[SPARK-25674][FOLLOW-UP] Update the stats for each ColumnarBatch

gatorsmile
authored and
srowen
committed

Commits on Oct 18, 2018

[SPARK-21402][SQL][BACKPORT-2.3] Fix java array of structs deserialization

Vladimir Kuriatkov
authored and
dongjoon-hyun
committed

Commits on Oct 19, 2018

[SPARK-25768][SQL] fix constant argument expecting UDAFs

peter-toth
authored and
cloud-fan
committed
fix security issue of zinc
cloud-fan
committed

Commits on Oct 20, 2018

[DOC][MINOR] Fix minor error in the code of graphx guide

WeichenXu123
authored and
dongjoon-hyun
committed

Commits on Oct 22, 2018

Commits on Oct 26, 2018

[SPARK-25822][PYSPARK] Fix a race condition when releasing a Python worker

zsxwing
authored and
ueshin
committed
[SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown

shaneknapp
authored and
srowen
committed

Commits on Oct 29, 2018

[SPARK-25816][SQL] Fix attribute resolution in nested extractors

peter-toth
authored and
gatorsmile
committed
[SPARK-25797][SQL][DOCS][BACKPORT-2.3] Add migration doc for solving issues caused by view canonicalization approach change

seancxmao
authored and
dongjoon-hyun
committed
[DOC] Fix doc for spark.sql.parquet.recordLevelFilter.enabled

bersprockets
authored and
cloud-fan
committed

Commits on Nov 1, 2018

[SPARK-25837][CORE] Fix potential slowdown in AppStatusListener when cleaning up stages

patrickbrownsync
authored and
Marcelo Vanzin
committed

Commits on Nov 3, 2018

[SPARK-25933][DOCUMENTATION] Fix pstats.Stats() reference in configuration.md

Alex Hagerman
authored and
srowen
committed

Commits on Nov 15, 2018

[SPARK-26011][SPARK-SUBMIT] Yarn mode pyspark app without python main resource does not honor "spark.jars.packages"

shanyu
authored and
srowen
committed

Commits on Nov 16, 2018

[SPARK-25934][MESOS] Don't propagate SPARK_CONF_DIR from spark submit

mpmolek
authored and
srowen
committed

Commits on Nov 17, 2018

[MINOR][SQL] Fix typo in CTAS plan database string

dongjoon-hyun
authored and
HyukjinKwon
committed

Commits on Nov 20, 2018

[SPARK-26084][SQL] Fixes unresolved AggregateExpression.references exception

ssimeonov
authored and
hvanhovell
committed

Commits on Nov 21, 2018

[SPARK-26109][WEBUI] Duration in the task summary metrics table and the task table are different

shahidki31
authored and
srowen
committed

Commits on Nov 22, 2018

[SPARK-26118][BACKPORT-2.3][WEB UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize

attilapiros
authored and
dongjoon-hyun
committed

Commits on Nov 24, 2018

[SPARK-25786][CORE] If the ByteBuffer.hasArray is false , it will throw UnsupportedOperationException for Kryo

10110346
authored and
srowen
committed

Commits on Nov 28, 2018

[SPARK-26137][CORE] Use Java system property "file.separator" inste…

Mark Pavey
authored and
srowen
committed

Commits on Nov 29, 2018

[SPARK-26211][SQL] Fix InSet for binary, and struct and array with null.

ueshin
authored and
cloud-fan
committed

Commits on Nov 30, 2018

[SPARK-26201] Fix python broadcast with encryption

schintap
authored and
tgravescs
committed

Commits on Dec 1, 2018

[MINOR][DOC] Correct some document description errors

10110346
authored and
srowen
committed

Commits on Dec 3, 2018

[SPARK-26198][SQL] Fix Metadata serialize null values throw NPE

wangyum
authored and
srowen
committed

Commits on Dec 5, 2018

[SPARK-26233][SQL][BACKPORT-2.3] CheckOverflow when encoding a decimal value

mgaido91
authored and
dongjoon-hyun
committed

Commits on Dec 10, 2018

[SPARK-26307][SQL] Fix CTAS when INSERT a partitioned table using Hive serde

gatorsmile
authored and
cloud-fan
committed

Commits on Dec 14, 2018

[SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

xuanyuanking
authored and
dongjoon-hyun
committed

Commits on Dec 15, 2018

[SPARK-26315][PYSPARK] auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

Jing Chen He
authored and
srowen
committed

Commits on Dec 17, 2018

[SPARK-26352][SQL] join reorder should not change the order of output attributes

rednaxelafx
authored and
cloud-fan
committed
[SPARK-26352][SQL][FOLLOWUP-2.3] Fix missing sameOutput in branch-2.3

rednaxelafx
authored and
cloud-fan
committed

Commits on Dec 18, 2018

[SPARK-26316][SPARK-21052][BRANCH-2.3] Revert hash join metrics in that causes performance degradation

JkSelf
authored and
dongjoon-hyun
committed
[SPARK-26394][CORE] Fix annotation error for Utils.timeStringAsMs

Jackey Lee
authored and
srowen
committed

Commits on Dec 20, 2018

[SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error

caneGuy
authored and
srowen
committed

Commits on Dec 21, 2018

Commits on Dec 22, 2018

Revert "[SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False"
dongjoon-hyun
committed

Commits on Dec 23, 2018

[SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

mgaido91
authored and
dongjoon-hyun
committed

Commits on Dec 28, 2018

[SPARK-26444][WEBUI] Stage color doesn't change with it's status

seancxmao
authored and
srowen
committed

Commits on Dec 29, 2018

[SPARK-26496][SS][TEST] Avoid to use Random.nextString in StreamingInnerJoinSuite

HyukjinKwon
authored and
dongjoon-hyun
committed

Commits on Jan 3, 2019

[SPARK-25591][PYSPARK][SQL][BRANCH-2.3] Avoid overwriting deserialized accumulator

viirya
authored and
HyukjinKwon
committed
[SPARK-26019][PYSPARK] Allow insecure py4j gateways

squito
authored and
HyukjinKwon
committed

Commits on Jan 4, 2019

[MINOR][NETWORK][TEST] Fix TransportFrameDecoderSuite to use ByteBuf instead of ByteBuffer
dongjoon-hyun
committed

Commits on Jan 5, 2019

[SPARK-26078][SQL][BACKPORT-2.3] Dedup self-join attributes on IN subqueries

mgaido91
authored and
dongjoon-hyun
committed
[SPARK-26545] Fix typo in EqualNullSafe's truth table comment

rednaxelafx
authored and
gatorsmile
committed

Commits on Jan 6, 2019

[SPARK-26537][BUILD][BRANCH-2.3] change git-wip-us to gitbox

shaneknapp
authored and
dongjoon-hyun
committed

Commits on Jan 7, 2019

Commits on Jan 11, 2019

[SPARK-26576][SQL] Broadcast hint not applied to partitioned table

jzhuge
authored and
gatorsmile
committed

Commits on Jan 12, 2019

Commits on Jan 13, 2019

[SPARK-26010][R] fix vignette eval with Java 11

felixcheung
authored and
maropu
committed
[SPARK-25572][SPARKR] test only if not cran

felixcheung
authored and
maropu
committed

Commits on Jan 16, 2019

Commits on Jan 17, 2019

[SPARK-26638][PYSPARK][ML] Pyspark vector classes always return error for unary negation
srowen
committed

Commits on Jan 19, 2019

[SPARK-24740][PYTHON][ML][BACKPORT-2.3] Make PySpark's tests compatible with NumPy 1.14+

HyukjinKwon
authored and
maropu
committed

Commits on Jan 21, 2019

[SPARK-26351][MLLIB] Update doc and minor correction in the mllib evaluation metrics

shahidki31
authored and
srowen
committed

Commits on Jan 22, 2019

[SPARK-26665][CORE] Fix a bug that BlockTransferService.fetchBlockSync may hang forever
zsxwing
committed

Commits on Jan 23, 2019

[SPARK-26228][MLLIB] OOM issue encountered when computing Gramian matrix
srowen
committed

Commits on Jan 24, 2019

[SPARK-26706][SQL] Fix `illegalNumericPrecedence` for ByteType

aokolnychyi
authored and
dbtsai
committed
[SPARK-26706][SQL][FOLLOWUP] Fix `illegalNumericPrecedence` for ByteType
dbtsai
committed
[SPARK-26682][SQL] Use taskAttemptID instead of attemptNumber for Had…

rdblue
authored and
Marcelo Vanzin
committed

Commits on Jan 25, 2019

[SPARK-26680][SPARK-25767][SQL][BACKPORT-2.3] Eagerly create inputVars while conditions are appropriate

bersprockets
authored and
dongjoon-hyun
committed

Commits on Jan 26, 2019

[SPARK-26709][SQL][BRANCH-2.3] OptimizeMetadataOnlyQuery does not handle empty records correctly

gengliangwang
authored and
maropu
committed

Commits on Jan 28, 2019

[SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

HeartSaVioR
and
dongjoon-hyun
committed

Commits on Jan 30, 2019

[SPARK-26732][CORE][TEST] Wait for listener bus to process events in SparkContextInfoSuite.

Marcelo Vanzin
authored and
maropu
committed
[SPARK-26718][SS][BRANCH-2.3] Fixed integer overflow in SS kafka rateLimit calculation

ryne.yang
authored and
dongjoon-hyun
committed

Commits on Jan 31, 2019

[SPARK-26726] Synchronize the amount of memory used by the broadcast variable to the UI display

httfighter
authored and
Marcelo Vanzin
committed
[SPARK-26757][GRAPHX] Return 0 for `count` on empty Edge/Vertex RDDs

huonw
authored and
srowen
committed

Commits on Feb 1, 2019

[SPARK-26806][SS] EventTimeStats.merge should handle zeros correctly
zsxwing
committed

Commits on Feb 3, 2019

[SPARK-26751][SQL] Fix memory leak when statement run in background and throw exception which is not HiveSQLException

caneGuy
authored and
srowen
committed

Commits on Feb 4, 2019

Commits on Feb 5, 2019

[SPARK-26758][CORE] Idle Executors are not getting killed after spark.dynamiAllocation.executorIdleTimeout value

sandeep-katta
authored and
srowen
committed

Commits on Feb 6, 2019

[SPARK-26734][STREAMING] Fix StackOverflowError with large block queue

rlodge
authored and
srowen
committed

Commits on Feb 7, 2019

[SPARK-26082][MESOS] Fix mesos fetch cache config name

mwlon
authored and
dongjoon-hyun
committed
[SPARK-26082][MESOS][FOLLOWUP] Add UT on fetcher cache option on MesosClusterScheduler

HeartSaVioR
authored and
dongjoon-hyun
committed

Commits on Feb 9, 2019

Revert "[SPARK-26082][MESOS][FOLLOWUP] Add UT on fetcher cache option on MesosClusterScheduler"
dongjoon-hyun
committed

Commits on Feb 10, 2019

[SPARK-26082][MESOS][FOLLOWUP][BRANCH-2.3] Add UT on fetcher cache option on MesosClusterScheduler

HeartSaVioR
authored and
dongjoon-hyun
committed

Commits on Feb 12, 2019

[SPARK-23408][SS][BRANCH-2.3] Synchronize successive AddData actions in Streaming*JoinSuite

authored and
srowen
committed

Commits on Feb 13, 2019

[SPARK-23491][SS] Remove explicit job cancellation from ContinuousExecution reconfiguring

jose-torres
authored and
maropu
committed
[SPARK-23416][SS] Add a specific stop method for ContinuousExecution.

jose-torres
authored and
maropu
committed

Commits on Feb 14, 2019

[SPARK-26572][SQL] fix aggregate codegen result evaluation

peter-toth
authored and
cloud-fan
committed

Commits on Feb 18, 2019

[SPARK-26897][SQL][TEST][FOLLOW-UP] Remove workaround for 2.2.0 and 2.1.x in HiveExternalCatalogVersionsSuite

maropu
authored and
HyukjinKwon
committed

Commits on Feb 19, 2019

[SPARK-26897][SQL][TEST][BRANCH-2.3] Update Spark 2.3.x testing from HiveExternalCatalogVersionsSuite

maropu
authored and
srowen
committed
[SPARK-26873][SQL] Use a consistent timestamp to build Hadoop Job IDs.

rdblue
authored and
Marcelo Vanzin
committed

Commits on Feb 21, 2019

[R][BACKPORT-2.4] update package description

felixcheung
authored and
Felix Cheung
committed

Commits on Feb 22, 2019

Commits on Feb 25, 2019

[MINOR][BUILD] Update all checkstyle dtd to use "https://checkstyle.org"

HeartSaVioR
authored and
Marcelo Vanzin
committed

Commits on Mar 5, 2019

[MINOR][DOCS] Clarify that Spark apps should mark Spark as a 'provided' dependency, not package it
srowen
committed

Commits on Mar 6, 2019

[SPARK-24669][SQL] Invalidate tables in case of DROP DATABASE CASCADE

Udbhav30
authored and
dongjoon-hyun
committed
[SPARK-27065][CORE] avoid more than one active task set managers for a stage

cloud-fan
authored and
squito
committed

Commits on Mar 7, 2019