Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 18, 2025

• [SPARK-53323][PYTHON][CONNECT] Enable Spark Connect tests for df.asTable() in Arrow UDTF

  Show description for 1795306
  

  shujingyang-db

  authored and

  zhengruifeng

  committed
  1795306

  Copy full SHA for 1795306

• [SPARK-53630][PYTHON][DOCS][TESTS] Reenable doctest for `Dataframe.freqItems`

  Show description for 1ec647e
  zhengruifeng

  committed
  1ec647e

  Copy full SHA for 1ec647e

• [MINOR][TESTS] Restore classic-only python tests

  Show description for b87f6d1
  zhengruifeng

  committed
  b87f6d1

  Copy full SHA for b87f6d1

• [SPARK-53355][PYTHON][SQL] fix numpy 1.x repr in type tests

  Show description for 9d23f2f
  

  benhurdelhey

  authored and

  zhengruifeng

  committed
  9d23f2f

  Copy full SHA for 9d23f2f

• [SPARK-53619][PYTHON][DOCS][TESTS] Enable doctests for toArrow/toPandas/mapInArrow/mapInPandas

  Show description for 551e7f2
  zhengruifeng

  committed
  551e7f2

  Copy full SHA for 551e7f2

Commits on Sep 17, 2025

• [SPARK-53387][PYTHON] Add support for Arrow UDTFs with PARTITION BY

  Show description for 3080e61
  allisonwang-db

  committed
  3080e61

  Copy full SHA for 3080e61

• [SPARK-53507][CONNECT] Add breaking change info to errors

  Show description for 010d36f
  

  imarkowitz

  authored and

  HyukjinKwon

  committed
  010d36f

  Copy full SHA for 010d36f

• [SPARK-52659][SQL] Misleading modulo error message in ansi mode

  Show description for f490471
  

  2 peopleauthored and

  gengliangwang

  committed
  f490471

  Copy full SHA for f490471

• [SPARK-53620][CORE] SparkSubmit should print stacktrace when exitFn is called

  Show description for 3990b0f
  

  pan3793

  authored and

  dongjoon-hyun

  committed
  3990b0f

  Copy full SHA for 3990b0f

• [SPARK-53438][CONNECT][SQL] Use CatalystConverter in LiteralExpressionProtoConverter

  Show description for 87a71fa
  

  heyihong

  authored and

  cloud-fan

  committed
  87a71fa

  Copy full SHA for 87a71fa

• [SPARK-53372][SDP] SDP End to End Testing Suite

  Show description for 79a9283
  

  2 peopleauthored and

  cloud-fan

  committed
  79a9283

  Copy full SHA for 79a9283

• [SPARK-53606][DOCS] Fix MapInPandas/MapInArrow examples with barrier

  Show description for e08c15b
  zhengruifeng

  committed
  e08c15b

  Copy full SHA for e08c15b

• [SPARK-53546][TESTS][FOLLOW-UP] Fix nested array schema evolution and style for InMemoryBaseTable

  Show description for f57a473
  

  szehon-ho

  authored and

  cloud-fan

  committed
  f57a473

  Copy full SHA for f57a473

• [SPARK-52991][SQL][FOLLOW-UP] Revise `MergeIntoTable` to use `lazy val` and add a new test

  Show description for 33e40b7
  

  szehon-ho

  authored and

  dongjoon-hyun

  committed
  33e40b7

  Copy full SHA for 33e40b7

• [SPARK-53604][INFRA] Temporarily increase PySpark job execution time to 150 minutes

  Show description for 067f295
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  067f295

  Copy full SHA for 067f295

• [MINOR][DOCS] Update the `See Also` section for time functions

  Show description for aaf9308
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  aaf9308

  Copy full SHA for aaf9308

• [SPARK-53603][BUILD] Upgrade Checkstyle to 11.0.1

  Show description for 5d1ad61
  dongjoon-hyun

  committed
  5d1ad61

  Copy full SHA for 5d1ad61

• [SPARK-53594][PYTHON] Make arrow UDF respect user-specified eval type

  Show description for 3d87de3
  zhengruifeng

  committed
  3d87de3

  Copy full SHA for 3d87de3

• [SPARK-53602][PYTHON] Profile dump improvement and profiler doc fix

  Show description for 53a330b
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  53a330b

  Copy full SHA for 53a330b

Commits on Sep 16, 2025

• [SPARK-53581][CORE] Fix potential thread-safety issue for mapTaskIds.add()

  Show description for 78aba00
  

  Ngone51

  authored and

  dongjoon-hyun

  committed
  78aba00

  Copy full SHA for 78aba00

• [SPARK-53599][BUILD] Upgrade `Netty` to 4.1.127.Final

  Show description for 4aa934e
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  4aa934e

  Copy full SHA for 4aa934e

• [SPARK-53601][INFRA] Use Java 25 instead of 25-ea

  Show description for 54e69ba
  dongjoon-hyun

  committed
  54e69ba

  Copy full SHA for 54e69ba

• [SPARK-53600][SQL] Revise `SessionHolder` last access time log message

  Show description for 7781ec2
  dongjoon-hyun

  committed
  7781ec2

  Copy full SHA for 7781ec2

• [MINOR][PYTHON][DOCS] Correct the examples of `toPandas` and `toArrow`

  Show description for 56fa1e9
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  56fa1e9

  Copy full SHA for 56fa1e9

• [SPARK-53559][SQL][CATALYST] Fix HLL sketch updates to use raw collation key bytes

  Show description for 86d310b
  

  2 peopleauthored and

  dtenedor

  committed
  86d310b

  Copy full SHA for 86d310b

• Fix: SparkML-connect can't load SparkML (legacy mode) saved model

  Show description for f03c644
  WeichenXu123

  committed
  f03c644

  Copy full SHA for f03c644

• [SPARK-53582][SQL] Extend `isExtractable` so it can be applied on `UnresolvedExtractValue`

  Show description for dbbb54d
  

  mihailotim-db

  authored and

  cloud-fan

  committed
  dbbb54d

  Copy full SHA for dbbb54d

• [MINOR][PYTHON][DOCS] Update the doctests to check the default column names

  Show description for 24139be
  zhengruifeng

  committed
  24139be

  Copy full SHA for 24139be

• [SPARK-53584][PYTHON] Improve process_column_param validation and column parameter docstring

  Show description for fa2f7d5
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  fa2f7d5

  Copy full SHA for fa2f7d5

Commits on Sep 15, 2025

• [SPARK-53590][BUILD] Add `huaweicloud-provided` profile

  Show description for e3dce42
  dongjoon-hyun

  committed
  e3dce42

  Copy full SHA for e3dce42

• [SPARK-53586][K8S][BUILD] Upgrade `kubernetes-client` to 7.4.0

  Show description for 6c9e750
  dongjoon-hyun

  committed
  6c9e750

  Copy full SHA for 6c9e750

• [SPARK-53577][DOCS] Fix Scaladoc source links for java sources

  Show description for 10b27f3
  

  yaooqinn

  authored and

  HyukjinKwon

  committed
  10b27f3

  Copy full SHA for 10b27f3

• [SPARK-53113][SQL] Support the time type by try_make_timestamp()

  Show description for 8c422f9
  

  uros-db

  authored and

  cloud-fan

  committed
  8c422f9

  Copy full SHA for 8c422f9

• [SPARK-53127][SQL] Enable LIMIT ALL to override recursion row limit

  Show description for 2844705
  

  2 peopleauthored and

  cloud-fan

  committed
  2844705

  Copy full SHA for 2844705

• [SPARK-53572][SQL] Avoid throwing from ExtractValue.isExtractable

  Show description for 10c634f
  

  vladimirg-db

  authored and

  cloud-fan

  committed
  10c634f

  Copy full SHA for 10c634f

Pagination

Previous

Next