Skip to content

Commit f8b3404

Browse files
committed
Add a comment.
1 parent d503aa2 commit f8b3404

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

python/pyspark/worker.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -253,6 +253,8 @@ def read_udfs(pickleSer, infile, eval_type):
253253
"spark.sql.legacy.execution.pandas.groupedMap.assignColumnsByName", "true")\
254254
.lower() == "true"
255255

256+
# Scalar Pandas UDF handles struct type arguments as pandas DataFrames instead of
257+
# pandas Series. See SPARK-27240.
256258
df_for_struct = eval_type == PythonEvalType.SQL_SCALAR_PANDAS_UDF
257259
ser = ArrowStreamPandasUDFSerializer(timezone, safecheck, assign_cols_by_name,
258260
df_for_struct)

0 commit comments

Comments
 (0)