Skip to content

[SPARK-32106][SQL] Implement script transform in sql/core #29414

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
AngersZhuuuu wants to merge 16 commits into from
Closed

[SPARK-32106][SQL] Implement script transform in sql/core #29414

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
b4c4b40
[SPARK-32106][SQL] Implement script transform in sql/core
AngersZhuuuu Aug 12, 2020
c58729b
Update SparkSqlParser.scala
AngersZhuuuu Aug 12, 2020
fc5bbce
follow comment
AngersZhuuuu Aug 13, 2020
a812333
follow commnet
AngersZhuuuu Aug 13, 2020
fdfc987
follow comment
AngersZhuuuu Aug 13, 2020
5b17cd9
Merge branch 'master' into SPARK-32106-MINOR
AngersZhuuuu Aug 24, 2020
dabae9b
fix add UT
AngersZhuuuu Aug 24, 2020
61466f6
Merge branch 'master' into SPARK-32106-MINOR
AngersZhuuuu Oct 26, 2020
d68066e
Update SparkScriptTransformationSuite.scala
AngersZhuuuu Oct 26, 2020
57735bf
Merge branch 'master' into SPARK-32106-MINOR
AngersZhuuuu Nov 13, 2020
3ad44e3
Update SparkSqlParser.scala
AngersZhuuuu Nov 13, 2020
5b41fbc
Update transform.sql.out
AngersZhuuuu Nov 14, 2020
63bdb53
Merge branch 'master' into SPARK-32106-MINOR
AngersZhuuuu Dec 9, 2020
d3c65d4
Update SparkSqlParser.scala
AngersZhuuuu Dec 9, 2020
4e66417
Merge branch 'master' into SPARK-32106-MINOR
AngersZhuuuu Dec 15, 2020
a10c5a6
Update transform.sql.out
AngersZhuuuu Dec 15, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
follow comment
  • Loading branch information
@AngersZhuuuu
AngersZhuuuu committed Aug 13, 2020
commit fdfc98767c1f82981d49ccc0778c558b049566df
4 changes: 2 additions & 2 deletions sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,8 +33,8 @@ import org.apache.spark.util.CircularBuffer
* @param input the set of expression that should be passed to the script.
* @param script the command that should be executed.
* @param output the attributes that are produced by the script.
* @param child logical plan whose output is transformed
* @param ioschema the wrapper classes of input and output schema properties
* @param child logical plan whose output is transformed.
* @param ioschema the class set that defines how to handle input/output data.
*/
case class SparkScriptTransformationExec(
input: Seq[Expression],
Expand Down
4 changes: 2 additions & 2 deletions ...ive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,8 +45,8 @@ import org.apache.spark.util.{CircularBuffer, Utils}
* @param input the set of expression that should be passed to the script.
* @param script the command that should be executed.
* @param output the attributes that are produced by the script.
* @param child logical plan whose output is transformed
* @param ioschema the wrapper classes of input and output schema properties
* @param child logical plan whose output is transformed.
* @param ioschema the class set that defines how to handle input/output data.
*/
case class HiveScriptTransformationExec(
input: Seq[Expression],
Expand Down