Skip to content

[SPARK-35380][SQL] Loading SparkSessionExtensions from ServiceLoader #32515

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
yaooqinn wants to merge 20 commits into from
Closed

[SPARK-35380][SQL] Loading SparkSessionExtensions from ServiceLoader #32515

Changes from 1 commit
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
baa61a3
[WIP][SPARK-35380][SQL] Loading SparkSessionExtensions from ServiceLo…
yaooqinn May 12, 2021
ec731fc
[WIP][SPARK-35380][SQL] Loading SparkSessionExtensions from ServiceLo…
yaooqinn May 12, 2021
8ab0b79
add tests
yaooqinn May 12, 2021
4e84a6f
avoid API change
yaooqinn May 12, 2021
453ad87
Revert "avoid API change"
yaooqinn May 12, 2021
1aece6a
add doc and example
yaooqinn May 12, 2021
459eab0
indent
yaooqinn May 12, 2021
d5a4037
doc
yaooqinn May 12, 2021
e9b05cd
doc
yaooqinn May 12, 2021
a552759
Revert "doc"
yaooqinn May 12, 2021
c2bb28e
Revert "doc"
yaooqinn May 12, 2021
2784e48
address commnet
yaooqinn May 12, 2021
1918381
address commnet
yaooqinn May 12, 2021
ea2e3b9
address commnet
yaooqinn May 12, 2021
9b5d7c2
typo
yaooqinn May 12, 2021
a79d76e
typo
yaooqinn May 13, 2021
e795f45
Update sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExten…
yaooqinn May 13, 2021
8f1be0e
Update sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExten…
yaooqinn May 13, 2021
ad18acc
fix build
yaooqinn May 13, 2021
b8b54ea
fix doc build
yaooqinn May 13, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
address commnet
  • Loading branch information
@yaooqinn
yaooqinn committed May 12, 2021
commit 19183818843442585ab51e27b5427065d6e4b82d
10 changes: 5 additions & 5 deletions sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExtensions.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,9 @@ import org.apache.spark.sql.execution.{ColumnarRule, SparkPlan}
* extensions.injectResolutionRule { session =>
* ...
* }
* extensions.injectFunction(...)
* extensions.injectParser { (session, parser) =>
* ...
* }
* }
* .getOrCreate()
* }}}
Expand All @@ -72,7 +74,7 @@ import org.apache.spark.sql.execution.{ColumnarRule, SparkPlan}
* .config("spark.sql.extensions", "org.example.MyExtensions,org.example.YourExtensions")
* .getOrCreate()
*
* class MyExtensions extends SparkSessionExtensions => Unit {
* class MyExtensions extends Function1[SparkSessionExtensions, Unit] {
* override def apply(extensions: SparkSessionExtensions): Unit = {
* extensions.injectResolutionRule { session =>
* ...
Expand All @@ -88,9 +90,7 @@ import org.apache.spark.sql.execution.{ColumnarRule, SparkPlan}
* extensions.injectResolutionRule { session =>
* ...
* }
* extensions.injectParser { (session, parser) =>
* ...
* }
* extensions.injectFunction(...)
* }
* }
* }}}
Expand Down