Skip to content

[SPARK-30510][SQL][DOCS] Publicly document Spark SQL configuration options #27459

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nchammas wants to merge 29 commits into from
Closed

[SPARK-30510][SQL][DOCS] Publicly document Spark SQL configuration options #27459

Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
f2bb001
include sql configs from html file
nchammas Feb 4, 2020
f0137f6
generate html table of sql configs
nchammas Feb 4, 2020
a6045f7
example of follow-up that is needed to clean docstrings
nchammas Feb 4, 2020
7742fc1
back to a plain list
nchammas Feb 4, 2020
a3b6d19
style
nchammas Feb 4, 2020
886d01e
python style
nchammas Feb 4, 2020
b80e6f2
catch missed special default values
nchammas Feb 4, 2020
914630f
fix reference
nchammas Feb 4, 2020
a8ad179
tweak create-docs info message
nchammas Feb 5, 2020
e09f890
use markdown via mkdocs
nchammas Feb 5, 2020
851d557
explain why .toArray
nchammas Feb 5, 2020
36fd916
use markdown from within mkdocs
nchammas Feb 5, 2020
6ca51cd
fix config reference + undo ConfigEntry removal
nchammas Feb 5, 2020
43e47bd
explain why weird import
nchammas Feb 6, 2020
1c9aa71
show example html output
nchammas Feb 6, 2020
65c5bb0
unnecessary comment
nchammas Feb 6, 2020
79022e7
docstring -> description
nchammas Feb 6, 2020
aa63cbe
split up sql docs script: API + Config
nchammas Feb 6, 2020
ba8ae9f
move sql-configs.html to root of docs/
nchammas Feb 6, 2020
5310f08
fix documentation around create-docs.sh
nchammas Feb 6, 2020
61b4ac5
unnecessary whitespace
nchammas Feb 6, 2020
679bdac
group imports at beginning
nchammas Feb 6, 2020
8401b6a
check for private configs
nchammas Feb 6, 2020
e48eb34
tweak default formatting
nchammas Feb 7, 2020
3292108
remove check for private configs
nchammas Feb 7, 2020
617a69d
tweak info message from create-docs.sh
nchammas Feb 7, 2020
452bf98
remove dup default
nchammas Feb 7, 2020
4c32cf2
stringify certain defaults so they display right
nchammas Feb 7, 2020
b08bac4
300 -> 5 * 60
nchammas Feb 7, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
explain why weird import
  • Loading branch information
@nchammas
nchammas committed Feb 6, 2020
commit 43e47bdd89bf9ff3b383f28d3d882ae855e6c453
1 change: 1 addition & 0 deletions sql/gen-sql-markdown.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@
from collections import namedtuple
from textwrap import dedent

# To avoid adding a new direct dependency, we import markdown from within mkdocs.
from mkdocs.structure.pages import markdown

ExpressionInfo = namedtuple(
Expand Down