Skip to content
Closed
Changes from 1 commit
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
19b9a68
Stub implementation and a test
MaxGekk Sep 15, 2018
90832f9
Saving all plans to file
MaxGekk Sep 15, 2018
673ae56
Output attributes
MaxGekk Sep 15, 2018
fbde812
Output whole stage codegen
MaxGekk Sep 15, 2018
dca19d3
Reusing codegenToOutputStream
MaxGekk Sep 15, 2018
66351a0
Code de-duplication
MaxGekk Sep 15, 2018
2ee75bc
Do not truncate fields
MaxGekk Sep 15, 2018
9b2a3e6
Moving the test up because previous one leaved a garbage
MaxGekk Sep 15, 2018
51c196e
Removing string interpolation in the test
MaxGekk Sep 16, 2018
c66a616
Getting Hadoop's conf from session state
MaxGekk Sep 16, 2018
ed57c8e
Using java.io.Writer
MaxGekk Sep 16, 2018
ce2c086
Using java.io.Writer
MaxGekk Sep 16, 2018
37326e2
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Sep 17, 2018
7abf14c
Using StringWriter
MaxGekk Sep 17, 2018
d1188e3
Removing unneeded buffering and flushing
MaxGekk Sep 17, 2018
71ff7d1
Code de-duplication among toString and toFile
MaxGekk Sep 17, 2018
ac94a86
Using StringBuilderWriter and fix tests
MaxGekk Sep 18, 2018
f2906d9
Do not change maxFields so far
MaxGekk Sep 18, 2018
d3fede1
Added tests
MaxGekk Sep 18, 2018
c153838
Using StringBuilderWriter in treeString
MaxGekk Sep 18, 2018
6fe08bf
Propagating numFields to truncatedString
MaxGekk Sep 18, 2018
3324927
Bug fix + test
MaxGekk Sep 18, 2018
d63f862
Bug fix: passing maxFields to simpleString
MaxGekk Sep 18, 2018
24dbbba
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Sep 18, 2018
deb5315
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Sep 24, 2018
7fd88d3
Passing parameters by names
MaxGekk Sep 24, 2018
732707a
Getting file system from file path
MaxGekk Sep 24, 2018
3a133ae
Using the buffered writer
MaxGekk Sep 24, 2018
7452b82
Removing default value for maxFields in simpleString
MaxGekk Sep 24, 2018
4ec5732
Removing unnecessary signature of truncatedString
MaxGekk Sep 24, 2018
be16175
Minor improvement - passing maxFields by name
MaxGekk Sep 25, 2018
90ff7b5
Moving truncatedString out of core
MaxGekk Sep 25, 2018
2ba6624
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Sep 26, 2018
1fcfc23
Adding SQL config to control maximum number of fields
MaxGekk Sep 27, 2018
2bf11fc
Adding Spark Core config to control maximum number of fields
MaxGekk Sep 27, 2018
5e2d3a6
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Sep 27, 2018
bd331c5
Revert indentations
MaxGekk Sep 27, 2018
3cf564b
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Oct 11, 2018
2375064
Making writeOrError multi-line
MaxGekk Oct 11, 2018
8befa13
Removing core config: spark.debug.maxToStringFields
MaxGekk Oct 11, 2018
28795c7
Improving description of spark.sql.debug.maxToStringFields
MaxGekk Oct 11, 2018
a246db4
Limit number of fields in structs too
MaxGekk Oct 11, 2018
d4da29b
Description of simpleString of TreeNode.
MaxGekk Oct 11, 2018
41b57bc
Added description of maxFields param of truncatedString
MaxGekk Oct 11, 2018
28cce2e
Fix typo
MaxGekk Oct 11, 2018
e4567cb
Passing maxField
MaxGekk Oct 11, 2018
9b72104
Fix for the warning
MaxGekk Oct 11, 2018
9f1d11d
Merge branch 'master' into plan-to-file
MaxGekk Oct 12, 2018
76f4248
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Oct 31, 2018
f7de26d
Merge remote-tracking branch 'origin/master' into plan-to-file
MaxGekk Nov 5, 2018
bda6ac2
Merge branch 'master' into plan-to-file
MaxGekk Nov 5, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Passing parameters by names
  • Loading branch information
MaxGekk committed Sep 24, 2018
commit 7fd88d3367b04ee8b9187db361094b6fae8c7729
Original file line number Diff line number Diff line change
Expand Up @@ -398,7 +398,14 @@ case class InputAdapter(child: SparkPlan) extends UnaryExecNode with CodegenSupp
prefix: String = "",
addSuffix: Boolean = false,
maxFields: Option[Int]): Unit = {
child.generateTreeString(depth, lastChildren, writer, verbose, "", false, maxFields)
child.generateTreeString(
depth,
lastChildren,
writer,
verbose,
prefix = "",
addSuffix = false,
maxFields)
}

override def needCopyResult: Boolean = false
Expand Down Expand Up @@ -680,8 +687,8 @@ case class WholeStageCodegenExec(child: SparkPlan)(val codegenStageId: Int)
lastChildren,
writer,
verbose,
s"*($codegenStageId) ",
false,
prefix = s"*($codegenStageId) ",
addSuffix = false,
maxFields)
}

Expand Down