Skip to content

[SPARK-16596] [SQL] Refactor DataSourceScanExec to do partition discovery at execution instead of planning time #14241

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ericl wants to merge 23 commits into from
Closed

[SPARK-16596] [SQL] Refactor DataSourceScanExec to do partition discovery at execution instead of planning time #14241

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
d046364
Fri Jul 15 19:18:52 PDT 2016
ericl Jul 16, 2016
36d6ef4
Sun Jul 17 14:28:47 PDT 2016
ericl Jul 17, 2016
6c0eb0e
Sun Jul 17 14:29:46 PDT 2016
ericl Jul 17, 2016
1a46602
Sun Jul 17 14:36:58 PDT 2016
ericl Jul 17, 2016
5382334
Sun Jul 17 14:42:32 PDT 2016
ericl Jul 17, 2016
98d6d74
Sun Jul 17 14:55:13 PDT 2016
ericl Jul 17, 2016
0d4642a
Sun Jul 17 15:12:24 PDT 2016
ericl Jul 17, 2016
9cc3337
Wed Jul 20 11:47:51 PDT 2016
ericl Jul 20, 2016
b45e253
Wed Jul 20 11:49:00 PDT 2016
ericl Jul 20, 2016
ebf2102
Wed Jul 20 12:50:42 PDT 2016
ericl Jul 20, 2016
bbf89a1
Wed Jul 20 12:52:49 PDT 2016
ericl Jul 20, 2016
358eb9f
Wed Jul 20 13:07:47 PDT 2016
ericl Jul 20, 2016
2d78051
exception is now wrapped
ericl Jul 20, 2016
a3d2c69
Merge branch 'master' into refactor
ericl Jul 21, 2016
780fec5
Mon Jul 25 15:07:23 PDT 2016
ericl Jul 25, 2016
ac9547f
Merge remote-tracking branch 'upstream/master' into refactor
ericl Jul 25, 2016
ddb202e
fix compile
ericl Jul 25, 2016
d3bb6fe
Merge branch 'master' into refactor
ericl Jul 28, 2016
b4b2403
Thu Jul 28 11:46:08 PDT 2016
ericl Jul 28, 2016
18f5543
Merge branch 'refactor' of github.com:ericl/spark into refactor
ericl Jul 28, 2016
8c2b7df
Tue Aug 2 13:37:47 PDT 2016
ericl Aug 2, 2016
a76b432
Merge branch 'master' into refactor
ericl Aug 2, 2016
704511e
Tue Aug 2 15:01:42 PDT 2016
ericl Aug 2, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Wed Jul 20 11:47:51 PDT 2016
  • Loading branch information
@ericl
ericl committed Jul 20, 2016
commit 9cc33370ba5b27eee1e026043fd9fbd422fd7109
2 changes: 1 addition & 1 deletion sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -300,7 +300,7 @@ abstract class QueryPlan[PlanType <: QueryPlan[PlanType]] extends TreeNode[PlanT
*/
lazy val allAttributes: AttributeSeq = children.flatMap(_.output)

private def cleanExpression(e: Expression): Expression = e match {
protected def cleanExpression(e: Expression): Expression = e match {
case a: Alias =>
// As the root of the expression, Alias will always take an arbitrary exprId, we need
// to erase that for equality testing.
Expand Down
Loading