Skip to content

Conversation

@wenfang6
Copy link
Collaborator

What changes were proposed in this pull request?

This PR solved the first question about Issues[61]#61, don't pushdown MySQL datasource when there are some functions provided by spark in subquery.

How was this patch tested?

No UT now.

@beliefer beliefer added the bug Something isn't working label Nov 12, 2019
true
} else {
false
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

            if (pushdownFunctions.contains(func.prettyName)) {
              false
            } else {
              true
            }

}
plan.find {
functionNotPushdown
}.isEmpty
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

plan.find(functionNotPushdown).isEmpty

@beliefer
Copy link
Collaborator

LGTM

beliefer pushed a commit that referenced this pull request Nov 12, 2019
… some spark-provided functions in subquery #64

This PR solved the first question about Issues[61]#61, don't `pushdown `MySQL `datasource `when there are some functions  provided by spark in subquery.
beliefer pushed a commit that referenced this pull request Nov 12, 2019
… some spark-provided functions in subquery #64

This PR solved the first question about Issues[61]#61, don't `pushdown `MySQL `datasource `when there are some functions  provided by spark in subquery.
@beliefer
Copy link
Collaborator

Thanks! Merged to master and branch-0.6

@beliefer beliefer closed this Nov 12, 2019
@beliefer beliefer mentioned this pull request Nov 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants