Skip to content

Conversation

@hvanhovell
Copy link
Contributor

This replaces the Hive UDAFs with native Spark SQL UDAFs using the new UDAF interface. See the JIRA ticket for more information.

This is currently a work in progress. I have created the PR in order to get feedback. There are still a number of open issues:

  • Remove the Hive Window Function and old Window Function code path. This is completely replaced by the new interface.
  • Improve the check analysis messages.
  • A lot of testing: the Distinct aggregation path, Error messages.

@hvanhovell
Copy link
Contributor Author

cc @yhuai

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@hvanhovell hvanhovell force-pushed the SPARK-8641 branch 3 times, most recently from d905eec to ed394eb Compare July 31, 2015 04:13
@marmbrus
Copy link
Contributor

marmbrus commented Sep 3, 2015

@hvanhovell, this is pretty awesome and I'd love to do some of this in 1.6. Can you coordinate with @yhuai on JIRA about the best way to get this implemented. To keep the PR queue manageable would you mind if we close this issue until its not WIP?

@asfgit asfgit closed this in 804a012 Sep 4, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants