Skip to content

[SPARK-13139][SQL] Create native DDL commands #11048

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
viirya wants to merge 20 commits into from
Closed

[SPARK-13139][SQL] Create native DDL commands #11048

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
77252af
init import: create database and create function.
viirya Feb 3, 2016
2b38d11
Fix import order.
viirya Feb 3, 2016
cee8056
Merge remote-tracking branch 'upstream/master' into native-ddl
viirya Feb 8, 2016
127a684
alter table command.
viirya Feb 5, 2016
f9c1397
Fix it.
viirya Feb 8, 2016
eb1fab7
Fix style.
viirya Feb 8, 2016
3db2e1d
List TOK_ALTERTABLE as not explanable command.
viirya Feb 9, 2016
8a7d34e
Merge remote-tracking branch 'upstream/master' into native-ddl
viirya Feb 15, 2016
2e78f52
Add execution.commands package.
viirya Feb 15, 2016
170bd77
Refactor.
viirya Feb 15, 2016
4a96331
Fix scala style.
viirya Feb 16, 2016
3c2fc25
Fix import.
viirya Feb 16, 2016
461d163
Merge remote-tracking branch 'upstream/master' into native-ddl
viirya Feb 22, 2016
bcf3f28
Address comments.
viirya Feb 22, 2016
0c57651
Delete moved files.
viirya Feb 22, 2016
54c0578
Fix scala style.
viirya Feb 23, 2016
0eb1687
Merge remote-tracking branch 'upstream/master' into native-ddl
viirya Feb 23, 2016
5f8e70d
Merge remote-tracking branch 'upstream/master' into native-ddl
viirya Feb 25, 2016
53d02f0
Merge remote-tracking branch 'upstream/master' into native-ddl
viirya Feb 26, 2016
6032268
Merge remote-tracking branch 'upstream/master' into native-ddl
viirya Mar 1, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'upstream/master' into native-ddl 
Conflicts:
	sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala
	sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala
	sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala
  • Loading branch information
@viirya
viirya committed Feb 26, 2016
commit 53d02f06d4b6c019eb03873f1ea1697a78b414dd
6 changes: 3 additions & 3 deletions sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,13 +21,13 @@ import java.util.NoSuchElementException

import org.apache.spark.Logging
import org.apache.spark.rdd.RDD
import org.apache.spark.sql.{DataFrame, Row, SQLConf, SQLContext}
import org.apache.spark.sql.catalyst.{CatalystTypeConverters, InternalRow, TableIdentifier}
import org.apache.spark.sql.{DataFrame, Row, SQLContext}
import org.apache.spark.sql.catalyst.{CatalystTypeConverters, InternalRow}
import org.apache.spark.sql.catalyst.errors.TreeNodeException
import org.apache.spark.sql.catalyst.expressions.{Attribute, AttributeReference}
import org.apache.spark.sql.catalyst.plans.logical
import org.apache.spark.sql.catalyst.plans.logical.LogicalPlan
import org.apache.spark.sql.execution.datasources.BucketSpec
import org.apache.spark.sql.internal.SQLConf
import org.apache.spark.sql.types._

/**
Expand Down
3 changes: 2 additions & 1 deletion sql/core/src/main/scala/org/apache/spark/sql/execution/commands/commands.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,14 +21,15 @@ import java.util.NoSuchElementException

import org.apache.spark.Logging
import org.apache.spark.rdd.RDD
import org.apache.spark.sql.{DataFrame, Row, SQLConf, SQLContext}
import org.apache.spark.sql.{DataFrame, Row, SQLContext}
import org.apache.spark.sql.catalyst.{CatalystTypeConverters, InternalRow, TableIdentifier}
import org.apache.spark.sql.catalyst.errors.TreeNodeException
import org.apache.spark.sql.catalyst.expressions.{Attribute, AttributeReference}
import org.apache.spark.sql.catalyst.plans.logical
import org.apache.spark.sql.catalyst.plans.logical.LogicalPlan
import org.apache.spark.sql.execution._
import org.apache.spark.sql.execution.datasources.BucketSpec
import org.apache.spark.sql.internal.SQLConf
import org.apache.spark.sql.types._

case class SetCommand(kv: Option[(String, Option[String])]) extends RunnableCommand with Logging {
Expand Down
3 changes: 2 additions & 1 deletion sql/core/src/main/scala/org/apache/spark/sql/execution/commands/ddl.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,14 +21,15 @@ import java.util.NoSuchElementException

import org.apache.spark.Logging
import org.apache.spark.rdd.RDD
import org.apache.spark.sql.{DataFrame, Row, SQLConf, SQLContext}
import org.apache.spark.sql.{DataFrame, Row, SQLContext}
import org.apache.spark.sql.catalyst.{CatalystTypeConverters, InternalRow, TableIdentifier}
import org.apache.spark.sql.catalyst.errors.TreeNodeException
Copy link
Contributor

@andrewor14 andrewor14 Mar 2, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

by the way there are a lot of unused imports in this file and other files. Please take the time to remove the ones that are not used.

import org.apache.spark.sql.catalyst.expressions.{Attribute, AttributeReference}
import org.apache.spark.sql.catalyst.plans.logical
import org.apache.spark.sql.catalyst.plans.logical.LogicalPlan
import org.apache.spark.sql.execution._
import org.apache.spark.sql.execution.datasources.BucketSpec
import org.apache.spark.sql.internal.SQLConf
import org.apache.spark.sql.types._

abstract class NativeDDLCommands(val sql: String) extends RunnableCommand {
Expand Down
2 changes: 1 addition & 1 deletion ...rc/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ import org.apache.hive.service.cli.operation.ExecuteStatementOperation
import org.apache.hive.service.cli.session.HiveSession

import org.apache.spark.Logging
import org.apache.spark.sql.{DataFrame, Row => SparkRow, SQLConf}
import org.apache.spark.sql.{DataFrame, Row => SparkRow}
import org.apache.spark.sql.execution.commands.SetCommand
import org.apache.spark.sql.hive.{HiveContext, HiveMetastoreTypes}
import org.apache.spark.sql.internal.SQLConf
Expand Down
2 changes: 0 additions & 2 deletions sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,6 @@ import org.apache.hadoop.util.VersionInfo
import org.apache.spark.{Logging, SparkContext}
import org.apache.spark.api.java.JavaSparkContext
import org.apache.spark.sql._
import org.apache.spark.sql.SQLConf.SQLConfEntry
import org.apache.spark.sql.SQLConf.SQLConfEntry._
import org.apache.spark.sql.catalyst.InternalRow
import org.apache.spark.sql.catalyst.analysis._
import org.apache.spark.sql.catalyst.expressions.{Expression, LeafExpression}
Expand Down
You are viewing a condensed version of this merge commit. You can view the full changes here.