Skip to content

Conversation

@wangtao605
Copy link

What changes were proposed in this pull request?

Dfs command has been supported,but SqlBase.g4 also put it in unsupportedHiveNativeCommands.

(Please fill in changes proposed in this fix)

How was this patch tested?

manual tests

Please review http://spark.apache.org/contributing.html before opening a pull request.

@wangtao605 wangtao605 changed the title [SPARK-23812]DFS should be removed from unsupportedHiveNativeCommands in SqlBase.g4 [SPARK-23812][SQL] DFS should be removed from unsupportedHiveNativeCommands in SqlBase.g4 Mar 29, 2018
@hvanhovell
Copy link
Contributor

@wangtao605 AFAIK we don’t support dfs.

@wangtao605
Copy link
Author

dfs
@hvanhovell Please see the pic above,i run the "DFS" command in spark-sql,it can work.

@srowen
Copy link
Member

srowen commented May 13, 2018

It may happen to work, but I think the idea here is that we do not want to guarantee it will going forward. I think this should be closed

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@srowen srowen mentioned this pull request Jul 3, 2018
@asfgit asfgit closed this in 5bf95f2 Jul 4, 2018
@wangyum
Copy link
Member

wangyum commented Aug 31, 2020

We don’t support dfs.

scala> spark.sql("dfs -ls /tmp").show
org.apache.spark.sql.catalyst.parser.ParseException:
mismatched input 'dfs' expecting {'(', 'SELECT', 'FROM', 'ADD', 'DESC', 'WITH', 'VALUES', 'CREATE', 'TABLE', 'INSERT', 'DELETE', 'DESCRIBE', 'EXPLAIN', 'SHOW', 'USE', 'DROP', 'ALTER', 'MAP', 'SET', 'RESET', 'START', 'COMMIT', 'ROLLBACK', 'REDUCE', 'REFRESH', 'CLEAR', 'CACHE', 'UNCACHE', 'TRUNCATE', 'ANALYZE', 'LIST', 'REVOKE', 'GRANT', 'LOCK', 'UNLOCK', 'MSCK', 'EXPORT', 'IMPORT', 'LOAD'}(line 1, pos 0)

== SQL ==
dfs -ls /tmp
^^^

  at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:239)
  at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:115)
  at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:48)
  at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:69)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:638)
  ... 49 elided

bin/spark-sql uses Hive api.

zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
Closes apache#20932
Closes apache#17843
Closes apache#13477
Closes apache#14291
Closes apache#20919
Closes apache#17907
Closes apache#18766
Closes apache#20809
Closes apache#8849
Closes apache#21076
Closes apache#21507
Closes apache#21336
Closes apache#21681
Closes apache#21691

Author: Sean Owen <[email protected]>

Closes apache#21708 from srowen/CloseStalePRs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants