New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-15331] [SQL] Disallow All the Unsupported CLI Commands #13122
Conversation
Test build #58612 has finished for PR 13122 at commit
|
Test build #58614 has finished for PR 13122 at commit
|
@@ -172,6 +172,10 @@ unsupportedHiveNativeCommands | |||
| kw1=ROLLBACK | |||
| kw1=DFS | |||
| kw1=DELETE kw2=FROM | |||
| kw1=RELOAD kw2=FUNCTION | |||
| kw1=DELETE kw2=(FILE | FILES | JAR | JARS | ARCHIVE | ARCHIVES) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you perhaps do this without adding the FILE
, FILES
, JAR
, JARS
, ARCHIVE
& ARCHIVES
keywords? This makes it consistent with the ADD <resource>
command.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sure, will do it.
Test build #58839 has finished for PR 13122 at commit
|
Test build #58841 has finished for PR 13122 at commit
|
# Conflicts: # sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 # sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala # sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLCLIDriver.scala
@hvanhovell @yhuai This is also ready to review. Thanks! |
Test build #59568 has finished for PR 13122 at commit
|
What changes were proposed in this pull request?
The JIRAs under https://issues.apache.org/jira/browse/SPARK-14118 remove the support of the DDL/CLI commands that are not natively supported by Spark. However, in Spark-SQL CLI, we still delegate the CLI commands to Hive command processors. To be consistent, we should also remove the related command supports in Spark SQL CLI.
Also, we need to improve Parser to issue better error exception messages for these unsupported operations.
How was this patch tested?
Added a test case in CliSuite.