SPARK-26999: Fix SparkSQL CLIDriver process line incorrectly

[turboFei]

What changes were proposed in this pull request?

SparkSQLCLIDriver parse sql statement incorrectly, because its processLine method is not correct.
The processLine method is one method of CLIDriver, which is a class of hive-cli.
SparkSQLCLIDriver extends CLIDriver, but it does't override processLine method.
The spark-hive-cliet version of master branch is hive-1.2.1.spark2.
In hive-1.2.1, the processLine method splits statement directly by ";", however, there may be a quote.
For example:
The statement:

 select * from table_a where column_a not like '%;';

Will be parsed to:

select * from table_a where column_a not like '%

In this PR, I override the processLine of CLIDriver in SPARKSQLCLIDriver based on the implement of apache/hive master branch.
And it process the input sql statement correctly.

How was this patch tested?

manual test with $SPARK_HOME/bin/spark-sql

[AmplabJenkins]

Can one of the admins verify this patch?

[turboFei]

@cloud-fan @mgaido91

[wangyum]

It works after upgrade built-in Hive to 2.3.4:

[gatorsmile]

@hustfeiwang @wangyum Could you help review this PR https://github.com/apache/spark/pull/23276/files?

[turboFei]

It works after upgrade built-in Hive to 2.3.4:

Yes, it is a bug of hive-1.2.1.

[turboFei]

@hustfeiwang @wangyum Could you help review this PR https://github.com/apache/spark/pull/23276/files?

With pleasure if I have time.

[mgaido91]

yes I think this one can be closed. Probably the cleanest approach would be upgrading Hive dep, but this is a big pain as we. SO if we want to fix this without doing the upgrade we can have this in the PR Xiao mentioned.

[turboFei]

yes I think this one can be closed. Probably the cleanest approach would be upgrading Hive dep, but this is a big pain as we. SO if we want to fix this without doing the upgrade we can have this in the PR Xiao mentioned.

ok, thanks