[SPARK-37545][SQL] V2 CreateTableAsSelect command should qualify location

[imback82]

What changes were proposed in this pull request?

Currently, v2 CTAS command doesn't qualify the location:

spark.sql("CREATE TABLE testcat.t USING foo LOCATION '/tmp/foo' AS SELECT id FROM source")
spark.sql("DESCRIBE EXTENDED testcat.t").filter("col_name = 'Location'").show

+--------+-------------+-------+
|col_name|    data_type|comment|
+--------+-------------+-------+
|Location|/tmp/foo     |       |
+--------+-------------+-------+

, whereas v1 command qualifies the location as file:/tmp/foo which is the correct behavior since the default filesystem can change for different sessions.

Why are the changes needed?

This PR proposes to store the qualified location in order to prevent the issue where default filesystem changes for different sessions.

Does this PR introduce any user-facing change?

Yes, now, v2 CTAS command will store qualified location:

+--------+-------------+-------+
|col_name|    data_type|comment|
+--------+-------------+-------+
|Location|file:/tmp/foo|       |
+--------+-------------+-------+

How was this patch tested?

Added new test

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50396/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50396/

[SparkQA]

Test build #145920 has finished for PR 34806 at commit e3c2624.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50398/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50398/

[SparkQA]

Test build #145922 has finished for PR 34806 at commit fb771b7.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[huaxingao]

I didn't qualify path in ReplaceTableAsSelect. I will submit a PR shortly to fix it.

[huaxingao]

Merged to master. Thanks! @imback82

cc @cloud-fan

[cloud-fan]

late LGTM