[SPARK-36552][SQL] Fix different behavior for writing char/varchar to hive and datasource table

[yaooqinn]

What changes were proposed in this pull request?

For the hive table, the actual write path and the schema handling are inconsistent when spark.sql.legacy.charVarcharAsString is true.

This causes problems like SPARK-36552 described.

In this PR we respect spark.sql.legacy.charVarcharAsString when generates hive table schema from spark data types.

Why are the changes needed?

bugfix

Does this PR introduce any user-facing change?

yes, when spark.sql.legacy.charVarcharAsString is true, hive table with char/varchar will respect string behavior.

How was this patch tested?

newly added test

[yaooqinn]

cc @cloud-fan @HyukjinKwon @maropu thanks

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47172/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47172/

[SparkQA]

Test build #142670 has finished for PR 33798 at commit f33ca39.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #142680 has finished for PR 33798 at commit c4d25aa.

• This patch fails to build.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47182/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47182/

[yaooqinn]

retest this please

[SparkQA]

Test build #142681 has finished for PR 33798 at commit c4d25aa.

• This patch fails to build.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47183/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47183/

[HyukjinKwon]

Merged to master and branch-3.2.