[SPARK-35982][SQL] Allow from_json/to_json for map types where value types are year-month intervals

[sarutak]

What changes were proposed in this pull request?

This PR fixes two issues. One is that to_json doesn't support map types where value types are year-month interval types like:

spark-sql> select to_json(map('a', interval '1-2' year to  month));
21/07/02 11:38:15 ERROR SparkSQLDriver: Failed in [select to_json(map('a', interval '1-2' year to  month))]
java.lang.RuntimeException: Failed to convert value 14 (class of class java.lang.Integer) with the type of YearMonthIntervalType(0,1) to JSON.

The other issue is that even if the issue of to_json is resolved, from_json doesn't support to convert year-month interval string to JSON. So the result of following query will be null.

spark-sql> select from_json(to_json(map('a', interval '1-2' year to month)), 'a interval year to month');
{"a":null}

Why are the changes needed?

There should be no reason why year-month intervals cannot used as map value types.
CalendarIntervalTypes can do it.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

New tests.

[SparkQA]

Kubernetes integration test unable to build dist.

exiting with code: 1
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45067/

[SparkQA]

Test build #140555 has finished for PR 33181 at commit e795847.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[sarutak]

retest this please.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45080/

[SparkQA]

Test build #140568 has finished for PR 33181 at commit e795847.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[sarutak]

retest this please.

[SparkQA]

Test build #140574 has finished for PR 33181 at commit e795847.

• This patch fails to build.
• This patch merges cleanly.
• This patch adds no public classes.

[sarutak]

retest this please.

[HyukjinKwon]

cc @MaxGekk FYI

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45080/

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45085/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45085/

[SparkQA]

Kubernetes integration test unable to build dist.

exiting with code: 1
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45089/

[SparkQA]

Test build #140578 has finished for PR 33181 at commit e795847.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[MaxGekk]

+1, LGTM. Merging to master/3.2.
Thank you, @sarutak .