[SPARK-35012][PYTHON] Port Koalas DataFrame-related unit tests into PySpark

[xinrong-meng]

What changes were proposed in this pull request?

Now that we merged the Koalas main code into the PySpark code base (#32036), we should port the Koalas DataFrame-related unit tests to PySpark.

Why are the changes needed?

Currently, the pandas-on-Spark modules are not fully tested. We should enable the DataFrame-related unit tests first.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Enable DataFrame-related unit tests.

Keyword:SPARK-34849

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41803/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41803/

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41811/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41811/

[SparkQA]

Test build #137225 has finished for PR 32131 at commit 6190e3f.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #137231 has finished for PR 32131 at commit 114610b.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41840/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41840/

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41843/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41843/

[SparkQA]

Test build #137261 has finished for PR 32131 at commit dc1cd4b.

• This patch passes all tests.
• This patch does not merge cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #137264 has finished for PR 32131 at commit fd77331.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[xinrong-meng]

CC @ueshin @HyukjinKwon @itholic

[ueshin]

LGTM.

[ueshin]

Thanks! Merged to master.

[xinrong-meng]

Thanks!

[itholic]

LGTM. Thanks :)