[SPARK-35497][PYTHON] Enable plotly tests in pandas-on-Spark

[HyukjinKwon]

What changes were proposed in this pull request?

This PR enables plot tests with plotly

./python/run-tests --python-executables=python3 --modules=pyspark-pandas

Before:

Traceback (most recent call last):
  File "/.../miniconda3/envs/python3.8/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/.../miniconda3/envs/python3.8/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/.../pyspark/pandas/tests/plot/test_frame_plot_plotly.py", line 42, in <module>
    plotly_requirement_message + " Or pandas<1.0; pandas<1.0 does not support latest plotly "
TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'

After:

...
Starting test(python3): pyspark.pandas.tests.plot.test_series_plot_plotly
...
Finished test(python3): pyspark.pandas.tests.plot.test_series_plot_plotly (23s)
...
Tests passed in 1296 seconds

Why are the changes needed?

For test coverage.

Does this PR introduce any user-facing change?

No, test-only.

How was this patch tested?

By running the tests.

[HyukjinKwon]

@dongjoon-hyun FYI. Would you mind installing plotly at Python 3.8 in the Docker image we use when you find some time?

[dongjoon-hyun]

Oh, I missed this comment last week. I only added plotly to Python 3.9 for now. I will add it to Python 3.8 soon.

[HyukjinKwon]

Oh i should have clarified it.now python 3.9 has to have this since we don't run he pyspark tests with python 3.8 anymore in the master branch, and pandas on Spark is only in the master branch.

[HyukjinKwon]

cc @ueshin @xinrong-databricks @itholic

[SparkQA]

Test build #138864 has finished for PR 32649 at commit 0c87c07.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #138865 has finished for PR 32649 at commit 48d9da5.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43386/

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43387/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43386/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43387/

[ueshin]

The changes LGTM, pending tests.

[SparkQA]

Test build #138894 has finished for PR 32649 at commit 57ef92e.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[itholic]

LGTM

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43416/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43416/

[HyukjinKwon]

Merged to master.

[xinrong-meng]

Thanks!