[SPARK-30695][BUILD] Upgrade Apache ORC to 1.5.9

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to upgrade to Apache ORC 1.5.9.

• For hive-2.3 profile, we need to upgrade hive-storage-api from 2.6.0 to 2.7.1.
• For hive-1.2 profile, ORC library with classifier nohive already shaded it. So, there is no change.

Why are the changes needed?

This will bring the latest bug fixes. The following is the full release note.

• https://issues.apache.org/jira/projects/ORC/versions/12346546

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the Jenkins with the existing tests.

Here is the summary.

1. Hive 1.2 + Hadoop 2.7 passed. (here)
2. Hive 2.3 + Hadoop 2.7 passed. (here)

[dongjoon-hyun]

Retest this please.

[SparkQA]

Test build #117677 has finished for PR 27421 at commit afcce15.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Retest this please.

[SparkQA]

Test build #117676 has finished for PR 27421 at commit 1c1f13b.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Here is the summary.

1. Hive 1.2 + Hadoop 2.7 passed. (here)
2. Hive 2.3 + Hadoop 2.7 seems to fail at irrelevant org.apache.spark.sql.hive.thriftserver.CliSuite.SPARK-28840 test --jars command test flakiness.
3. Hive 2.3 + Hadoop 3.2 + JDK11 failed at irrelevant Python mllib test flakiness.

For (2) and (3), I rebased this PR to the master and verified that those tests pass locally.

[dongjoon-hyun]

Retest this please.

[dongjoon-hyun]

I created a testing PR for Python mllib flakiness in JDK11 environment.

• [SPARK-29138][PYTHON][TEST] Increase timeout of StreamingLogisticRegressionWithSGDTests.test_parameter_accuracy #27424

[SparkQA]

Test build #117691 has finished for PR 27421 at commit afcce15.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #117685 has finished for PR 27421 at commit afcce15.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Hi, @viirya . Could you review this PR?

[viirya]

hmm, this is added since 1.5.9?

[dongjoon-hyun]

Yes. It is~

[dongjoon-hyun]

Thank you for review and approval.

[dongjoon-hyun]

Merged to master.