[SPARK-35818][BUILD] Upgrade SBT to 1.5.4

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to upgrade SBT to 1.5.4.

Why are the changes needed?

SBT 1.5.4 is released 5 days ago.

• https://github.com/sbt/sbt/releases/tag/v1.5.4

This will bring the latest bug fixes like the following.

• Fixes BSP on ARM Macs by keeping JNI server socket to keep using JNI
• Fixes compiler ClassLoader list to use compilerJars.toList (For Scala 3, this drops support for 3.0.0-M2)
• Fixes undercompilation of package object causing "Symbol 'type X' is missing from the classpath"
• Fixes overcompilation with scalac -release flag
• Fixes build/exit notification not closing BSP channel
• Fixes POM file's Maven repository ID character restriction to match that of Maven

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44529/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44529/

[SparkQA]

Test build #140003 has finished for PR 32966 at commit 4ea7773.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

For the Jenkins UT failure, I filed a follow-up PR for SPARK-35593

• [SPARK-35593][K8S][TESTS][FOLLOWUP] Increase timeout in KubernetesLocalDiskShuffleDataIOSuite #32967

[viirya]

Seems GA was passed.

[sarutak]

retest this please.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44543/

[dongjoon-hyun]

Thank you, @HyukjinKwon , @viirya , @sarutak .
Merged to master for Apache Spark 3.2.0.

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44543/

[SparkQA]

Test build #140017 has finished for PR 32966 at commit 4ea7773.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.