[CI][Java][Release] java-jars is failing on maintenance branch because arrow-bom is not found on https://repository.apache.org/snapshots

[raulcd]

Describe the bug, including details regarding any error messages, version, and platform.

There seems to be an issue building java-jars on the maintenance branch because org.apache.arrow:arrow-bom:pom:14.0.1-SNAPSHOT cannot be found on apache.snapshots (https://repository.apache.org/snapshots)

 ~/work/crossbow/crossbow/arrow/java ~/work/crossbow/crossbow
gpg: directory '/Users/runner/.gnupg' created
gpg: /Users/runner/.gnupg/trustdb.gpg: trustdb created
gpg: directory '/Users/runner/.gnupg/openpgp-revocs.d' created
gpg: revocation certificate stored as '/Users/runner/.gnupg/openpgp-revocs.d/AEC4AB3E371C97789461AF85687223BA9FD35D5A.rev'
[INFO] Scanning for projects...
Downloading from apache.snapshots: https://repository.apache.org/snapshots/org/apache/arrow/arrow-bom/14.0.1-SNAPSHOT/maven-metadata.xml
Downloading from apache.snapshots: https://repository.apache.org/snapshots/org/apache/arrow/arrow-bom/14.0.1-SNAPSHOT/arrow-bom-14.0.1-SNAPSHOT.pom
Error: ] Some problems were encountered while processing the POMs:
Error:  Non-resolvable import POM: The following artifacts could not be resolved: org.apache.arrow:arrow-bom:pom:14.0.1-SNAPSHOT (absent): Could not find artifact org.apache.arrow:arrow-bom:pom:14.0.1-SNAPSHOT in apache.snapshots (https://repository.apache.org/snapshots) @ line 602, column 19
 @ 
Error:  The build could not read 1 project -> [Help 1]
Error:    
Error:    The project org.apache.arrow:arrow-java-root:14.0.1-SNAPSHOT (/Users/runner/work/crossbow/crossbow/arrow/java/pom.xml) has 1 error
Error:      Non-resolvable import POM: The following artifacts could not be resolved: org.apache.arrow:arrow-bom:pom:14.0.1-SNAPSHOT (absent): Could not find artifact org.apache.arrow:arrow-bom:pom:14.0.1-SNAPSHOT in apache.snapshots (https://repository.apache.org/snapshots) @ line 602, column 19 -> [Help 2]

Component(s)

Continuous Integration, Java

[raulcd]

From my understanding this is expected as the arrow-bom was added on this release:
#38264
We should not check that pom on the snapshots, right? @lidavidm @jduo @kou

[raulcd]

BTW the failed job is this one: https://github.com/ursacomputing/crossbow/actions/runs/7477878909/job/20378915619

[kou]

Hmm. It seems that 15.0.0-SNAPSHOT and 14.0.1-SNAPSHOT are mixed. It may be a problem...

[raulcd]

I can't seem to find any occurrence on our repo about 14.0.1-SNAPSHOT.

[lidavidm]

Why is it setting the version to 14.0.1-SNAPSHOT? (Not that that's related...)

It seems that after mvn versions:set, the version in bom/pom.xml is not updated like the rest. And the root pom.xml defines a dependency on arrow-bom version 14.0.1. I think that is where it is coming from. If I update bom/pom.xml to version 14.0.1, then the build proceeds. (However, it fails with a very similar issue in module-info-compiler-maven-plugin.) If I don't, the build fails.

[lidavidm]

The build seems OK if I fix all versions in bom/pom.xml, maven/pom.xml, and maven/module-info-compiler-maven-plugin/pom.xml.

[lidavidm]

However, I can't get mvn versions:set to do this for me even if I explicitly invoke it on the bom pom

[lidavidm]

Oh, actually, this seems to work

mvn versions:set -DnewVersion=14.0.1-SNAPSHOT # we already do this in the job
mvn versions:set -DnewVersion=14.0.1-SNAPSHOT -f bom
mvn versions:set -DnewVersion=14.0.1-SNAPSHOT -f maven

The latter two commands will print an error but seem to pass and update the versions properly.

[lidavidm]

So I think this would work:

diff --git a/dev/tasks/java-jars/github.yml b/dev/tasks/java-jars/github.yml
index fbce12ee4..7ee68e77e 100644
--- a/dev/tasks/java-jars/github.yml
+++ b/dev/tasks/java-jars/github.yml
@@ -236,6 +236,8 @@ jobs:
           set -e
           pushd arrow/java
           mvn versions:set -DnewVersion={{ arrow.no_rc_snapshot_version }}
+          mvn versions:set -DnewVersion={{ arrow.no_rc_snapshot_version }} -f bom
+          mvn versions:set -DnewVersion={{ arrow.no_rc_snapshot_version }} -f maven
           popd
           arrow/ci/scripts/java_full_build.sh \
             $GITHUB_WORKSPACE/arrow \