Docs: Add build of particular compute engine versions

[a49a]

Feature Request / Improvement

Add /gradlew build -DsparkVersions=3.2,3.3 -DflinkVersions=1.14 to the docs.

Query engine

No response

[kbendick]

Technically there's -DsparkVersions, -DflinkVersions, -DhiveVersions and -DscalaVersion, as we can see from dev/stage-binaries.sh.

So maybe we just document that each of those exists? Some things like scalaVersion only affect certain packages (namely Spark related ones).

For reference, the complete build steps at present (except the build command should be used not publishApachePublicationToMavenRepository):

iceberg/dev/stage-binaries.sh

Lines 21 to 31 in b1ab35d

	SCALA_VERSION=2.12
	FLINK_VERSIONS=1.13,1.14,1.15
	SPARK_VERSIONS=2.4,3.0,3.1,3.2,3.3
	HIVE_VERSIONS=2,3
	./gradlew -Prelease -DscalaVersion=$SCALA_VERSION -DflinkVersions=$FLINK_VERSIONS -DsparkVersions=$SPARK_VERSIONS -DhiveVersions=$HIVE_VERSIONS publishApachePublicationToMavenRepository
	# Also publish Scala 2.13 Artifacts for versions that support it.
	# Flink does not yet support 2.13 (and is largely dropping a user-facing dependency on Scala). Hive doesn't need a Scala specification.
	./gradlew -Prelease -DscalaVersion=2.13 -DsparkVersions=3.2 :iceberg-spark:iceberg-spark-3.2_2.13:publishApachePublicationToMavenRepository :iceberg-spark:iceberg-spark-extensions-3.2_2.13:publishApachePublicationToMavenRepository :iceberg-spark:iceberg-spark-runtime-3.2_2.13:publishApachePublicationToMavenRepository
	./gradlew -Prelease -DscalaVersion=2.13 -DsparkVersions=3.3 :iceberg-spark:iceberg-spark-3.3_2.13:publishApachePublicationToMavenRepository :iceberg-spark:iceberg-spark-extensions-3.3_2.13:publishApachePublicationToMavenRepository :iceberg-spark:iceberg-spark-runtime-3.3_2.13:publishApachePublicationToMavenRepository

[kbendick]

Ideally this could be documented either:

1. generically, so we don't have to update it - possibly linking to the dev/stage-binaries.sh script to show the complete set of options (though this could create confusion).
2. pulled from the repository somehow so that the versioned docs always have the complete set of commands. But we'd want to emphasize when is it important to use certain ones (like the scala version only affects Spark 3.2 and 3.3).

If you want to try this one out @deadwind4, I don't think you'll hear any objections. I would cc @samredai in case he has any concerns or existing knowledge of anything on going related to this 🙂

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'