Build: Fix Spark publication and CI configuration

[manuzhang]

Summary

The supplemental snapshot publication repeats publication of common modules, Kafka Connect, and Spark 4.0 artifacts already covered by the all-modules pass. Limit it to the three additional Spark 3.5/Scala 2.13 artifacts: integration, extensions, and runtime.

Add Spark 4.0 and 4.1/Scala 2.13 entries to the BOM so consumers can use its version constraints for those artifacts. Keep Spark 4.2 excluded from the release BOM.

Correct stale JMH workflow paths in CI filters and align Spark matrix comments with the configuration they describe.

Validation

• ./gradlew spotlessCheck
• Dry-run of the three supplemental snapshot publication tasks
• Generated the all-modules BOM and verified Spark constraint counts
• Parsed all 23 GitHub workflow YAML files
• git diff --check

---

AI Disclosure

• Model: GPT-5 (initial changes, as previously recorded); GPT-6 (follow-up edits and description)
• Platform/Tool: Codex
• Human Oversight: partially reviewed
• Prompt Summary: Fix Spark snapshot publication, release BOM entries, and CI configuration; remove the outdated Java 21 comment and keep dev/stage-binaries.sh unchanged.

[uros-b]

Looks good, thank you @manuzhang!

[szehon-ho]

lgtm but im not the expert, will see if any other comments and merge if none

[kevinjqliu]

LGTM

[kevinjqliu]

I see, so the first ./gradlew -DallModules command publishes all the packages and uses the default 2.12 scala.

Spark 3.5 is the odd one out, it needs to publish package for both 2.12 and 2.13

iceberg/build.gradle

Lines 1257 to 1263 in cff60bc

	// The Iceberg-Build builds for only one Scala version at a time, so the BOM would also
	// only contain artifacts for that single Scala version. The following code ensures that
	// the BOM references the artifacts for all Scala versions.
	def sparkScalaPattern = ~"(.*)-([0-9][.][0-9]+)_([0-9][.][0-9]+)"
	def sparkScalaVersions = [
	"3.5": ["2.12", "2.13"],
	]

So this second command publishes explicitly for Spark 3.5 with 2.13

[manuzhang]

The first command publishes with default 2.12 for 3.5 and 2.13 for 4+.

[kevinjqliu]

this is a separate BOM issue.

[kevinjqliu]

Thanks @manuzhang