Skip to content

[MINOR][VL] Flatten backends-velox pom - #12932

Merged
philo-he merged 1 commit into
apache:mainfrom
wecharyu:flatten-maven
Sep 1, 2026
Merged

[MINOR][VL] Flatten backends-velox pom#12932
philo-he merged 1 commit into
apache:mainfrom
wecharyu:flatten-maven

Conversation

@wecharyu

Copy link
Copy Markdown
Contributor

What changes are proposed in this pull request?

Enable flatten-maven-plugin for backends-velox.

This is similar to #11958, when running following test command in Spark 4.x, maven resolved arrow version 15, while Spark 4.x requires arrow 18, then the test failed:

 java.lang.NoClassDefFoundError: org/apache/arrow/vector/types/pojo/ArrowType$Utf8View
        at org.apache.arrow.c.SchemaExporter.export(SchemaExporter.java:70)
        at org.apache.arrow.c.Data.exportField(Data.java:55)
        at org.apache.arrow.c.Data.exportSchema(Data.java:72)
        at org.apache.gluten.utils.ArrowAbiUtil$.exportSchema(ArrowAbiUtil.scala:134)
        at org.apache.gluten.execution.RowToVeloxColumnarExec$.toColumnarBatchIterator(RowToVeloxColumnarExec.scala:140)

How was this patch tested?

Pass test:

build/mvn test -Dtest=none -Pspark-4.1 -Pscala-2.13 -Pjava-17 -Pbackends-velox -Pspark-ut -DargLine="-Dspark.test.home=/opt/shims/spark41/spark_home/ -Dspark.testing=true" -pl gluten-ut/spark41 -Dsuites="org.apache.spark.sql.execution.datasources.parquet.GlutenParquetIOSuite"

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions Bot added the VELOX label Aug 31, 2026

@philo-he philo-he left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks.

@philo-he
philo-he merged commit 3e1962e into apache:main Sep 1, 2026
59 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants