Skip to content

[spark] Support partition sink strategy for Format Table#8786

Merged
JingsongLi merged 1 commit into
apache:masterfrom
Zouxxyy:xinyu/format-partition-sink-strategy
Jul 21, 2026
Merged

[spark] Support partition sink strategy for Format Table#8786
JingsongLi merged 1 commit into
apache:masterfrom
Zouxxyy:xinyu/format-partition-sink-strategy

Conversation

@Zouxxyy

@Zouxxyy Zouxxyy commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Purpose

Support spark.paimon.partition.sink-strategy for Paimon format tables in Spark.

  • Let format-table writes expose RequiresDistributionAndOrdering.
  • Require clustered distribution by partition columns for non-none strategies.
  • Add coverage for the none and hash strategies with a Hive-backed Paimon format table.

Tests

  • mvn -pl paimon-spark/paimon-spark-ut -Pspark3,fast-build -DfailIfNoTests=false -Dtest=none -DwildcardSuites=org.apache.paimon.spark.sql.FormatTableWriteDistributeModeTest test
  • mvn -pl paimon-spark/paimon-spark-ut -Pspark3,fast-build -DfailIfNoTests=false -Dtest=none -DwildcardSuites=org.apache.paimon.spark.sql.WriteDistributeModeTest test

@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit 260fcc7 into apache:master Jul 21, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants