Skip to content

Add compaction strategy as a iceberg table property #12985

@akhilyendluri

Description

@akhilyendluri

Feature Request / Improvement

Currently, compaction strategy is set via a getter field in the rewriteDataFilesSparkAction. Allowing a table property to set the type of compaction strategy can help all vendors providing automatic compaction to read this field and allow a more hands off approach. This allows the Apache Iceberg table metadata to be the source of truth. Currently, min-input-files, target-file-size, etc can all be set in the table as a property. Allowing this too will be useful.

Query engine

None

Willingness to contribute

  • I can contribute this improvement/feature independently
  • I would be willing to contribute this improvement/feature with guidance from the Iceberg community
  • I cannot contribute this improvement/feature at this time

Metadata

Metadata

Assignees

No one assigned

    Labels

    improvementPR that improves existing functionalitystale

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions