Skip to content

Cleanup code for max-file-group-size-bytes in Iceberg rewrite files. #16248

@mukund-thakur

Description

@mukund-thakur

Feature Request / Improvement

max-file-group-size-bytes and MAX_FILE_GROUP_SIZE_BYTES_DEFAULT are present in two places thus can lead to confusion.
https://github.com/apache/iceberg/blob/main/api/src/main/java/org/apache/iceberg/actions/RewriteDataFiles.java#L76
https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/actions/SizeBasedFileRewritePlanner.java#L106

I suggest we keep the configs in RewriteDataFiles as the external facing interface.

Query engine

None

Willingness to contribute

  • I can contribute this improvement/feature independently
  • I would be willing to contribute this improvement/feature with guidance from the Iceberg community
  • I cannot contribute this improvement/feature at this time

Metadata

Metadata

Assignees

No one assigned

    Labels

    improvementPR that improves existing functionality

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions