Skip to content

Core: Generalize Util::blockLocations#11053

Merged
nastra merged 3 commits into
apache:mainfrom
okumin:block-locations-task-group
Dec 4, 2024
Merged

Core: Generalize Util::blockLocations#11053
nastra merged 3 commits into
apache:mainfrom
okumin:block-locations-task-group

Conversation

@okumin

@okumin okumin commented Aug 31, 2024

Copy link
Copy Markdown
Contributor

The Apache Hive community is trying to implement optimizations, such as Bucket Map Join, using partition transform specs. We presume Util::blockLocations should accept not CombinedScanTask but ScanTaskGroup<FileScanTask>, which is a more general expression.

See also apache/hive#5409

Comment thread .palantir/revapi.yml Outdated
- code: "java.class.removed"
old: "enum org.apache.iceberg.BaseMetastoreTableOperations.CommitStatus"
justification: "Removing deprecated code"
- code: "java.method.parameterTypeChanged"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unfortunately we can't just break APIs. You would have you create an additional method and deprecate the old one

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nastra
I understand we have to keep the binary compatibility 100%. Is the current style more acceptable? I'm also checking why the CI failed

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've updated the deprecation message but the new version looks much better, thanks

@okumin
okumin force-pushed the block-locations-task-group branch from 40fed51 to 9d75dcc Compare December 3, 2024 12:04
Comment thread core/src/main/java/org/apache/iceberg/hadoop/Util.java
@nastra
nastra merged commit 8c04bcb into apache:main Dec 4, 2024
@okumin
okumin deleted the block-locations-task-group branch December 4, 2024 16:00
@okumin

okumin commented Dec 4, 2024

Copy link
Copy Markdown
Contributor Author

Thanks for reviewing my change. It helps the Hive community

nastra pushed a commit to nastra/iceberg that referenced this pull request Dec 9, 2024
zachdisc pushed a commit to zachdisc/iceberg that referenced this pull request Dec 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants