Skip to content

feat(table): match transformed partitions in dynamic overwrite - #1675

Draft
fallintoplace wants to merge 3 commits into
apache:mainfrom
fallintoplace:feat/dynamic-overwrite-transforms
Draft

feat(table): match transformed partitions in dynamic overwrite#1675
fallintoplace wants to merge 3 commits into
apache:mainfrom
fallintoplace:feat/dynamic-overwrite-transforms

Conversation

@fallintoplace

@fallintoplace fallintoplace commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

Summary

Match dynamic overwrite partitions using their partition transforms.

Why

Partition values stored in data files are post-transform values. Comparing them directly with source columns only works for identity transforms.

What changed

Build predicates over transform(source) for non-identity fields while keeping identity predicates unchanged. Validate each transform against its source field and add bucket and truncate coverage.

The generated expression is intended to be bound by the transform-term predicate support in #1679.

Tests

  • go test ./table/internal -run TestBuildPartitionMatchPredicate -count=1

@fallintoplace fallintoplace changed the title Match transformed partitions in dynamic overwrite feat(table): match transformed partitions in dynamic overwrite Aug 6, 2026
@fallintoplace
fallintoplace force-pushed the feat/dynamic-overwrite-transforms branch from 7849e10 to fdb2b53 Compare August 6, 2026 21:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant