Skip to content

[core] Support partition and bucket predicate pushdown for BucketsTable#7592

Merged
JingsongLi merged 1 commit intoapache:masterfrom
kerwin-zk:bucketstable
Apr 3, 2026
Merged

[core] Support partition and bucket predicate pushdown for BucketsTable#7592
JingsongLi merged 1 commit intoapache:masterfrom
kerwin-zk:bucketstable

Conversation

@kerwin-zk
Copy link
Copy Markdown
Contributor

Purpose

Support partition and bucket predicate pushdown for BucketsTable

Tests

CI

@JingsongLi
Copy link
Copy Markdown
Contributor

+1

@JingsongLi JingsongLi merged commit 051dc75 into apache:master Apr 3, 2026
12 checks passed
plusplusjiajia pushed a commit to plusplusjiajia/paimon that referenced this pull request Apr 5, 2026
sundapeng added a commit to sundapeng/paimon that referenced this pull request Apr 11, 2026
PartitionsTable.withFilter() was a no-op (TODO), causing full manifest
scans when querying with partition filters. This adds predicate pushdown
following the same pattern as BucketsTable (apache#7592) and FilesTable (apache#7376).

Key changes:
- PartitionsScan extracts partition predicate via LeafPredicateExtractor
- PartitionsSplit carries the predicate to PartitionsRead
- Catalog path: in-memory filter preserving metadata columns
- TableScan path: manifest-level pushdown via withPartitionFilter
- PartitionPredicateHelper refactored to build+apply two-step pattern
- parsePartitionSpec extended for key=value/key=value format

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants