Skip to content

Incremental Cleaning should not revert to brute force all-partition scanning in any cases #14569

Open
Open
Incremental Cleaning should not revert to brute force all-partition scanning in any cases#14569
Labels
component:cleaningCleaning table servicefrom-jiragood first issueGood for newcomershelp-wantedpriority:highSignificant impact; potential bugstype:featureNew features and enhancements
@hudi-bot

Description

@hudi-bot
hudi-bot
opened on Nov 30, 2025

After [https://github.com//pull/1576] . Incremental Cleaning would still resort to full partition scan when  no previous clean operation was done in the dataset. This ticket is to design and implement a safe solution which would avoid full scanning in all cases.

JIRA info

Comments

09/Jul/20 13:10;309637554;i am happy to take this issue.;;;

Metadata

Metadata

Assignees

No one assigned

    Labels

    component:cleaningCleaning table servicefrom-jiragood first issueGood for newcomershelp-wantedpriority:highSignificant impact; potential bugstype:featureNew features and enhancements

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions