-
Notifications
You must be signed in to change notification settings - Fork 2.5k
Implement support for applying updates as deletes + inserts #16073
Copy link
Copy link
Open
Labels
area:performancePerformance optimizationsPerformance optimizationsfrom-jirapriority:highSignificant impact; potential bugsSignificant impact; potential bugstype:featureNew features and enhancementsNew features and enhancements
Milestone
Description
This needs to happen at the higher layer of writing from Spark/Flink etc.
Hudi can already support this, by
- Logging delete blocks to the old file group.
- Writing new data blocks/base files to the new file group.
JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6490
- Type: New Feature
- Epic: https://issues.apache.org/jira/browse/HUDI-3249
- Fix version(s):
- 1.1.0
Comments
15/Aug/23 01:30;vinoth;[~tim.brown] Do you want to take this work up? This can be done even on the 0.X code line. ;;;
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
area:performancePerformance optimizationsPerformance optimizationsfrom-jirapriority:highSignificant impact; potential bugsSignificant impact; potential bugstype:featureNew features and enhancementsNew features and enhancements