-
Notifications
You must be signed in to change notification settings - Fork 2.5k
Open
Labels
type:featureNew features and enhancementsNew features and enhancements
Description
I have an use case where I would like to use hudi. I have to process several inserts, updates and deletes indicated in a file. The file can have lots of rows for the same key and I have to combine it in order using a file. I have developed my own Payload but I can process the rows in order. I have used the options hoodie.datasource.write.precombine.field to indicate the precombine field and hoodie.payload.ordering.field to order by the same field but it didn't work.
Also, I have tested using repartition and sort functions in the spark code before saving hudi but it didn't work either.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
type:featureNew features and enhancementsNew features and enhancements
Type
Projects
Status
🏁 Triaged