Skip to content

Fixed all follow ups from HUDI-9030 #16906

@hudi-bot

Description

@hudi-bot

Filing a tracking ticket for all follow ups from HUDI-9030

 

[https://github.com//pull/12888/files#r1985816074]
[https://github.com//pull/12888/files#r1985858219]
[https://github.com//pull/12888/files#r1985859138]
Any changes to LogRecordScanner classes. not really required to be fixed right away. 

  1. Listing based rollback strategy. 
  2. Add tests to restore to a commit w/ long history w/ a mix of DC, compaction, clustering N no of times. all inline table service would do. But restore should succeed and data validation should remain intact. 
  3. Fix the IOType as Append for log files with table version 6
  4. We will need to check if configs addded in version 1.0 are required for tbl version 6
  5. Ensure these are accounted for in FGR [https://github.com/[HUDI-9030] Compatibility fixes for table version 6 with 1.0 #12888/files#r1976856670] 

 

 

WIP patch: 

[https://github.com/nsivabalan/hudi/tree/fixTableVersion6FixesAbstraction]

 

JIRA info

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions