Skip to content

[HUDI-6393] Enable MOR support for Record index with functional test cases#9017

Merged
xushiyan merged 21 commits intoapache:masterfrom
lokeshj1703:HUDI-6393
Jun 29, 2023
Merged

[HUDI-6393] Enable MOR support for Record index with functional test cases#9017
xushiyan merged 21 commits intoapache:masterfrom
lokeshj1703:HUDI-6393

Conversation

@lokeshj1703
Copy link
Collaborator

Change Logs

The PR adds functional tests for Record level index. It covers different write operations, data table services, metadata table services, rollback and other failure scenarios.

Impact

NA

Risk level (write none, low medium or high below)

low

Documentation Update

NA

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@lokeshj1703 lokeshj1703 force-pushed the HUDI-6393 branch 2 times, most recently from 877c75f to d0b2f24 Compare June 21, 2023 13:12
@xushiyan xushiyan changed the title [HUDI-6393] Add functional tests for RecordLevelIndex [WIP][HUDI-6393] Add functional tests for RecordLevelIndex Jun 21, 2023
@xushiyan xushiyan added priority:critical Production degraded; pipelines stalled release-0.14.0 labels Jun 21, 2023
@nsivabalan
Copy link
Contributor

@xushiyan
Copy link
Member

@lokeshj1703 i'll drop 97e7cc9 and rebase master as #7336 was landed

@xushiyan
Copy link
Member

@lokeshj1703 can we disable the known failing testcases and land this PR first? some code clean-up and the testcases' runtime optimization would be needed though

@lokeshj1703 lokeshj1703 changed the title [WIP][HUDI-6393] Add functional tests for RecordLevelIndex [HUDI-6393] Add functional tests for RecordLevelIndex Jun 29, 2023
Copy link
Member

@codope codope left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's land this and keep adding more onto it in subsequent patches.

@xushiyan xushiyan changed the title [HUDI-6393] Add functional tests for RecordLevelIndex [HUDI-6393] Enable MOR support for Record index with functional test cases Jun 29, 2023
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@xushiyan
Copy link
Member

CI is timing out as expected. The newly added testcase is passing. will land this now.

@xushiyan xushiyan merged commit dc3aa39 into apache:master Jun 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority:critical Production degraded; pipelines stalled release-0.14.0

Projects

Status: ✅ Done

Development

Successfully merging this pull request may close these issues.

5 participants