Skip to content

[HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient#13033

Merged
yihua merged 3 commits intoapache:masterfrom
vinishjail97:HUDI-9216-RemoveValidationForDatabase
Mar 27, 2025
Merged

[HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient#13033
yihua merged 3 commits intoapache:masterfrom
vinishjail97:HUDI-9216-RemoveValidationForDatabase

Conversation

@vinishjail97
Copy link
Contributor

Change Logs

If user passes a different value of hoodie.database.name in properties, the validation can be ignored if tableConfig (content in hoodie.properties) contains null/empty string in it. This is primarily for use-cases, where there's an external table created with 0.x, initializing the table using 1.x adds hoodie.database.name in hoodie.properties as empty string and the validation keeps failing after that.

In the current PR we are removing both - the validation for empty hoodie.database.name and not setting hoodie.database.name in tableConfig if it's null or empty.

Impact

Low

Risk level (write none, low medium or high below)

Medium

Documentation Update

None.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

Copy link
Contributor

@yihua yihua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the size:S PR with lines of changes in (10, 100] label Mar 26, 2025
@vinishjail97
Copy link
Contributor Author

There are test failures looking into them.

Error:  Tests run: 18, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 5.096 s <<< FAILURE! - in org.apache.hudi.hadoop.TestGloballyConsistentTimeStampFilteringInputFormat
Error:  testIncrementalWithDatabaseName  Time elapsed: 0.241 s  <<< FAILURE!
org.opentest4j.AssertionFailedError: The hoodie.database.name should be empty ==> expected: <> but was: <null>


@vinishjail97
Copy link
Contributor Author

Azure CI failed with timeout. The flink IT's pass locally and are not related to this change. @yihua Can I push a retry for the failed ones ?

@yihua yihua force-pushed the HUDI-9216-RemoveValidationForDatabase branch from cc0b0b6 to 8ca830a Compare March 26, 2025 21:46
@yihua
Copy link
Contributor

yihua commented Mar 26, 2025

Azure CI failed with timeout. The flink IT's pass locally and are not related to this change. @yihua Can I push a retry for the failed ones ?

I rebased the branch on top of the latest master with CI improvements.

@apache apache deleted a comment from hudi-bot Mar 26, 2025
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@yihua
Copy link
Contributor

yihua commented Mar 27, 2025

Flink IT flakiness is irrelevant. Merging the PR.

@yihua yihua merged commit fb8d27b into apache:master Mar 27, 2025
59 of 60 checks passed
voonhous pushed a commit to voonhous/hudi that referenced this pull request Apr 8, 2025
voonhous pushed a commit to voonhous/hudi that referenced this pull request Apr 9, 2025
voonhous pushed a commit to voonhous/hudi that referenced this pull request Apr 15, 2025
voonhous pushed a commit to voonhous/hudi that referenced this pull request Apr 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-1.0.2 size:S PR with lines of changes in (10, 100]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants