-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[HUDI-6924] Fix hoodie table config not wok in table properties #9836
Conversation
@boneanxs Do you have intreast to review this PR? |
@@ -199,7 +184,7 @@ object HoodieOptionConfig { | |||
|
|||
// extract primaryKey, preCombineField, type options | |||
def extractSqlOptions(options: Map[String, String]): Map[String, String] = { | |||
val sqlOptions = mapTableConfigsToSqlOptions(options) | |||
val sqlOptions = mapHoodieOptionsToSqlOptions(options) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
mapHoodieConfigsToSqlOptions
should be more accurate?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Make sense.
* @param options | ||
* @return | ||
*/ | ||
def getTableType(options: Map[String, String]): String = { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No need to delete this
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1 for this, this is actually a bug that hoodie tableconfig won't take effect if user set it.
But we need to note that there's a behavior change if user both set writeConfig & tableConfig, before only writeConfigs take effect, but now tableConfig has priority than writeConfig(Thinking this should be minor since user usually won't set both).
@hudi-bot run azure |
Change Logs
Fix the bug that hoodie table config not work in table properties. Including:
mapTableConfigsToSqlOptions
andmapDataSourceWriteOptionsToSqlOptions
tomapHoodieOptionsToSqlOptions
inHoodieOptionConfig
.HoodieOptionConfig
.Impact
Make
hoodie.table.*
configs take effect.Risk level (write none, low medium or high below)
None.
Documentation Update
Describe any necessary documentation update if there is any new feature, config, or user-facing change
ticket number here and follow the instruction to make
changes to the website.
Contributor's checklist