Skip to content

[HUDI-7136] in the dfs catalog scenario, solve the problem of Primary key definit…#10162

Merged
danny0405 merged 1 commit intoapache:masterfrom
empcl:master_fix_pk
Dec 7, 2023
Merged

[HUDI-7136] in the dfs catalog scenario, solve the problem of Primary key definit…#10162
danny0405 merged 1 commit intoapache:masterfrom
empcl:master_fix_pk

Conversation

@empcl
Copy link
Contributor

@empcl empcl commented Nov 22, 2023

…ion is missing

Change Logs

in the dfs catalog scenario, solve the problem of Primary key definition is missing

Impact

no

Risk level (write none, low medium or high below)

no

Documentation Update

no

Contributor's checklist

no

@empcl
Copy link
Contributor Author

empcl commented Nov 27, 2023

@hudi-bot run azure

1 similar comment
@empcl
Copy link
Contributor Author

empcl commented Nov 28, 2023

@hudi-bot run azure

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

//set pk
if (resolvedSchema.getPrimaryKey().isPresent()
&& !conf.containsKey(FlinkOptions.RECORD_KEY_FIELD.key())) {
final String pkColumns = String.join(",", resolvedSchema.getPrimaryKey().get().getColumns());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does hudi hive catalog has this problem?

@nsivabalan nsivabalan added priority:critical Production degraded; pipelines stalled release-0.14.1 labels Nov 30, 2023
@empcl
Copy link
Contributor Author

empcl commented Dec 5, 2023

HoodieHiveCatalog#instantiateHiveTable() { Map<String, String> properties = new HashMap<>(table.getOptions()); ... }
@danny0405 hi, properties contain RECORD_ KEY_ FIELD configuration

@danny0405 danny0405 merged commit 48b1737 into apache:master Dec 7, 2023
nsivabalan pushed a commit to nsivabalan/hudi that referenced this pull request Dec 11, 2023
… key definition is missing (apache#10162)

Co-authored-by: chenlei677 <chenlei677@jd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority:critical Production degraded; pipelines stalled release-0.14.1

Projects

Status: ✅ Done

Development

Successfully merging this pull request may close these issues.

4 participants