Skip to content

[HUDI-5515] Fix concurrency conflict in ClusteringOperator when process latency marker#7625

Merged
danny0405 merged 1 commit intoapache:masterfrom
ThinkerLei:HUDI-5515
Jan 10, 2023
Merged

[HUDI-5515] Fix concurrency conflict in ClusteringOperator when process latency marker#7625
danny0405 merged 1 commit intoapache:masterfrom
ThinkerLei:HUDI-5515

Conversation

@ThinkerLei
Copy link
Contributor

@ThinkerLei ThinkerLei commented Jan 9, 2023

Change Logs

Fix concurrency conflict in ClusteringOperator

Impact

when asyncClustering is enabled, send ClusteringCommitEvent 、 LatencyMarker may cause concurrency conflict.

Risk level (write none, low medium or high below)

none

Documentation Update

fix the buc

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

danny0405
danny0405 approved these changes Jan 9, 2023
View reviewed changes
Copy link
Contributor

@danny0405 danny0405 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@danny0405 danny0405 self-assigned this Jan 9, 2023
@danny0405 danny0405 added the engine:flink Flink integration label Jan 9, 2023
@danny0405 danny0405 changed the title [HUDI-5515]Fix concurrency conflict in ClusteringOperator [HUDI-5515] Fix concurrency conflict in for flink async clustering with latency marker Jan 9, 2023
@danny0405 danny0405 added priority:critical Production degraded; pipelines stalled area:table-service Table services labels Jan 9, 2023
@hudi-bot
Copy link
Collaborator

hudi-bot commented Jan 9, 2023

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@ThinkerLei ThinkerLei changed the title [HUDI-5515] Fix concurrency conflict in for flink async clustering with latency marker [HUDI-5515] Fix concurrency conflict in ClusteringOperator when process latency marker Jan 9, 2023
@danny0405 danny0405 merged commit 2d1dd2a into apache:master Jan 10, 2023
fengjian428 pushed a commit to fengjian428/hudi that referenced this pull request Jan 31, 2023
@ThinkerLei
[HUDI-5515] Fix concurrency conflict in ClusteringOperator with laten…
c44bc27 
…cy marker (apache#7625)

Co-authored-by: coder_wang <leiw5658@gmail.com>
XuQianJin-Stars pushed a commit that referenced this pull request Feb 11, 2023
@ThinkerLei
[HUDI-5515] Fix concurrency conflict in ClusteringOperator with laten…
09df730 
…cy marker (#7625)

Co-authored-by: coder_wang <leiw5658@gmail.com>

(cherry picked from commit 2d1dd2a)
nsivabalan pushed a commit to nsivabalan/hudi that referenced this pull request Mar 22, 2023
@ThinkerLei @nsivabalan
[HUDI-5515] Fix concurrency conflict in ClusteringOperator with laten…
5dd4a8b 
…cy marker (apache#7625)

Co-authored-by: coder_wang <leiw5658@gmail.com>
fengjian428 pushed a commit to fengjian428/hudi that referenced this pull request Apr 5, 2023
@ThinkerLei
[HUDI-5515] Fix concurrency conflict in ClusteringOperator with laten…
e9ca78c 
…cy marker (apache#7625)

Co-authored-by: coder_wang <leiw5658@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@danny0405 danny0405 danny0405 approved these changes

Assignees

@danny0405 danny0405

Labels

area:table-service Table services engine:flink Flink integration priority:critical Production degraded; pipelines stalled

Projects

Hudi PR Support
Archived in project

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ThinkerLei @hudi-bot @danny0405