Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: AMS will repeat trigger the same minor optimize when the bucket > self-optimizing.minor.trigger.file-count #2464

Closed
2 tasks done
Tracked by #2448
GavinH1984 opened this issue Dec 21, 2023 · 0 comments · Fixed by #2465
Closed
2 tasks done
Tracked by #2448

[Bug]: AMS will repeat trigger the same minor optimize when the bucket > self-optimizing.minor.trigger.file-count #2464

GavinH1984 opened this issue Dec 21, 2023 · 0 comments · Fixed by #2465
Labels
type:bug Something isn't working

Comments

@GavinH1984
Copy link
Contributor

GavinH1984 commented Dec 21, 2023 •
edited
Loading

What happened?

for mix-iceberg table, when the table bucket size bigger than the self-optimizing.minor.trigger.file-count( default value is 12) setting, the same minor optimize task will repeat trigger.

the same minor optimize tirgger repeatly:
image

the detail of two optimize task:
image

Affects Versions

master

What engines are you seeing the problem on?

AMS

How to reproduce

  1. create a mix-iceberg table with the setting: bucket size > self-optimizing.minor.trigger.file-count
  2. monitor optimize task will trigger again and again.

Relevant log output

N/A

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

  • I agree to follow this project's Code of Conduct
@GavinH1984 GavinH1984 added the type:bug Something isn't working label Dec 21, 2023
GavinH1984 added a commit to GavinH1984/arctic that referenced this issue Dec 21, 2023
@GavinH1984
Fix the bug: apache#2464 [Bug]: AMS will repeat trigger the same mino…
30cbe94 
…r optimize when the bucket > self-optimizing.minor.trigger.file-count
@GavinH1984 GavinH1984 mentioned this issue Dec 21, 2023
Merged
3 tasks
zhoujinsong pushed a commit that referenced this issue Dec 22, 2023
@GavinH1984
[AMORO-2464] Fix bug AMS will repeat trigger the same minor optimize …
8facf5b 
…when the bucket > self-optimizing.minor.trigger.file-count (#2465)

Fix the bug: #2464  [Bug]: AMS will repeat trigger the same minor optimize when the bucket > self-optimizing.minor.trigger.file-count
ShawHee pushed a commit to ShawHee/arctic that referenced this issue Dec 29, 2023
@GavinH1984 @ShawHee
[AMORO-2464] Fix bug AMS will repeat trigger the same minor optimize …
d75ee3c 
…when the bucket > self-optimizing.minor.trigger.file-count (apache#2465)

Fix the bug: apache#2464  [Bug]: AMS will repeat trigger the same minor optimize when the bucket > self-optimizing.minor.trigger.file-count
zhoujinsong pushed a commit that referenced this issue Feb 2, 2024
@GavinH1984 @zhoujinsong
[AMORO-2464] Fix bug AMS will repeat trigger the same minor optimize …
04bf3cc 
…when the bucket > self-optimizing.minor.trigger.file-count (#2465)

Fix the bug: #2464  [Bug]: AMS will repeat trigger the same minor optimize when the bucket > self-optimizing.minor.trigger.file-count

(cherry picked from commit 8facf5b)
Signed-off-by: zhoujinsong <zhoujinsong0505@163.com>
@zhoujinsong zhoujinsong mentioned this issue Feb 2, 2024
Closed
33 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type:bug Something isn't working
Projects
None yet
Milestone
No milestone
1 participant
@GavinH1984