Skip to content

Comments

[fix] insert-select oom#10254

Closed
englefly wants to merge 1 commit intoapache:masterfrom
englefly:cir-234
Closed

[fix] insert-select oom#10254
englefly wants to merge 1 commit intoapache:masterfrom
englefly:cir-234

Conversation

@englefly
Copy link
Contributor

Proposed changes

  1. if flush thread pool already have tasks waiting in queue, wait at most 2 sec
    compared with current strategy, it could avoid flushing small segment files
  2. After waiting for 2 sec, if the thread pool is still overloaded, we choose the delta_writer whose current mem-table is big, the submitted mem-table is not counted.
  3. when mem exceeded, the size of mem to reduce is calculated by the _mem_tracker->consumption(), not by _mem_tracker->limit().

Issue Number: close #xxx

Problem Summary:

Describe the overview of changes.

Checklist(Required)

  1. Does it affect the original behavior: (Yes/No/I Don't know)
  2. Has unit tests been added: (Yes/No/No Need)
  3. Has document been added or modified: (Yes/No/No Need)
  4. Does it need to update dependencies: (Yes/No)
  5. Are there any changes that cannot be rolled back: (Yes/No)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@englefly englefly closed this Jun 29, 2022
@englefly englefly deleted the cir-234 branch June 29, 2022 01:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant