Skip to content

[fix](streamload&sink) release and allocate memory in the same tracker#12929

Merged
xinyiZzz merged 1 commit intoapache:branch-1.1-ltsfrom
dataroaring:branch-1.1-lts-stream-load-mem
Sep 23, 2022
Merged

[fix](streamload&sink) release and allocate memory in the same tracker#12929
xinyiZzz merged 1 commit intoapache:branch-1.1-ltsfrom
dataroaring:branch-1.1-lts-stream-load-mem

Conversation

@dataroaring
Copy link
Contributor

  1. HttpServer threads allocate bytebuffer and put them into streamload pipe, but scanner thread release them with query tracker.

  2. We can assume brpc allocate memory in doris thread.

Above problems leads to wrong result of memtracker.

Proposed changes

Issue Number: close #xxx

Problem summary

Describe your changes.

Checklist(Required)

  1. Does it affect the original behavior:
    • Yes
    • No
    • I don't know
  2. Has unit tests been added:
    • Yes
    • No
    • No Need
  3. Has document been added or modified:
    • Yes
    • No
    • No Need
  4. Does it need to update dependencies:
    • Yes
    • No
  5. Are there any changes that cannot be rolled back:
    • Yes (If Yes, please explain WHY)
    • No

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

1. HttpServer threads allocate bytebuffer and put them into streamload pipe,
but scanner thread release them with query tracker.

2. We can assume brpc allocate memory in doris thread.

Above problems leads to wrong result of memtracker.
Copy link
Contributor

@xinyiZzz xinyiZzz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 23, 2022
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@xinyiZzz xinyiZzz merged commit a7c0d5f into apache:branch-1.1-lts Sep 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/merged-1.1.3-deprecated reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants