Skip to content

[fix](nereids) translate agg-dist#15473

Merged
morrySnow merged 2 commits intoapache:masterfrom
englefly:agg-dist
Jan 3, 2023
Merged

[fix](nereids) translate agg-dist#15473
morrySnow merged 2 commits intoapache:masterfrom
englefly:agg-dist

Conversation

@englefly
Copy link
Copy Markdown
Contributor

Proposed changes

when nereids translates PhysicalHashAggreg node to original plan, if the input fragment root is exchange node, nereids assumes that this exchanged node is generated by PhyscialDistirbute node.
But this assumption is not true. For example, sort node could be translated to exchange(merge phase)+sort(local phase).

Issue Number: close #xxx

Problem summary

Describe your changes.

Checklist(Required)

  1. Does it affect the original behavior:
    • Yes
    • No
    • I don't know
  2. Has unit tests been added:
    • Yes
    • No
    • No Need
  3. Has document been added or modified:
    • Yes
    • No
    • No Need
  4. Does it need to update dependencies:
    • Yes
    • No
  5. Are there any changes that cannot be rolled back:
    • Yes (If Yes, please explain WHY)
    • No

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 29, 2022
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

924060929
924060929 previously approved these changes Dec 29, 2022
Copy link
Copy Markdown
Contributor

@924060929 924060929 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should refactor translatorPhysicalDistribute later, so that other plan don't need to process ExchangeNode again

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Dec 29, 2022

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 36.52 seconds
load time: 646 seconds
storage size: 17123345777 Bytes
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230101141702_clickbench_pr_72348.html

@englefly englefly changed the title [fix](nereids) translate agg-sort [fix](nereids) translate agg-dist Dec 30, 2022
@morrySnow morrySnow merged commit 31548cf into apache:master Jan 3, 2023
eldenmoon pushed a commit to eldenmoon/incubator-doris that referenced this pull request Jan 5, 2023
…ysicalDistribute (apache#15473)

when nereids translates PhysicalHashAggreg node to original plan, if the input fragment root is exchange node, nereids assumes that this exchanged node is generated from PhyscialDistirbute node.
But this assumption is not true. For example, sort node could be translated to exchange(merge phase)+sort(local phase).
@englefly englefly deleted the agg-dist branch June 15, 2023 08:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/nereids kind/test reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants