Skip to content

[feature](nereids) runtime filter prune#13873

Closed
englefly wants to merge 3 commits intoapache:masterfrom
englefly:rf_prune
Closed

[feature](nereids) runtime filter prune#13873
englefly wants to merge 3 commits intoapache:masterfrom
englefly:rf_prune

Conversation

@englefly
Copy link
Contributor

@englefly englefly commented Nov 1, 2022

Proposed changes

consider L join R on L.a=R.b
runtime-filter: L.a<-R.b is effective,
if a is not completely covered by b,
or R.b.selectivity<1

Issue Number: close #xxx

Problem summary

Describe your changes.

Checklist(Required)

  1. Does it affect the original behavior:
    • Yes
    • No
    • I don't know
  2. Has unit tests been added:
    • Yes
    • No
    • No Need
  3. Has document been added or modified:
    • Yes
    • No
    • No Need
  4. Does it need to update dependencies:
    • Yes
    • No
  5. Are there any changes that cannot be rolled back:
    • Yes (If Yes, please explain WHY)
    • No

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@hello-stephen
Copy link
Contributor

hello-stephen commented Nov 1, 2022

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 38.26 seconds
load time: 580 seconds
storage size: 17154821630 Bytes
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20221103145054_clickbench_pr_39385.html

@github-actions github-actions bot added the area/planner Issues or PRs related to the query planner label Nov 2, 2022
2. rename enable_remove_no_conjuncts_runtime_filter_policy to enable_runtime_filter_prune
@englefly englefly closed this Nov 4, 2022
@englefly englefly deleted the rf_prune branch November 4, 2022 11:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/nereids area/planner Issues or PRs related to the query planner

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants