Skip to content

[chore](fuzzy) topn_opt_limit_threshold#27496

Merged
zhangstar333 merged 1 commit intoapache:masterfrom
hello-stephen:patch-24
Nov 24, 2023
Merged

[chore](fuzzy) topn_opt_limit_threshold#27496
zhangstar333 merged 1 commit intoapache:masterfrom
hello-stephen:patch-24

Conversation

@hello-stephen
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@hello-stephen
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 23, 2023
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@hello-stephen
Copy link
Contributor Author

run clickbench

Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.5 seconds
stream load tsv: 580 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size: 17098777338 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit ed8fe358f3e09099932046983228d8a9451b0b67, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4962	4642	4616	4616
q2	350	169	161	161
q3	2044	1932	1931	1931
q4	1397	1260	1280	1260
q5	3966	3941	4043	3941
q6	253	129	127	127
q7	1456	881	878	878
q8	2774	2805	2775	2775
q9	9650	9516	9397	9397
q10	3478	3571	3516	3516
q11	389	237	235	235
q12	438	293	293	293
q13	4570	3822	3810	3810
q14	310	300	295	295
q15	592	534	525	525
q16	662	585	601	585
q17	1141	956	956	956
q18	7812	7426	7373	7373
q19	1681	1710	1697	1697
q20	578	326	302	302
q21	4355	3993	3994	3993
q22	465	372	363	363
Total cold run time: 53323 ms
Total hot run time: 49029 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4606	4574	4549	4549
q2	332	236	238	236
q3	4032	3989	3999	3989
q4	2704	2689	2702	2689
q5	9645	9642	9675	9642
q6	249	123	122	122
q7	3048	2491	2542	2491
q8	4440	4473	4428	4428
q9	12956	12833	12799	12799
q10	4065	4178	4182	4178
q11	778	633	659	633
q12	973	826	832	826
q13	4263	3573	3603	3573
q14	379	346	361	346
q15	579	514	538	514
q16	750	680	696	680
q17	3887	3823	3851	3823
q18	9615	9048	9115	9048
q19	1869	1779	1817	1779
q20	2383	2050	2069	2050
q21	8907	8438	8529	8438
q22	956	834	780	780
Total cold run time: 81416 ms
Total hot run time: 77613 ms

@zhangstar333 zhangstar333 merged commit dbff9d7 into apache:master Nov 24, 2023
seawinde pushed a commit to seawinde/doris that referenced this pull request Nov 28, 2023
XuJianxu pushed a commit to XuJianxu/doris that referenced this pull request Dec 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants