Skip to content

[improve](env) Improve catalog not ready tips#27715

Merged
dataroaring merged 1 commit intoapache:masterfrom
w41ter:improve/catalog_not_ready_tips
Dec 1, 2023
Merged

[improve](env) Improve catalog not ready tips#27715
dataroaring merged 1 commit intoapache:masterfrom
w41ter:improve/catalog_not_ready_tips

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Nov 28, 2023

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@w41ter
Copy link
Contributor Author

w41ter commented Nov 28, 2023

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 42.99 seconds
stream load tsv: 579 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.4 seconds inserted 10000000 Rows, about 352K ops/s
storage size: 17100160531 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 43cdab0e27a7ca6c13c7457edac2941804afb8ad, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4951	4648	4662	4648
q2	353	148	155	148
q3	1529	1278	1254	1254
q4	1148	937	937	937
q5	3221	3256	3240	3240
q6	252	134	131	131
q7	1037	519	561	519
q8	2256	2244	2228	2228
q9	6937	6940	6923	6923
q10	3299	3369	3352	3352
q11	340	217	198	198
q12	355	219	234	219
q13	4650	3869	3866	3866
q14	251	215	217	215
q15	598	533	534	533
q16	416	406	382	382
q17	1017	634	618	618
q18	8106	7403	7522	7403
q19	1543	1538	1551	1538
q20	566	321	286	286
q21	3397	2928	2982	2928
q22	373	293	306	293
Total cold run time: 46595 ms
Total hot run time: 41859 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4589	4596	4570	4570
q2	310	205	218	205
q3	3750	3743	3735	3735
q4	2538	2535	2519	2519
q5	6191	6170	6153	6153
q6	242	126	126	126
q7	2582	1994	1934	1934
q8	3735	3696	3698	3696
q9	9432	9369	9396	9369
q10	4074	4134	4134	4134
q11	646	520	517	517
q12	808	606	646	606
q13	4379	3602	3593	3593
q14	288	244	242	242
q15	589	527	532	527
q16	501	500	526	500
q17	2117	2055	2077	2055
q18	9637	8827	9195	8827
q19	1753	1759	1764	1759
q20	2327	1987	1978	1978
q21	7506	6918	6893	6893
q22	640	555	574	555
Total cold run time: 68634 ms
Total hot run time: 64493 ms

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 28, 2023
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit d9bbeca into apache:master Dec 1, 2023
@w41ter w41ter deleted the improve/catalog_not_ready_tips branch December 4, 2023 02:20
XuJianxu pushed a commit to XuJianxu/doris that referenced this pull request Dec 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.4 meta-change reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants