Skip to content

[fix](cloud) fix chose cloud cluster order#32506

Merged
yiguolei merged 2 commits intoapache:masterfrom
yujun777:fix-use-cluster-not-work
Mar 22, 2024
Merged

[fix](cloud) fix chose cloud cluster order#32506
yiguolei merged 2 commits intoapache:masterfrom
yujun777:fix-use-cluster-not-work

Conversation

@yujun777
Copy link
Contributor

@yujun777 yujun777 commented Mar 20, 2024

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

doris-robot commented Mar 20, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@dataroaring dataroaring force-pushed the fix-use-cluster-not-work branch from e283aec to 2c59d50 Compare March 20, 2024 15:33
@dataroaring
Copy link
Contributor

dataroaring commented Mar 20, 2024

run buildall

@yujun777 yujun777 force-pushed the fix-use-cluster-not-work branch from 2c59d50 to e8611e6 Compare March 21, 2024 07:18
@yujun777 yujun777 force-pushed the fix-use-cluster-not-work branch from e8611e6 to 3c42cd7 Compare March 21, 2024 07:18
@yujun777 yujun777 changed the title [draft](cloud) fix multi clusters use cluster not work [fix](cloud) fix chose cloud cluster order Mar 21, 2024
@yujun777
Copy link
Contributor Author

yujun777 commented Mar 21, 2024

run buildall

dataroaring
dataroaring approved these changes Mar 21, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 21, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Mar 21, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 21, 2024

PR approved by anyone and no changes requested.

@deardeng
Copy link
Contributor

deardeng commented Mar 21, 2024

https://github.com/selectdb/selectdb/commit/ae25f2eb00f4ed2aba54ef2a61287b8fb5df6434

choose way 建议改成和现在dev一样的方式

@luwei16
Copy link
Contributor

luwei16 commented Mar 21, 2024

LGTM

@doris-robot
Copy link

doris-robot commented Mar 21, 2024

TPC-H: Total hot run time: 37668 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c6885d7cde2a3f170b137ece715c8ddce6bc41e8, data reload: false

------ Round 1 ----------------------------------
q1	17644	4237	4163	4163
q2	2030	161	155	155
q3	10587	1124	1189	1124
q4	10224	724	783	724
q5	7463	2965	2885	2885
q6	202	124	122	122
q7	1033	591	572	572
q8	9337	2020	1961	1961
q9	7402	6458	6413	6413
q10	8399	3405	3456	3405
q11	441	217	214	214
q12	428	198	190	190
q13	17785	2862	2906	2862
q14	235	205	208	205
q15	506	450	451	450
q16	450	360	362	360
q17	942	519	569	519
q18	7264	6538	6658	6538
q19	3629	1419	1486	1419
q20	537	255	260	255
q21	3581	2869	2827	2827
q22	357	305	314	305
Total cold run time: 110476 ms
Total hot run time: 37668 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4171	4070	4058	4058
q2	323	220	224	220
q3	2973	2861	2866	2861
q4	1820	1520	1526	1520
q5	5201	5265	5206	5206
q6	197	115	115	115
q7	2234	1857	1865	1857
q8	3149	3276	3258	3258
q9	8512	8469	8499	8469
q10	3718	3730	3686	3686
q11	525	444	428	428
q12	720	610	572	572
q13	16924	2881	2840	2840
q14	264	242	256	242
q15	483	438	439	438
q16	468	409	412	409
q17	1727	1471	1470	1470
q18	7406	7406	7035	7035
q19	1585	1489	1539	1489
q20	1892	1719	1702	1702
q21	4726	4804	4599	4599
q22	530	441	435	435
Total cold run time: 69548 ms
Total hot run time: 52909 ms

@doris-robot
Copy link

doris-robot commented Mar 21, 2024

TPC-DS: Total hot run time: 180823 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c6885d7cde2a3f170b137ece715c8ddce6bc41e8, data reload: false

query1	916	361	351	351
query2	7463	1944	1996	1944
query3	6706	214	222	214
query4	31418	20737	20696	20696
query5	4368	420	404	404
query6	267	180	174	174
query7	4619	288	286	286
query8	230	163	173	163
query9	9938	2290	2269	2269
query10	466	236	241	236
query11	17129	14123	14154	14123
query12	134	91	83	83
query13	1616	406	398	398
query14	11657	10742	10344	10344
query15	274	205	197	197
query16	8178	274	266	266
query17	1905	573	546	546
query18	2117	294	293	293
query19	324	163	165	163
query20	93	87	85	85
query21	201	138	121	121
query22	4661	4485	4471	4471
query23	31651	30966	31120	30966
query24	10723	2852	2830	2830
query25	620	387	387	387
query26	1165	148	160	148
query27	2588	347	354	347
query28	7809	1951	1900	1900
query29	876	645	632	632
query30	303	147	145	145
query31	950	734	719	719
query32	97	64	60	60
query33	771	263	255	255
query34	1073	463	481	463
query35	820	609	622	609
query36	1029	859	891	859
query37	126	76	74	74
query38	3529	3428	3468	3428
query39	1461	1377	1377	1377
query40	209	109	117	109
query41	51	46	46	46
query42	100	98	94	94
query43	488	463	465	463
query44	1198	723	727	723
query45	283	227	263	227
query46	1064	683	679	679
query47	1662	1595	1610	1595
query48	440	356	353	353
query49	1128	345	335	335
query50	767	368	375	368
query51	6732	6574	6631	6574
query52	107	89	90	89
query53	346	281	278	278
query54	317	248	298	248
query55	83	88	81	81
query56	249	229	234	229
query57	1080	1033	1004	1004
query58	233	207	213	207
query59	2770	2581	2503	2503
query60	281	260	267	260
query61	118	112	112	112
query62	586	405	400	400
query63	306	284	270	270
query64	5590	3819	3777	3777
query65	3055	3008	2994	2994
query66	853	344	340	340
query67	14924	14425	14340	14340
query68	8461	525	539	525
query69	615	381	369	369
query70	1241	1176	1118	1118
query71	512	286	278	278
query72	6380	2629	2510	2510
query73	730	317	322	317
query74	8153	6612	6541	6541
query75	4535	2853	2857	2853
query76	5069	906	962	906
query77	657	272	254	254
query78	10207	9642	9607	9607
query79	7648	522	535	522
query80	1426	416	383	383
query81	516	216	208	208
query82	851	202	207	202
query83	205	141	144	141
query84	282	78	79	78
query85	1454	327	312	312
query86	424	295	292	292
query87	3654	3505	3532	3505
query88	4763	2320	2332	2320
query89	483	362	375	362
query90	2008	182	178	178
query91	175	142	146	142
query92	60	46	52	46
query93	5321	506	492	492
query94	1125	183	183	183
query95	444	329	336	329
query96	611	274	282	274
query97	3044	2888	2880	2880
query98	228	215	212	212
query99	1106	773	760	760
Total cold run time: 307679 ms
Total hot run time: 180823 ms

@doris-robot
Copy link

doris-robot commented Mar 21, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c6885d7cde2a3f170b137ece715c8ddce6bc41e8 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       20.1 seconds inserted 10000000 Rows, about 497K ops/s

@yujun777
Copy link
Contributor Author

yujun777 commented Mar 21, 2024

run p0

@yiguolei yiguolei merged commit bc5c8c2 into apache:master Mar 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@luwei16 luwei16 luwei16 approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@yujun777 @doris-robot @dataroaring @deardeng @luwei16 @yiguolei