[branch-2.0](colocate group) fix colocate group always exclude the same host

[yujun777]

BUG: colocate group always exclude replica with the same host. But if Config.allow_replica_on_same_host = true, it should not exclude the same host.

pick from: #33823

Proposed changes

Issue Number: close #xxx

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[yujun777]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49894 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9d2bb9b8c14173281a02516a67a67d09de503c59, data reload: false

------ Round 1 ----------------------------------
q1	18064	4512	4356	4356
q2	2071	158	159	158
q3	10545	1876	1910	1876
q4	10362	1237	1346	1237
q5	8404	3959	3947	3947
q6	259	128	128	128
q7	2011	1606	1578	1578
q8	9549	2727	2706	2706
q9	14183	10276	10270	10270
q10	8674	3580	3524	3524
q11	410	249	251	249
q12	471	305	305	305
q13	18378	3951	4046	3951
q14	354	334	320	320
q15	506	455	455	455
q16	673	568	580	568
q17	1128	956	925	925
q18	7243	6893	6864	6864
q19	1766	1674	1668	1668
q20	542	330	295	295
q21	4413	4150	4068	4068
q22	527	446	462	446
Total cold run time: 120533 ms
Total hot run time: 49894 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4327	4283	4298	4283
q2	326	228	222	222
q3	4212	4151	4150	4150
q4	2768	2737	2744	2737
q5	7196	7062	7089	7062
q6	239	121	120	120
q7	3248	2823	2863	2823
q8	4411	4432	4466	4432
q9	16842	16808	16894	16808
q10	4172	4305	4268	4268
q11	765	718	728	718
q12	1025	851	868	851
q13	6733	3781	3742	3742
q14	447	428	428	428
q15	515	461	450	450
q16	731	676	681	676
q17	3836	3875	3854	3854
q18	8777	8797	8812	8797
q19	1750	1686	1678	1678
q20	2429	2133	2090	2090
q21	8595	8607	8393	8393
q22	1061	970	974	970
Total cold run time: 84405 ms
Total hot run time: 79552 ms

[doris-robot]

TPC-DS: Total hot run time: 203569 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9d2bb9b8c14173281a02516a67a67d09de503c59, data reload: false

query1	941	435	390	390
query2	6619	2747	2582	2582
query3	6925	205	203	203
query4	21583	18233	18019	18019
query5	19737	6584	6597	6584
query6	292	223	244	223
query7	4161	293	313	293
query8	459	441	439	439
query9	3079	2630	2621	2621
query10	417	326	294	294
query11	11415	10842	10838	10838
query12	119	78	77	77
query13	5625	679	670	670
query14	17471	13555	13560	13555
query15	367	253	248	248
query16	6447	282	264	264
query17	1709	1438	865	865
query18	2316	416	408	408
query19	219	150	156	150
query20	80	80	82	80
query21	195	98	94	94
query22	5266	5155	5082	5082
query23	32486	31892	31810	31810
query24	7010	6594	6496	6496
query25	523	452	435	435
query26	524	165	159	159
query27	1897	306	295	295
query28	6235	2367	2328	2328
query29	2852	2774	2716	2716
query30	241	161	168	161
query31	885	734	726	726
query32	70	62	59	59
query33	391	260	253	253
query34	850	482	468	468
query35	1077	875	909	875
query36	1180	1104	1061	1061
query37	89	57	64	57
query38	3052	2931	2997	2931
query39	1388	1346	1329	1329
query40	204	94	94	94
query41	48	43	42	42
query42	90	77	87	77
query43	798	711	740	711
query44	1126	724	731	724
query45	241	243	234	234
query46	1230	970	977	970
query47	1874	1823	1713	1713
query48	1003	700	702	700
query49	621	363	392	363
query50	861	614	655	614
query51	4785	4628	4642	4628
query52	94	87	91	87
query53	441	311	323	311
query54	2642	2456	2466	2456
query55	90	82	84	82
query56	232	200	203	200
query57	1193	1101	1147	1101
query58	221	211	200	200
query59	4217	3884	4181	3884
query60	215	203	222	203
query61	95	93	92	92
query62	839	448	517	448
query63	485	337	337	337
query64	2589	1462	1440	1440
query65	3652	3569	3557	3557
query66	795	375	373	373
query67	16196	17240	15235	15235
query68	9691	641	636	636
query69	572	355	372	355
query70	1835	1307	1473	1307
query71	417	306	315	306
query72	6613	3562	3554	3554
query73	738	324	316	316
query74	6245	5747	5841	5747
query75	5344	3710	3743	3710
query76	6218	1195	1230	1195
query77	1025	261	261	261
query78	13146	11935	11436	11436
query79	8086	639	641	639
query80	722	413	402	402
query81	506	239	240	239
query82	654	94	104	94
query83	168	134	136	134
query84	250	72	70	70
query85	735	325	325	325
query86	340	291	294	291
query87	3283	3075	3041	3041
query88	4466	2281	2282	2281
query89	417	326	287	287
query90	1928	209	212	209
query91	171	146	138	138
query92	62	54	51	51
query93	5970	572	628	572
query94	668	202	215	202
query95	1130	1048	1061	1048
query96	633	321	312	312
query97	6433	6318	6365	6318
query98	185	178	174	174
query99	2911	906	905	905
Total cold run time: 314631 ms
Total hot run time: 203569 ms

[doris-robot]

ClickBench: Total hot run time: 30.9 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9d2bb9b8c14173281a02516a67a67d09de503c59, data reload: false

query1	0.02	0.02	0.03
query2	0.07	0.02	0.02
query3	0.25	0.05	0.04
query4	1.78	0.07	0.07
query5	0.54	0.53	0.51
query6	1.23	0.61	0.66
query7	0.01	0.01	0.02
query8	0.04	0.03	0.02
query9	0.53	0.49	0.48
query10	0.55	0.54	0.54
query11	0.12	0.08	0.08
query12	0.11	0.10	0.09
query13	0.62	0.63	0.62
query14	0.78	0.77	0.80
query15	0.78	0.76	0.76
query16	0.36	0.36	0.36
query17	1.03	1.02	0.98
query18	0.23	0.26	0.26
query19	1.87	1.84	1.84
query20	0.02	0.01	0.01
query21	15.47	0.55	0.54
query22	2.09	2.70	1.99
query23	17.17	1.10	0.87
query24	6.45	1.24	0.83
query25	0.37	0.11	0.07
query26	0.65	0.19	0.15
query27	0.03	0.04	0.04
query28	6.87	0.76	0.73
query29	12.77	2.28	2.38
query30	0.62	0.52	0.55
query31	2.82	0.39	0.38
query32	3.37	0.49	0.51
query33	3.08	3.06	3.07
query34	15.25	4.79	4.76
query35	4.84	4.87	4.84
query36	1.03	1.01	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.19 s
Total hot run time: 30.9 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 9d2bb9b8c14173281a02516a67a67d09de503c59 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

[xiaokang]

@yujun777 pls pick testcase

[yujun777]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49592 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5c0eb54e554bbaefbb12fb85a0316110b2519dd, data reload: false

------ Round 1 ----------------------------------
q1	17606	4379	4381	4379
q2	2096	158	149	149
q3	10266	1910	1923	1910
q4	10380	1247	1326	1247
q5	8625	3908	3888	3888
q6	261	140	124	124
q7	2012	1600	1638	1600
q8	9525	2736	2698	2698
q9	13733	10248	10158	10158
q10	8604	3512	3528	3512
q11	413	255	248	248
q12	461	304	303	303
q13	18330	3940	4070	3940
q14	351	337	338	337
q15	503	461	464	461
q16	657	564	566	564
q17	1136	918	909	909
q18	7283	6996	6794	6794
q19	1786	1645	1557	1557
q20	552	322	304	304
q21	4439	4137	4068	4068
q22	535	442	464	442
Total cold run time: 119554 ms
Total hot run time: 49592 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4327	4298	4280	4280
q2	325	232	229	229
q3	4158	4137	4117	4117
q4	2753	2752	2724	2724
q5	7157	7085	7108	7085
q6	238	121	117	117
q7	3204	2865	2831	2831
q8	4395	4453	4489	4453
q9	16882	16716	16683	16683
q10	4241	4286	4282	4282
q11	767	723	684	684
q12	1012	865	861	861
q13	6840	3733	3718	3718
q14	448	413	417	413
q15	504	460	459	459
q16	736	689	668	668
q17	3826	3873	3871	3871
q18	8810	8979	8762	8762
q19	1706	1691	1674	1674
q20	2350	2124	2087	2087
q21	8539	8501	8542	8501
q22	1021	1031	995	995
Total cold run time: 84239 ms
Total hot run time: 79494 ms

[doris-robot]

TPC-DS: Total hot run time: 203834 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f5c0eb54e554bbaefbb12fb85a0316110b2519dd, data reload: false

query1	961	424	383	383
query2	6558	2916	2713	2713
query3	6924	209	203	203
query4	20563	18241	18050	18050
query5	19750	6458	6539	6458
query6	285	229	246	229
query7	4174	306	306	306
query8	434	422	456	422
query9	3134	2732	2649	2649
query10	408	292	300	292
query11	11309	10820	10713	10713
query12	126	74	74	74
query13	5591	692	708	692
query14	18119	13297	13660	13297
query15	361	239	256	239
query16	6473	288	270	270
query17	1687	1476	881	881
query18	2296	415	413	413
query19	213	148	155	148
query20	86	78	82	78
query21	190	99	95	95
query22	5153	5015	4777	4777
query23	32661	31957	31992	31957
query24	7070	6547	6484	6484
query25	543	442	439	439
query26	616	165	166	165
query27	2029	295	292	292
query28	6110	2405	2346	2346
query29	2901	2733	2792	2733
query30	244	165	169	165
query31	917	750	747	747
query32	71	65	63	63
query33	405	258	262	258
query34	857	473	479	473
query35	1127	884	936	884
query36	1355	1132	1225	1132
query37	90	59	66	59
query38	3062	2953	2908	2908
query39	1379	1338	1330	1330
query40	210	101	99	99
query41	47	46	45	45
query42	98	78	91	78
query43	743	713	682	682
query44	1124	713	726	713
query45	247	239	240	239
query46	1221	1000	979	979
query47	1864	1723	1996	1723
query48	1024	710	697	697
query49	633	378	373	373
query50	868	613	604	604
query51	4813	4631	4677	4631
query52	96	83	88	83
query53	465	321	323	321
query54	2652	2455	2506	2455
query55	92	79	94	79
query56	246	220	217	217
query57	1269	1209	1102	1102
query58	218	201	208	201
query59	4243	3925	4216	3925
query60	207	211	208	208
query61	100	98	98	98
query62	757	474	446	446
query63	486	344	355	344
query64	2606	1536	1473	1473
query65	3655	3550	3587	3550
query66	839	381	381	381
query67	15889	15112	16333	15112
query68	9649	674	672	672
query69	579	356	342	342
query70	1800	1756	1428	1428
query71	414	326	324	324
query72	6547	3554	3478	3478
query73	753	320	323	320
query74	6246	5873	5896	5873
query75	5324	3851	3781	3781
query76	6163	1156	1218	1156
query77	1042	263	259	259
query78	12481	11615	12031	11615
query79	8847	645	680	645
query80	875	417	422	417
query81	497	241	236	236
query82	1198	104	102	102
query83	192	141	134	134
query84	255	74	71	71
query85	877	333	336	333
query86	324	305	295	295
query87	3223	3051	3081	3051
query88	4610	2354	2340	2340
query89	486	299	286	286
query90	1935	218	216	216
query91	173	142	152	142
query92	59	58	50	50
query93	6518	589	580	580
query94	659	216	217	216
query95	1119	1052	1064	1052
query96	635	332	326	326
query97	6533	6330	6394	6330
query98	193	176	171	171
query99	2969	946	918	918
Total cold run time: 316119 ms
Total hot run time: 203834 ms

[doris-robot]

ClickBench: Total hot run time: 31.02 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f5c0eb54e554bbaefbb12fb85a0316110b2519dd, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.79	0.07	0.08
query5	0.53	0.53	0.51
query6	1.25	0.61	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.03
query9	0.52	0.50	0.47
query10	0.54	0.53	0.55
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.62	0.62	0.61
query14	0.78	0.78	0.78
query15	0.78	0.76	0.78
query16	0.36	0.39	0.40
query17	1.00	1.02	1.03
query18	0.20	0.29	0.22
query19	1.96	1.85	1.86
query20	0.01	0.01	0.01
query21	15.47	0.55	0.54
query22	1.94	1.84	2.05
query23	17.26	1.08	0.80
query24	4.28	0.99	1.23
query25	0.27	0.11	0.07
query26	0.57	0.15	0.15
query27	0.04	0.04	0.04
query28	8.63	0.76	0.72
query29	12.61	2.41	2.37
query30	0.60	0.53	0.53
query31	2.82	0.40	0.37
query32	3.36	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.79	4.78
query35	4.84	4.85	4.86
query36	1.06	1.02	1.02
query37	0.05	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.43 s
Total hot run time: 31.02 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f5c0eb54e554bbaefbb12fb85a0316110b2519dd with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s