[opt](auto bucket) add fe config autobucket_max_buckets #33842

[xiaokang]

Proposed changes

Issue Number: close #xxx

pick from master #33842

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[xiaokang]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49502 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f27e1ea5fa80c83f1502e9a736884cc874ab2cc, data reload: false

------ Round 1 ----------------------------------
q1	18116	4349	4294	4294
q2	2030	149	139	139
q3	10445	1853	1880	1853
q4	10357	1271	1317	1271
q5	8472	3895	3947	3895
q6	227	127	123	123
q7	1998	1586	1569	1569
q8	9532	2688	2771	2688
q9	11627	10611	10297	10297
q10	8634	3501	3510	3501
q11	417	229	244	229
q12	462	298	299	298
q13	18343	3904	4062	3904
q14	339	321	324	321
q15	510	453	456	453
q16	696	587	587	587
q17	1117	954	946	946
q18	7264	6857	6916	6857
q19	1720	1573	1518	1518
q20	506	291	316	291
q21	4397	4071	4079	4071
q22	492	397	403	397
Total cold run time: 117701 ms
Total hot run time: 49502 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4301	4305	4275	4275
q2	316	224	218	218
q3	4191	4168	4130	4130
q4	2738	2759	2723	2723
q5	7362	7186	7211	7186
q6	236	126	120	120
q7	3171	2782	2827	2782
q8	4370	4466	4501	4466
q9	17110	16993	16897	16897
q10	4213	4233	4220	4220
q11	749	697	683	683
q12	1025	847	849	847
q13	6801	3719	3716	3716
q14	446	422	424	422
q15	507	448	450	448
q16	758	705	702	702
q17	3801	3862	3856	3856
q18	8724	8701	8732	8701
q19	1700	1685	1610	1610
q20	2402	2115	2097	2097
q21	8485	8619	8519	8519
q22	1028	952	919	919
Total cold run time: 84434 ms
Total hot run time: 79537 ms

[doris-robot]

TPC-DS: Total hot run time: 202804 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6f27e1ea5fa80c83f1502e9a736884cc874ab2cc, data reload: false

query1	918	390	386	386
query2	6537	2894	2678	2678
query3	6919	199	199	199
query4	20158	17989	17984	17984
query5	19723	6527	6504	6504
query6	289	216	234	216
query7	4163	306	304	304
query8	256	275	239	239
query9	3219	2775	2690	2690
query10	415	292	299	292
query11	11346	10666	10705	10666
query12	128	74	71	71
query13	5575	720	680	680
query14	17068	13526	13522	13522
query15	397	242	240	240
query16	6494	277	255	255
query17	1724	1449	880	880
query18	2327	415	399	399
query19	205	154	155	154
query20	72	73	78	73
query21	190	95	92	92
query22	5330	4882	5100	4882
query23	32533	31930	31819	31819
query24	7031	6550	6434	6434
query25	533	449	418	418
query26	525	172	161	161
query27	1858	296	291	291
query28	6166	2387	2351	2351
query29	3005	2900	2773	2773
query30	245	164	158	158
query31	904	714	727	714
query32	69	62	56	56
query33	389	259	255	255
query34	835	463	489	463
query35	1131	926	895	895
query36	1278	1243	1409	1243
query37	88	61	63	61
query38	3026	2928	2931	2928
query39	1382	1309	1327	1309
query40	207	102	96	96
query41	36	33	33	33
query42	85	80	88	80
query43	758	708	682	682
query44	1147	725	733	725
query45	246	229	228	228
query46	1221	966	964	964
query47	1832	1735	1708	1708
query48	1009	718	693	693
query49	608	370	369	369
query50	846	598	604	598
query51	4734	4715	4659	4659
query52	90	88	73	73
query53	451	316	316	316
query54	2652	2447	2458	2447
query55	89	76	89	76
query56	215	197	208	197
query57	1293	1120	1140	1120
query58	201	185	202	185
query59	4127	3674	3917	3674
query60	207	210	208	208
query61	89	86	88	86
query62	793	450	491	450
query63	461	334	350	334
query64	2533	1505	1339	1339
query65	3655	3546	3548	3546
query66	764	366	356	356
query67	16424	15193	15291	15193
query68	11059	667	640	640
query69	572	361	349	349
query70	2080	1358	1354	1354
query71	421	310	314	310
query72	6442	3500	3443	3443
query73	742	326	327	326
query74	6321	5798	5825	5798
query75	5520	3756	3723	3723
query76	6983	1137	1186	1137
query77	1182	249	250	249
query78	12645	11648	14280	11648
query79	8046	638	629	629
query80	815	404	389	389
query81	457	234	234	234
query82	327	100	98	98
query83	158	133	132	132
query84	249	68	68	68
query85	845	304	300	300
query86	333	293	293	293
query87	3263	2993	3004	2993
query88	3720	2310	2318	2310
query89	339	306	282	282
query90	1977	208	205	205
query91	169	134	139	134
query92	57	50	57	50
query93	1673	561	576	561
query94	731	198	208	198
query95	1125	1069	1077	1069
query96	626	318	333	318
query97	6531	6296	6428	6296
query98	184	176	169	169
query99	3193	929	1003	929
Total cold run time: 310009 ms
Total hot run time: 202804 ms

[doris-robot]

ClickBench: Total hot run time: 30.82 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6f27e1ea5fa80c83f1502e9a736884cc874ab2cc, data reload: false

query1	0.03	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.04	0.05
query4	1.80	0.07	0.07
query5	0.53	0.53	0.51
query6	1.23	0.60	0.67
query7	0.02	0.01	0.00
query8	0.03	0.02	0.02
query9	0.52	0.48	0.48
query10	0.54	0.54	0.53
query11	0.11	0.08	0.09
query12	0.11	0.09	0.09
query13	0.60	0.62	0.61
query14	0.78	0.79	0.79
query15	0.77	0.76	0.77
query16	0.38	0.37	0.36
query17	1.02	1.04	0.96
query18	0.25	0.26	0.24
query19	1.91	1.86	1.85
query20	0.01	0.01	0.01
query21	15.47	0.58	0.57
query22	1.98	2.15	1.78
query23	17.46	1.06	0.96
query24	6.80	0.88	1.13
query25	0.37	0.10	0.06
query26	0.71	0.15	0.17
query27	0.04	0.03	0.03
query28	6.63	0.72	0.71
query29	12.71	2.33	2.36
query30	0.57	0.52	0.58
query31	2.81	0.39	0.38
query32	3.38	0.50	0.50
query33	3.05	3.04	3.10
query34	15.28	4.79	4.77
query35	4.87	4.85	4.83
query36	1.05	1.02	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.02
query42	0.03	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 104.52 s
Total hot run time: 30.82 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 6f27e1ea5fa80c83f1502e9a736884cc874ab2cc with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       20.2 seconds inserted 10000000 Rows, about 495K ops/s

[dataroaring]

LGTM