[improvement](statistics)Improve statistics cache loading logic. (#38829)

[Jibing-Li]

backport: #38829

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[Jibing-Li]

run buildall

[Jibing-Li]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49624 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 59f689fd248cc1d36e3384481378255a0a020380, data reload: false

------ Round 1 ----------------------------------
q1	17799	4410	4366	4366
q2	2066	155	149	149
q3	10425	1890	1890	1890
q4	10349	1264	1333	1264
q5	8684	3839	3919	3839
q6	229	126	123	123
q7	2060	1590	1591	1590
q8	9290	2734	2718	2718
q9	10608	10390	10262	10262
q10	8645	3538	3523	3523
q11	422	250	245	245
q12	453	304	303	303
q13	18358	3965	4064	3965
q14	355	337	334	334
q15	502	459	462	459
q16	688	571	566	566
q17	1138	954	979	954
q18	7225	6845	6797	6797
q19	1696	1543	1517	1517
q20	512	324	310	310
q21	4484	4161	4064	4064
q22	487	400	386	386
Total cold run time: 116475 ms
Total hot run time: 49624 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4353	4301	4307	4301
q2	328	230	222	222
q3	4177	4150	4105	4105
q4	2782	2778	2739	2739
q5	7194	7122	7109	7109
q6	236	119	117	117
q7	3224	2867	2848	2848
q8	4333	4508	4511	4508
q9	16892	16885	16746	16746
q10	4241	4265	4262	4262
q11	771	682	684	682
q12	1020	844	871	844
q13	7183	3754	3727	3727
q14	455	428	425	425
q15	501	461	464	461
q16	737	684	676	676
q17	3819	3857	3837	3837
q18	8886	8739	8870	8739
q19	1737	1695	1655	1655
q20	2391	2175	2099	2099
q21	8553	8453	8547	8453
q22	1057	948	918	918
Total cold run time: 84870 ms
Total hot run time: 79473 ms

[doris-robot]

TPC-DS: Total hot run time: 204290 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 59f689fd248cc1d36e3384481378255a0a020380, data reload: false

query1	929	395	417	395
query2	6526	2277	2172	2172
query3	6917	202	197	197
query4	20087	18174	18113	18113
query5	19755	6591	6553	6553
query6	293	227	223	223
query7	4161	306	320	306
query8	255	280	240	240
query9	3188	2738	2657	2657
query10	409	312	300	300
query11	11283	10716	10643	10643
query12	122	78	77	77
query13	5609	653	650	650
query14	18070	13394	13800	13394
query15	369	222	231	222
query16	6480	284	263	263
query17	1714	1472	870	870
query18	2311	416	427	416
query19	212	149	149	149
query20	80	79	77	77
query21	193	98	89	89
query22	5205	4949	4971	4949
query23	32486	32156	32048	32048
query24	6946	6505	6488	6488
query25	548	434	424	424
query26	529	164	161	161
query27	1866	296	297	296
query28	6126	2351	2311	2311
query29	3023	2887	2681	2681
query30	244	171	168	168
query31	905	741	769	741
query32	71	61	58	58
query33	411	259	254	254
query34	846	475	483	475
query35	1122	927	845	845
query36	1496	1344	1331	1331
query37	92	61	63	61
query38	3105	2966	2986	2966
query39	1380	1331	1347	1331
query40	209	106	93	93
query41	39	41	35	35
query42	90	77	83	77
query43	653	570	642	570
query44	1157	728	722	722
query45	242	236	232	232
query46	1232	972	957	957
query47	1779	1694	1793	1694
query48	955	672	680	672
query49	619	388	375	375
query50	858	567	614	567
query51	4763	4693	4677	4677
query52	99	79	90	79
query53	455	321	322	321
query54	2660	2462	2506	2462
query55	91	88	86	86
query56	240	215	211	211
query57	1151	1172	1090	1090
query58	222	202	202	202
query59	3375	3359	3324	3324
query60	213	205	198	198
query61	96	93	96	93
query62	818	503	470	470
query63	486	341	339	339
query64	2274	1549	1525	1525
query65	3633	3573	3581	3573
query66	823	377	380	377
query67	15182	17362	16631	16631
query68	10034	667	671	667
query69	594	348	355	348
query70	1853	1435	1420	1420
query71	411	306	321	306
query72	6699	3535	3490	3490
query73	731	326	318	318
query74	6334	5874	5822	5822
query75	5449	3757	3710	3710
query76	6416	1118	1139	1118
query77	1060	271	271	271
query78	12535	11705	12275	11705
query79	8020	646	663	646
query80	1063	410	417	410
query81	498	241	238	238
query82	1594	103	98	98
query83	182	137	139	137
query84	265	72	71	71
query85	889	324	315	315
query86	332	320	329	320
query87	3225	3005	3020	3005
query88	4673	2330	2306	2306
query89	406	313	306	306
query90	1976	209	213	209
query91	170	132	125	125
query92	58	52	54	52
query93	6205	613	620	613
query94	710	218	215	215
query95	1127	1086	1067	1067
query96	661	321	325	321
query97	6508	6372	6401	6372
query98	178	179	175	175
query99	2781	886	868	868
Total cold run time: 313415 ms
Total hot run time: 204290 ms

[doris-robot]

ClickBench: Total hot run time: 30.84 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 59f689fd248cc1d36e3384481378255a0a020380, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.03
query3	0.25	0.05	0.04
query4	1.78	0.06	0.06
query5	0.54	0.53	0.52
query6	1.24	0.63	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.51	0.47
query10	0.54	0.54	0.55
query11	0.13	0.09	0.09
query12	0.12	0.09	0.10
query13	0.62	0.62	0.61
query14	0.79	0.79	0.79
query15	0.80	0.76	0.76
query16	0.36	0.39	0.38
query17	1.00	1.03	1.03
query18	0.22	0.28	0.23
query19	1.90	1.77	1.84
query20	0.02	0.01	0.01
query21	15.84	0.56	0.54
query22	2.12	2.13	1.43
query23	17.26	0.99	0.96
query24	4.09	2.37	1.31
query25	0.36	0.08	0.05
query26	0.69	0.16	0.15
query27	0.04	0.05	0.03
query28	7.56	0.77	0.74
query29	12.66	2.32	2.18
query30	0.56	0.54	0.53
query31	2.80	0.39	0.38
query32	3.38	0.50	0.50
query33	3.11	3.09	3.05
query34	15.25	4.83	4.80
query35	4.82	4.84	4.85
query36	1.05	1.01	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.03
query39	0.02	0.01	0.02
query40	0.16	0.14	0.15
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 102.97 s
Total hot run time: 30.84 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 59f689fd248cc1d36e3384481378255a0a020380 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s