Skip to content

[Enhancement] (nereids) implement alterRoutineLoadCommand in nereids #49960

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 32 commits into from
Jun 26, 2025
Merged

[Enhancement] (nereids) implement alterRoutineLoadCommand in nereids #49960

merged 32 commits into from
Jun 26, 2025

Conversation

yx-keith
Copy link
Contributor

What problem does this PR solve?

Issue Number: #42795

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yx-keith
Copy link
Contributor Author

yx-keith commented Jun 9, 2025

run buildall

@yx-keith
Copy link
Contributor Author

yx-keith commented Jun 9, 2025

run buildall

@yx-keith
Copy link
Contributor Author

yx-keith commented Jun 9, 2025

run buildall

@yx-keith
Copy link
Contributor Author

yx-keith commented Jun 9, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33623 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 429ab846ca49985c7f4121a0abc7402d021f8a6f, data reload: false

------ Round 1 ----------------------------------
q1	25726	5005	4924	4924
q2	1940	271	172	172
q3	10330	1208	680	680
q4	10218	981	524	524
q5	7505	2344	2292	2292
q6	174	159	134	134
q7	902	719	606	606
q8	9291	1206	1041	1041
q9	6779	5069	5020	5020
q10	6849	2298	1871	1871
q11	503	294	271	271
q12	341	344	209	209
q13	17797	3696	3103	3103
q14	222	227	217	217
q15	578	499	504	499
q16	445	465	395	395
q17	619	867	372	372
q18	7934	7355	7253	7253
q19	1489	933	523	523
q20	323	333	225	225
q21	3684	3165	2335	2335
q22	1061	994	957	957
Total cold run time: 114710 ms
Total hot run time: 33623 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5058	5033	5019	5019
q2	232	315	216	216
q3	2156	2632	2261	2261
q4	1347	1750	1375	1375
q5	4439	4331	4423	4331
q6	216	171	129	129
q7	1965	1874	1739	1739
q8	2587	2550	2493	2493
q9	7188	7239	7014	7014
q10	3032	3198	2723	2723
q11	575	520	488	488
q12	682	758	603	603
q13	3488	3910	3316	3316
q14	284	300	282	282
q15	546	508	497	497
q16	456	492	439	439
q17	1124	1483	1399	1399
q18	7786	7507	7341	7341
q19	797	804	775	775
q20	2005	2067	1892	1892
q21	4726	4445	4365	4365
q22	1082	1047	993	993
Total cold run time: 51771 ms
Total hot run time: 49690 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191931 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 429ab846ca49985c7f4121a0abc7402d021f8a6f, data reload: false

query1	1446	1096	1044	1044
query2	6447	1847	1820	1820
query3	11004	4622	4333	4333
query4	56487	25469	23337	23337
query5	4903	472	459	459
query6	319	193	186	186
query7	4875	494	287	287
query8	317	218	204	204
query9	5768	2612	2621	2612
query10	434	340	265	265
query11	15064	14943	14780	14780
query12	154	106	103	103
query13	1038	519	438	438
query14	10179	6277	6193	6193
query15	206	215	172	172
query16	7190	650	481	481
query17	1090	764	598	598
query18	1731	431	323	323
query19	201	200	185	185
query20	149	122	120	120
query21	212	127	110	110
query22	4447	4467	4202	4202
query23	34208	33422	33690	33422
query24	6683	2389	2424	2389
query25	480	476	421	421
query26	686	271	150	150
query27	2246	501	342	342
query28	3042	2139	2150	2139
query29	584	563	450	450
query30	269	225	193	193
query31	852	864	756	756
query32	68	62	62	62
query33	439	365	314	314
query34	764	878	510	510
query35	804	812	761	761
query36	940	982	896	896
query37	134	99	75	75
query38	4268	4379	4193	4193
query39	1485	1472	1462	1462
query40	213	122	106	106
query41	60	61	55	55
query42	127	107	110	107
query43	503	520	481	481
query44	1337	856	879	856
query45	186	183	167	167
query46	866	1022	645	645
query47	1869	1943	1814	1814
query48	385	436	324	324
query49	640	493	393	393
query50	653	689	406	406
query51	4228	4234	4267	4234
query52	113	109	97	97
query53	235	258	187	187
query54	571	569	522	522
query55	83	81	83	81
query56	292	311	305	305
query57	1210	1234	1184	1184
query58	263	257	255	255
query59	2662	2729	2631	2631
query60	343	332	324	324
query61	129	121	140	121
query62	744	754	678	678
query63	234	194	193	193
query64	1762	1040	761	761
query65	4239	4125	4142	4125
query66	685	385	298	298
query67	15966	15673	15565	15565
query68	7083	868	534	534
query69	526	313	321	313
query70	1181	1028	1118	1028
query71	461	320	289	289
query72	5781	4809	4965	4809
query73	1361	679	357	357
query74	9267	9015	8660	8660
query75	3521	3210	2707	2707
query76	3743	1178	777	777
query77	559	393	285	285
query78	10142	10347	9348	9348
query79	1598	781	578	578
query80	648	509	510	509
query81	497	250	225	225
query82	220	122	98	98
query83	251	245	233	233
query84	303	105	93	93
query85	738	351	311	311
query86	349	305	274	274
query87	4363	4510	4283	4283
query88	2830	2300	2264	2264
query89	395	308	279	279
query90	1873	207	209	207
query91	154	134	112	112
query92	76	61	55	55
query93	1489	919	591	591
query94	652	405	312	312
query95	368	294	286	286
query96	490	569	284	284
query97	2689	2823	2666	2666
query98	222	205	205	205
query99	1313	1399	1257	1257
Total cold run time: 297354 ms
Total hot run time: 191931 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.8 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 429ab846ca49985c7f4121a0abc7402d021f8a6f, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.12
query3	0.26	0.20	0.19
query4	1.60	0.20	0.20
query5	0.46	0.46	0.45
query6	1.16	0.66	0.66
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.52	0.52
query10	0.57	0.57	0.57
query11	0.16	0.12	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.60
query14	0.81	0.80	0.79
query15	0.88	0.85	0.88
query16	0.39	0.39	0.37
query17	1.03	1.07	1.06
query18	0.24	0.21	0.21
query19	1.91	1.87	1.82
query20	0.01	0.01	0.01
query21	15.42	0.89	0.54
query22	0.76	1.37	0.71
query23	14.75	1.40	0.65
query24	6.80	1.48	0.29
query25	0.28	0.10	0.10
query26	0.62	0.17	0.15
query27	0.06	0.04	0.04
query28	9.61	0.94	0.43
query29	12.57	4.11	3.48
query30	0.26	0.09	0.06
query31	2.82	0.58	0.38
query32	3.22	0.53	0.48
query33	3.04	3.12	3.11
query34	15.88	5.15	4.45
query35	4.52	4.50	4.45
query36	0.67	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.02
Total cold run time: 102.81 s
Total hot run time: 28.8 s

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33640 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 72187928ab138155569a9c3c9a145dad333e31f5, data reload: false

------ Round 1 ----------------------------------
q1	26101	5204	5024	5024
q2	1949	270	187	187
q3	10291	1237	702	702
q4	10215	966	518	518
q5	7533	2363	2301	2301
q6	171	160	132	132
q7	893	726	621	621
q8	9313	1292	1000	1000
q9	6942	5074	5028	5028
q10	6844	2316	1902	1902
q11	484	293	280	280
q12	343	357	215	215
q13	17770	3650	3027	3027
q14	225	226	225	225
q15	564	484	504	484
q16	424	425	378	378
q17	581	843	343	343
q18	7613	7144	7146	7144
q19	1528	955	556	556
q20	333	331	211	211
q21	3825	2548	2363	2363
q22	1021	1041	999	999
Total cold run time: 114963 ms
Total hot run time: 33640 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5095	5084	5083	5083
q2	234	312	220	220
q3	2120	2622	2249	2249
q4	1322	1775	1379	1379
q5	4314	4352	4395	4352
q6	219	174	127	127
q7	2011	1916	1785	1785
q8	2611	2555	2534	2534
q9	7170	7191	6973	6973
q10	2954	3190	2782	2782
q11	575	522	514	514
q12	689	744	605	605
q13	3534	3912	3290	3290
q14	283	302	278	278
q15	524	494	471	471
q16	452	484	438	438
q17	1176	1500	1421	1421
q18	7775	7419	7451	7419
q19	843	803	871	803
q20	1956	2029	1923	1923
q21	4801	4416	4433	4416
q22	1111	1036	1027	1027
Total cold run time: 51769 ms
Total hot run time: 50089 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193311 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 72187928ab138155569a9c3c9a145dad333e31f5, data reload: false

query1	1401	1094	1090	1090
query2	6337	1840	1806	1806
query3	11005	4428	4427	4427
query4	52993	25543	23733	23733
query5	5262	523	465	465
query6	374	214	205	205
query7	4981	502	298	298
query8	299	240	228	228
query9	6308	2639	2643	2639
query10	432	335	266	266
query11	15236	15078	14895	14895
query12	164	112	114	112
query13	1107	532	404	404
query14	10071	6301	6271	6271
query15	211	189	180	180
query16	7037	677	495	495
query17	1076	732	588	588
query18	1505	399	299	299
query19	196	191	160	160
query20	128	122	118	118
query21	201	124	110	110
query22	4424	4506	4196	4196
query23	34387	33996	33857	33857
query24	6649	2386	2441	2386
query25	472	494	411	411
query26	702	272	151	151
query27	2235	509	336	336
query28	3063	2177	2172	2172
query29	590	547	462	462
query30	270	225	183	183
query31	865	839	779	779
query32	74	68	70	68
query33	489	368	344	344
query34	759	888	539	539
query35	793	841	757	757
query36	937	988	915	915
query37	121	106	79	79
query38	4152	4212	4201	4201
query39	1562	1472	1453	1453
query40	208	126	115	115
query41	64	54	55	54
query42	132	113	110	110
query43	494	511	494	494
query44	1339	842	830	830
query45	188	181	163	163
query46	848	1025	659	659
query47	1853	1924	1829	1829
query48	412	435	329	329
query49	656	495	392	392
query50	671	682	412	412
query51	4229	4306	4234	4234
query52	112	107	103	103
query53	218	252	188	188
query54	577	575	529	529
query55	89	82	87	82
query56	301	302	285	285
query57	1234	1247	1162	1162
query58	266	261	270	261
query59	2706	2753	2697	2697
query60	344	340	304	304
query61	125	124	131	124
query62	736	723	684	684
query63	225	192	192	192
query64	1483	1069	741	741
query65	4383	4243	4203	4203
query66	738	396	306	306
query67	16077	15670	15371	15371
query68	7355	902	524	524
query69	529	315	267	267
query70	1217	1144	1104	1104
query71	502	323	302	302
query72	6017	4789	4764	4764
query73	1347	599	362	362
query74	9129	9291	8907	8907
query75	3581	3210	2706	2706
query76	4164	1187	768	768
query77	618	370	281	281
query78	10103	10274	9352	9352
query79	2402	813	569	569
query80	707	510	433	433
query81	491	320	218	218
query82	428	125	94	94
query83	410	242	232	232
query84	298	101	84	84
query85	801	386	322	322
query86	408	313	303	303
query87	4404	4382	4299	4299
query88	3323	2252	2242	2242
query89	399	304	285	285
query90	1823	206	267	206
query91	138	137	112	112
query92	70	57	61	57
query93	2106	924	582	582
query94	662	418	307	307
query95	369	296	290	290
query96	482	565	279	279
query97	2758	2747	2644	2644
query98	236	213	201	201
query99	1411	1367	1284	1284
Total cold run time: 298264 ms
Total hot run time: 193311 ms

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33981 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit de276108723215b3381303a3196f6c70091e9675, data reload: false

------ Round 1 ----------------------------------
q1	25902	4998	4978	4978
q2	1930	269	189	189
q3	10307	1218	683	683
q4	10226	987	548	548
q5	7534	2367	2302	2302
q6	192	167	134	134
q7	895	752	605	605
q8	9302	1220	1092	1092
q9	6702	4997	5042	4997
q10	6823	2306	1885	1885
q11	496	280	268	268
q12	340	357	215	215
q13	18005	3820	3215	3215
q14	227	246	216	216
q15	551	485	501	485
q16	433	445	389	389
q17	583	855	371	371
q18	7576	7369	7345	7345
q19	1238	951	564	564
q20	334	353	234	234
q21	3712	2500	2304	2304
q22	1046	989	962	962
Total cold run time: 114354 ms
Total hot run time: 33981 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5080	5019	4994	4994
q2	230	327	216	216
q3	2141	2618	2253	2253
q4	1336	1749	1368	1368
q5	4314	4362	4415	4362
q6	212	170	127	127
q7	2036	1895	1713	1713
q8	2564	2552	2505	2505
q9	7129	7128	7071	7071
q10	3042	3169	2788	2788
q11	568	512	493	493
q12	722	775	588	588
q13	3469	3920	3351	3351
q14	274	295	276	276
q15	513	486	475	475
q16	458	485	422	422
q17	1126	1539	1374	1374
q18	7663	7631	7380	7380
q19	811	753	764	753
q20	1969	2015	1836	1836
q21	4597	4442	4344	4344
q22	1105	1036	1047	1036
Total cold run time: 51359 ms
Total hot run time: 49725 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192585 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit de276108723215b3381303a3196f6c70091e9675, data reload: false

query1	1450	1092	1059	1059
query2	6364	1862	1871	1862
query3	10998	4558	4522	4522
query4	53712	25490	23314	23314
query5	5233	508	476	476
query6	393	205	207	205
query7	5239	509	296	296
query8	321	241	221	221
query9	6625	2647	2657	2647
query10	435	327	276	276
query11	15202	15052	14767	14767
query12	158	113	110	110
query13	1180	517	416	416
query14	10027	6401	6513	6401
query15	204	215	190	190
query16	6855	639	490	490
query17	1103	715	580	580
query18	1544	399	305	305
query19	197	207	200	200
query20	133	133	122	122
query21	207	122	114	114
query22	4372	4342	4439	4342
query23	34145	33408	33296	33296
query24	6713	2441	2453	2441
query25	474	492	414	414
query26	693	279	156	156
query27	2207	515	345	345
query28	2980	2208	2181	2181
query29	587	585	436	436
query30	275	220	193	193
query31	833	863	741	741
query32	71	61	67	61
query33	467	369	344	344
query34	810	901	532	532
query35	812	827	776	776
query36	943	1040	887	887
query37	123	108	77	77
query38	4286	4396	4301	4301
query39	1529	1471	1440	1440
query40	212	123	109	109
query41	61	61	57	57
query42	134	120	114	114
query43	511	520	494	494
query44	1377	844	852	844
query45	194	194	179	179
query46	855	1091	664	664
query47	1816	1842	1769	1769
query48	392	426	342	342
query49	672	484	429	429
query50	644	687	442	442
query51	4231	4264	4173	4173
query52	120	116	104	104
query53	225	263	192	192
query54	590	587	527	527
query55	85	87	85	85
query56	325	310	309	309
query57	1225	1253	1152	1152
query58	275	277	268	268
query59	2749	2805	2750	2750
query60	339	323	320	320
query61	126	125	128	125
query62	753	717	655	655
query63	231	205	203	203
query64	1843	1041	743	743
query65	4256	4145	4121	4121
query66	735	391	309	309
query67	15886	15539	15262	15262
query68	6506	890	523	523
query69	556	316	275	275
query70	1201	1138	1044	1044
query71	451	326	302	302
query72	5997	4803	4912	4803
query73	866	644	355	355
query74	9154	8852	8687	8687
query75	3433	3192	2697	2697
query76	3921	1186	780	780
query77	566	384	308	308
query78	10044	10161	9437	9437
query79	2200	811	580	580
query80	588	501	441	441
query81	482	246	222	222
query82	430	125	99	99
query83	250	252	235	235
query84	290	97	97	97
query85	821	356	386	356
query86	416	307	294	294
query87	4498	4549	4335	4335
query88	3307	2286	2296	2286
query89	400	306	277	277
query90	1844	211	214	211
query91	143	145	111	111
query92	78	58	57	57
query93	1963	921	577	577
query94	679	413	304	304
query95	372	298	283	283
query96	486	571	279	279
query97	2715	2756	2618	2618
query98	231	205	195	195
query99	1673	1409	1240	1240
Total cold run time: 297323 ms
Total hot run time: 192585 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.94 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit de276108723215b3381303a3196f6c70091e9675, data reload: false

query1	0.04	0.03	0.04
query2	0.13	0.10	0.11
query3	0.26	0.19	0.19
query4	1.59	0.19	0.19
query5	0.46	0.42	0.44
query6	1.14	0.67	0.65
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.57	0.52	0.50
query10	0.56	0.57	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.61	0.60	0.59
query14	0.78	0.79	0.81
query15	0.86	0.84	0.85
query16	0.39	0.38	0.38
query17	1.03	1.06	1.06
query18	0.22	0.21	0.21
query19	1.91	1.80	1.82
query20	0.02	0.01	0.01
query21	15.40	0.88	0.54
query22	0.75	1.18	0.67
query23	14.94	1.34	0.65
query24	7.40	1.27	0.72
query25	0.45	0.27	0.08
query26	0.69	0.16	0.14
query27	0.05	0.05	0.06
query28	8.86	0.89	0.43
query29	12.54	4.00	3.36
query30	0.25	0.10	0.07
query31	2.80	0.60	0.39
query32	3.23	0.55	0.45
query33	3.04	3.12	3.06
query34	15.70	5.09	4.46
query35	4.48	4.51	4.45
query36	0.67	0.49	0.48
query37	0.08	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.15	0.14
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 102.68 s
Total hot run time: 28.94 s

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34905 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit febcb67e6042ee285e35d938ea6275005ccb5bf9, data reload: false

------ Round 1 ----------------------------------
q1	17715	5143	5097	5097
q2	1939	299	186	186
q3	10295	1321	718	718
q4	10211	1040	533	533
q5	7536	2388	2375	2375
q6	185	163	137	137
q7	922	758	603	603
q8	9336	1361	1050	1050
q9	6984	5221	5128	5128
q10	6910	2398	1996	1996
q11	487	296	281	281
q12	354	363	220	220
q13	17784	3664	3125	3125
q14	232	225	219	219
q15	572	484	498	484
q16	440	432	384	384
q17	615	873	403	403
q18	7599	7204	7203	7203
q19	1222	964	551	551
q20	344	349	241	241
q21	4173	3415	3002	3002
q22	1092	1029	969	969
Total cold run time: 106947 ms
Total hot run time: 34905 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5105	5122	5105	5105
q2	257	322	223	223
q3	2171	2683	2347	2347
q4	1375	1834	1380	1380
q5	4221	4241	4456	4241
q6	216	173	128	128
q7	1996	1884	1733	1733
q8	2602	2573	2494	2494
q9	7217	7122	7173	7122
q10	3075	3244	2854	2854
q11	578	509	500	500
q12	697	775	626	626
q13	3472	3962	3256	3256
q14	274	294	274	274
q15	531	466	464	464
q16	423	482	445	445
q17	1160	1471	1368	1368
q18	7802	7330	7509	7330
q19	863	868	1100	868
q20	1986	2064	1932	1932
q21	4894	4613	4308	4308
q22	1088	1052	1024	1024
Total cold run time: 52003 ms
Total hot run time: 50022 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187086 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit febcb67e6042ee285e35d938ea6275005ccb5bf9, data reload: false

query1	969	397	381	381
query2	6534	1827	1844	1827
query3	6745	220	222	220
query4	26224	23449	22962	22962
query5	4364	634	468	468
query6	319	212	202	202
query7	4631	519	289	289
query8	265	213	199	199
query9	8624	2621	2651	2621
query10	450	329	269	269
query11	15198	15127	14933	14933
query12	158	113	108	108
query13	1643	552	397	397
query14	8859	6307	6283	6283
query15	212	194	186	186
query16	7152	637	481	481
query17	955	725	652	652
query18	1992	419	316	316
query19	206	196	172	172
query20	126	117	123	117
query21	218	129	109	109
query22	4251	4229	4002	4002
query23	34017	33070	33271	33070
query24	8503	2401	2451	2401
query25	578	496	444	444
query26	1242	264	151	151
query27	2771	521	346	346
query28	4307	2228	2219	2219
query29	804	562	438	438
query30	285	228	191	191
query31	913	834	741	741
query32	76	68	66	66
query33	566	360	323	323
query34	812	875	550	550
query35	818	880	760	760
query36	967	974	900	900
query37	115	97	82	82
query38	4174	4161	4107	4107
query39	1499	1467	1406	1406
query40	214	127	109	109
query41	63	61	65	61
query42	128	113	115	113
query43	519	525	499	499
query44	1340	869	875	869
query45	185	177	164	164
query46	864	1038	640	640
query47	1752	1796	1732	1732
query48	394	443	367	367
query49	752	500	397	397
query50	657	683	429	429
query51	4151	4198	4174	4174
query52	113	110	105	105
query53	240	256	190	190
query54	620	605	546	546
query55	91	89	92	89
query56	323	323	292	292
query57	1178	1196	1126	1126
query58	270	268	262	262
query59	2753	2726	2644	2644
query60	325	360	305	305
query61	135	129	126	126
query62	793	742	696	696
query63	226	189	191	189
query64	4350	991	669	669
query65	4328	4224	4190	4190
query66	1155	416	317	317
query67	15855	15873	15549	15549
query68	8535	923	581	581
query69	485	317	298	298
query70	1234	1131	1099	1099
query71	516	333	307	307
query72	5673	4817	4939	4817
query73	736	676	369	369
query74	9280	8892	8726	8726
query75	3938	3218	2705	2705
query76	3771	1195	783	783
query77	788	395	305	305
query78	10156	10006	9359	9359
query79	4562	825	586	586
query80	628	543	466	466
query81	472	265	222	222
query82	509	128	105	105
query83	289	266	243	243
query84	303	111	93	93
query85	787	352	326	326
query86	339	306	287	287
query87	4352	4477	4394	4394
query88	3418	2382	2342	2342
query89	445	329	291	291
query90	1939	206	216	206
query91	149	144	124	124
query92	79	61	64	61
query93	3119	967	618	618
query94	754	407	313	313
query95	393	293	290	290
query96	513	591	288	288
query97	2742	2821	2698	2698
query98	247	212	201	201
query99	1411	1395	1345	1345
Total cold run time: 278878 ms
Total hot run time: 187086 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.55 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit febcb67e6042ee285e35d938ea6275005ccb5bf9, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.04
query3	0.24	0.07	0.06
query4	1.60	0.10	0.11
query5	0.45	0.43	0.41
query6	1.18	0.66	0.68
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.54	0.52
query10	0.58	0.59	0.58
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.65	0.63	0.60
query14	0.80	0.83	0.80
query15	0.90	0.88	0.87
query16	0.40	0.38	0.40
query17	1.08	1.07	1.07
query18	0.23	0.21	0.21
query19	1.96	1.89	1.87
query20	0.01	0.01	0.01
query21	15.40	0.91	0.54
query22	0.76	1.13	0.74
query23	14.90	1.42	0.68
query24	7.38	1.61	0.45
query25	0.45	0.19	0.22
query26	0.71	0.18	0.16
query27	0.06	0.06	0.05
query28	8.95	0.89	0.47
query29	12.55	3.99	3.28
query30	0.26	0.10	0.08
query31	2.82	0.62	0.41
query32	3.24	0.56	0.47
query33	3.07	3.05	3.11
query34	16.07	5.46	4.85
query35	4.84	4.86	4.83
query36	0.70	0.52	0.49
query37	0.10	0.07	0.06
query38	0.05	0.05	0.04
query39	0.04	0.03	0.02
query40	0.18	0.15	0.14
query41	0.09	0.03	0.03
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.84 s
Total hot run time: 29.55 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 1.05% (2/190) 🎉
Increment coverage report
Complete coverage report

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34426 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 32729516de08deaa6c4b97d19f0074a863d0fb99, data reload: false

------ Round 1 ----------------------------------
q1	17575	5157	5083	5083
q2	1936	288	191	191
q3	10329	1344	728	728
q4	10268	1019	543	543
q5	8695	2403	2402	2402
q6	215	164	135	135
q7	915	741	608	608
q8	9320	1310	1104	1104
q9	7029	5154	5157	5154
q10	6908	2403	1980	1980
q11	532	291	263	263
q12	349	366	225	225
q13	17775	3694	3061	3061
q14	238	235	232	232
q15	575	484	488	484
q16	420	427	372	372
q17	632	881	386	386
q18	7776	7306	7255	7255
q19	1397	948	564	564
q20	364	356	234	234
q21	3989	3244	2456	2456
q22	1067	1031	966	966
Total cold run time: 108304 ms
Total hot run time: 34426 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5199	5130	5126	5126
q2	252	326	228	228
q3	2297	2666	2320	2320
q4	1381	1818	1370	1370
q5	4431	4404	4368	4368
q6	218	177	127	127
q7	1962	1943	1740	1740
q8	2584	2605	2521	2521
q9	7114	7111	7172	7111
q10	3069	3303	2832	2832
q11	590	516	492	492
q12	706	759	611	611
q13	3575	3851	3310	3310
q14	292	302	265	265
q15	517	470	475	470
q16	439	472	426	426
q17	1123	1514	1328	1328
q18	7420	7280	7163	7163
q19	829	860	852	852
q20	1906	1995	1815	1815
q21	4870	4467	4349	4349
q22	1077	1049	1001	1001
Total cold run time: 51851 ms
Total hot run time: 49825 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186020 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 32729516de08deaa6c4b97d19f0074a863d0fb99, data reload: false

query1	974	385	405	385
query2	6579	1807	1799	1799
query3	6738	222	216	216
query4	26145	23782	23520	23520
query5	4355	623	466	466
query6	297	212	219	212
query7	4632	501	287	287
query8	274	238	215	215
query9	8645	2628	2646	2628
query10	482	326	278	278
query11	15313	15127	14858	14858
query12	158	108	106	106
query13	1665	537	416	416
query14	9212	6058	6210	6058
query15	211	198	176	176
query16	7453	656	496	496
query17	1189	736	605	605
query18	2025	413	312	312
query19	204	190	163	163
query20	124	125	123	123
query21	216	127	108	108
query22	4270	4304	4239	4239
query23	33982	33131	32959	32959
query24	8464	2372	2342	2342
query25	551	460	385	385
query26	1227	265	151	151
query27	2746	504	354	354
query28	4316	2153	2111	2111
query29	773	544	430	430
query30	286	228	195	195
query31	929	824	764	764
query32	74	63	66	63
query33	566	363	305	305
query34	818	843	542	542
query35	801	810	725	725
query36	939	1000	891	891
query37	114	101	78	78
query38	4041	4121	4014	4014
query39	1465	1420	1418	1418
query40	209	117	107	107
query41	62	59	57	57
query42	126	109	112	109
query43	507	474	463	463
query44	1307	820	824	820
query45	182	180	182	180
query46	853	1026	637	637
query47	1733	1780	1713	1713
query48	395	423	306	306
query49	746	503	383	383
query50	643	692	404	404
query51	4158	4253	4121	4121
query52	108	105	105	105
query53	229	254	185	185
query54	598	580	505	505
query55	88	84	82	82
query56	318	294	288	288
query57	1211	1186	1123	1123
query58	270	265	252	252
query59	2631	2650	2578	2578
query60	349	329	299	299
query61	124	131	123	123
query62	820	724	681	681
query63	226	190	185	185
query64	4328	1022	678	678
query65	4245	4137	4185	4137
query66	1117	406	332	332
query67	15856	15851	15348	15348
query68	8105	904	541	541
query69	464	311	281	281
query70	1208	1173	1033	1033
query71	468	341	296	296
query72	5359	4778	4935	4778
query73	754	669	368	368
query74	9178	9053	8773	8773
query75	3783	3201	2695	2695
query76	3666	1191	775	775
query77	801	373	305	305
query78	9922	10251	9416	9416
query79	1835	838	577	577
query80	665	521	457	457
query81	471	255	229	229
query82	415	127	108	108
query83	279	259	231	231
query84	300	108	89	89
query85	857	354	313	313
query86	337	298	306	298
query87	4476	4450	4323	4323
query88	2901	2269	2261	2261
query89	376	319	284	284
query90	1977	211	203	203
query91	135	145	111	111
query92	78	60	61	60
query93	1099	977	602	602
query94	679	415	316	316
query95	379	294	279	279
query96	503	561	279	279
query97	2734	2797	2666	2666
query98	229	210	204	204
query99	1461	1419	1275	1275
Total cold run time: 272586 ms
Total hot run time: 186020 ms

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34140 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c810922fb08c69c8858b59c2681d9fdbc9a50ef5, data reload: false

------ Round 1 ----------------------------------
q1	17575	5149	5072	5072
q2	1939	293	190	190
q3	10300	1301	719	719
q4	10234	1029	520	520
q5	7609	2388	2381	2381
q6	187	167	133	133
q7	918	763	598	598
q8	9303	1341	1121	1121
q9	6784	5139	5133	5133
q10	6896	2406	1951	1951
q11	498	286	270	270
q12	340	350	230	230
q13	17767	3660	3024	3024
q14	232	234	216	216
q15	563	488	494	488
q16	425	427	372	372
q17	583	871	389	389
q18	7781	7258	7217	7217
q19	1213	946	565	565
q20	325	342	222	222
q21	3715	3236	2322	2322
q22	1094	1053	1007	1007
Total cold run time: 106281 ms
Total hot run time: 34140 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5169	5103	5113	5103
q2	248	328	227	227
q3	2294	2700	2312	2312
q4	1350	1783	1368	1368
q5	4219	4429	4502	4429
q6	213	171	128	128
q7	1991	1911	1768	1768
q8	2621	2589	2570	2570
q9	7103	7139	7184	7139
q10	3082	3354	2906	2906
q11	599	510	489	489
q12	691	788	622	622
q13	3464	3868	3247	3247
q14	287	298	263	263
q15	532	483	478	478
q16	454	495	424	424
q17	1132	1457	1338	1338
q18	7588	7342	6962	6962
q19	786	814	1043	814
q20	1914	1974	1809	1809
q21	4783	4482	4241	4241
q22	1087	1113	988	988
Total cold run time: 51607 ms
Total hot run time: 49625 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185859 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c810922fb08c69c8858b59c2681d9fdbc9a50ef5, data reload: false

query1	993	397	404	397
query2	6535	1833	1844	1833
query3	6746	219	213	213
query4	26108	23359	23080	23080
query5	4367	631	465	465
query6	294	206	189	189
query7	4623	488	285	285
query8	287	218	206	206
query9	8586	2628	2637	2628
query10	486	331	269	269
query11	15228	15036	14849	14849
query12	169	111	106	106
query13	1660	550	434	434
query14	8803	6256	6241	6241
query15	207	197	172	172
query16	7258	638	471	471
query17	1226	758	593	593
query18	1990	420	307	307
query19	196	194	163	163
query20	123	119	118	118
query21	213	128	109	109
query22	4004	4152	4062	4062
query23	33990	32991	33064	32991
query24	8482	2355	2380	2355
query25	561	457	403	403
query26	1217	262	149	149
query27	2775	518	346	346
query28	4298	2152	2124	2124
query29	827	552	436	436
query30	290	223	193	193
query31	924	867	776	776
query32	73	65	65	65
query33	554	349	314	314
query34	785	869	541	541
query35	800	822	717	717
query36	931	990	849	849
query37	114	102	100	100
query38	4021	4126	4003	4003
query39	1512	1420	1394	1394
query40	215	121	107	107
query41	62	61	60	60
query42	139	113	109	109
query43	494	495	476	476
query44	1326	827	824	824
query45	185	171	170	170
query46	858	1039	640	640
query47	1740	1779	1703	1703
query48	382	420	329	329
query49	727	484	398	398
query50	642	691	406	406
query51	4147	4116	4048	4048
query52	110	111	102	102
query53	229	251	192	192
query54	582	577	505	505
query55	86	83	82	82
query56	348	323	286	286
query57	1194	1202	1100	1100
query58	266	267	253	253
query59	2728	2626	2589	2589
query60	330	334	314	314
query61	129	125	126	125
query62	825	721	663	663
query63	226	201	188	188
query64	4374	1022	688	688
query65	4282	4194	4186	4186
query66	1168	411	310	310
query67	15731	15298	15319	15298
query68	7856	892	532	532
query69	494	313	293	293
query70	1258	1085	1098	1085
query71	475	354	304	304
query72	5821	4831	4930	4831
query73	726	685	355	355
query74	8873	8935	8970	8935
query75	3812	3199	2719	2719
query76	3495	1211	757	757
query77	789	405	299	299
query78	10155	10156	9404	9404
query79	2695	817	602	602
query80	689	531	455	455
query81	506	258	224	224
query82	460	129	101	101
query83	264	250	237	237
query84	247	106	91	91
query85	824	354	321	321
query86	384	315	266	266
query87	4353	4450	4415	4415
query88	3921	2259	2260	2259
query89	396	325	295	295
query90	1836	216	213	213
query91	140	139	109	109
query92	80	66	59	59
query93	2183	962	574	574
query94	679	418	312	312
query95	373	294	288	288
query96	503	577	280	280
query97	2697	2787	2656	2656
query98	248	212	211	211
query99	1346	1381	1280	1280
Total cold run time: 274359 ms
Total hot run time: 185859 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c810922fb08c69c8858b59c2681d9fdbc9a50ef5, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.06
query4	1.61	0.10	0.11
query5	0.43	0.43	0.40
query6	1.17	0.67	0.68
query7	0.03	0.01	0.02
query8	0.05	0.03	0.03
query9	0.57	0.51	0.52
query10	0.57	0.57	0.57
query11	0.14	0.12	0.11
query12	0.14	0.11	0.11
query13	0.63	0.60	0.62
query14	0.79	0.80	0.81
query15	0.90	0.84	0.87
query16	0.37	0.40	0.39
query17	1.04	1.08	1.04
query18	0.23	0.21	0.21
query19	1.96	1.82	1.80
query20	0.02	0.01	0.01
query21	15.45	0.90	0.56
query22	0.75	1.22	0.79
query23	14.78	1.40	0.65
query24	7.40	1.63	0.35
query25	0.32	0.19	0.06
query26	0.60	0.17	0.13
query27	0.06	0.06	0.05
query28	8.88	0.85	0.46
query29	12.55	3.98	3.24
query30	0.25	0.09	0.06
query31	2.84	0.59	0.40
query32	3.22	0.55	0.48
query33	3.08	3.12	3.05
query34	16.10	5.42	4.81
query35	4.88	4.83	4.81
query36	0.69	0.54	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.14
query41	0.09	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.36 s
Total hot run time: 29.04 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 26, 2025
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@starocean999 starocean999 merged commit 035f3de into apache:master Jun 26, 2025
25 of 27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zddr zddr zddr approved these changes

@starocean999 starocean999 starocean999 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@yx-keith @hello-stephen @doris-robot @zddr @starocean999