Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](delete) Fix delete stmt on MOW table doesn't use partial update in Nereids planner #38751

Merged
merged 5 commits into from
Aug 9, 2024
Merged

[fix](delete) Fix delete stmt on MOW table doesn't use partial update in Nereids planner #38751

merged 5 commits into from
Aug 9, 2024

Conversation

bobhan1
Copy link
Contributor

@bobhan1 bobhan1 commented Aug 2, 2024 •
edited
Loading

Proposed changes

  1. Fix nereids planner don't use partial update for delete statement on merge-on-write table introduced in [feat](nereids) support explain delete from clause #36782
  2. add IS_PARTIAL_UPDATE: true in OlapTableSink.getExplainString()
  3. don't convert the delete stmt to partial update if the table has cluster key.

branch-2.1-pick: #39214

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added the doing label Aug 2, 2024
@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 2, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41651 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0bb099ecd330297d6a703294f8f18c9f14f93428, data reload: false

------ Round 1 ----------------------------------
q1	17591	4168	4084	4084
q2	2022	223	199	199
q3	10446	1325	1337	1325
q4	10188	822	899	822
q5	7662	3011	2996	2996
q6	218	144	142	142
q7	1077	622	615	615
q8	9449	1774	1973	1774
q9	8510	6652	6602	6602
q10	8789	3857	3837	3837
q11	433	250	255	250
q12	409	239	233	233
q13	17752	2923	2957	2923
q14	271	243	240	240
q15	519	485	499	485
q16	525	403	403	403
q17	976	935	922	922
q18	8169	7308	7269	7269
q19	1869	1198	1218	1198
q20	564	318	329	318
q21	5380	4773	4736	4736
q22	348	278	278	278
Total cold run time: 113167 ms
Total hot run time: 41651 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4100	4054	4006	4006
q2	328	231	221	221
q3	3020	3012	3173	3012
q4	2004	2048	1999	1999
q5	5688	5466	5492	5466
q6	219	133	132	132
q7	2124	1778	1847	1778
q8	3300	3398	3352	3352
q9	8722	8699	8855	8699
q10	3943	4067	3962	3962
q11	568	461	473	461
q12	787	596	615	596
q13	16449	3170	3098	3098
q14	319	271	294	271
q15	532	513	477	477
q16	458	402	424	402
q17	1782	1692	1750	1692
q18	8391	7762	7714	7714
q19	1796	1739	1739	1739
q20	2048	1867	1844	1844
q21	5745	5458	5412	5412
q22	505	468	481	468
Total cold run time: 72828 ms
Total hot run time: 56801 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169621 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0bb099ecd330297d6a703294f8f18c9f14f93428, data reload: false

query1	922	380	370	370
query2	6443	1728	1670	1670
query3	6641	217	226	217
query4	20035	17577	17483	17483
query5	3630	514	523	514
query6	277	174	180	174
query7	4846	308	306	306
query8	256	198	219	198
query9	8517	2366	2367	2366
query10	442	287	273	273
query11	10529	10077	10204	10077
query12	122	92	86	86
query13	1648	390	388	388
query14	9321	6175	6428	6175
query15	218	161	158	158
query16	6983	469	466	466
query17	927	553	544	544
query18	1903	284	274	274
query19	193	143	140	140
query20	93	85	85	85
query21	206	101	103	101
query22	4253	4147	4120	4120
query23	34227	33792	33895	33792
query24	9378	3136	3038	3038
query25	621	427	411	411
query26	719	156	161	156
query27	2335	296	295	295
query28	5788	2006	1993	1993
query29	921	437	448	437
query30	243	150	163	150
query31	971	768	758	758
query32	103	65	59	59
query33	657	333	339	333
query34	987	508	520	508
query35	876	781	739	739
query36	1046	894	884	884
query37	132	82	81	81
query38	2847	2767	2811	2767
query39	886	802	808	802
query40	207	113	110	110
query41	46	44	43	43
query42	129	102	100	100
query43	458	439	420	420
query44	1187	754	742	742
query45	209	180	176	176
query46	1079	828	811	811
query47	1789	1692	1687	1687
query48	377	295	298	295
query49	836	421	419	419
query50	903	437	438	437
query51	6650	6692	6668	6668
query52	103	93	92	92
query53	264	193	188	188
query54	606	455	456	455
query55	82	74	76	74
query56	271	250	256	250
query57	1163	1068	1035	1035
query58	278	300	277	277
query59	2529	2331	2234	2234
query60	315	307	345	307
query61	94	91	92	91
query62	888	668	661	661
query63	214	185	181	181
query64	4146	1902	1880	1880
query65	3171	3096	3112	3096
query66	820	326	325	325
query67	15328	14963	14922	14922
query68	6014	574	596	574
query69	681	384	328	328
query70	1122	1097	1021	1021
query71	460	286	282	282
query72	7735	2652	2466	2466
query73	928	332	340	332
query74	6056	5693	5641	5641
query75	3607	2725	2748	2725
query76	3254	1282	1277	1277
query77	643	312	372	312
query78	9541	8886	8853	8853
query79	2240	540	540	540
query80	852	527	512	512
query81	535	227	225	225
query82	801	136	128	128
query83	191	172	175	172
query84	269	82	89	82
query85	1249	318	298	298
query86	469	293	295	293
query87	3240	3183	3062	3062
query88	3652	2510	2516	2510
query89	403	297	292	292
query90	1744	191	188	188
query91	122	101	104	101
query92	59	49	48	48
query93	1829	626	630	626
query94	743	306	298	298
query95	429	272	268	268
query96	604	291	288	288
query97	3252	3051	3061	3051
query98	224	196	200	196
query99	1605	1277	1268	1268
Total cold run time: 259837 ms
Total hot run time: 169621 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.79 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0bb099ecd330297d6a703294f8f18c9f14f93428, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.06
query5	0.48	0.48	0.49
query6	1.14	0.71	0.71
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.57	0.50	0.52
query10	0.58	0.56	0.56
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.64	0.61	0.62
query14	0.77	0.79	0.81
query15	0.89	0.86	0.87
query16	0.36	0.35	0.34
query17	0.99	1.03	1.00
query18	0.23	0.21	0.21
query19	1.85	1.76	1.73
query20	0.01	0.01	0.01
query21	15.40	0.77	0.66
query22	3.97	8.02	1.06
query23	17.82	1.39	1.36
query24	2.24	0.22	0.21
query25	0.18	0.07	0.07
query26	0.31	0.21	0.21
query27	0.46	0.22	0.22
query28	13.19	1.00	0.97
query29	12.51	3.30	3.30
query30	0.25	0.06	0.05
query31	2.86	0.41	0.40
query32	3.26	0.50	0.49
query33	2.95	3.00	2.93
query34	15.42	4.26	4.25
query35	4.29	4.28	4.30
query36	0.68	0.47	0.48
query37	0.19	0.16	0.16
query38	0.16	0.16	0.14
query39	0.04	0.04	0.03
query40	0.17	0.13	0.14
query41	0.10	0.04	0.04
query42	0.06	0.05	0.06
query43	0.05	0.04	0.04
Total cold run time: 107.48 s
Total hot run time: 29.79 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 2, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41713 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e051ed6be3dbbfdbbb99ec258333f73e1d5926d2, data reload: false

------ Round 1 ----------------------------------
q1	18811	4223	4163	4163
q2	2651	206	211	206
q3	12071	1360	1411	1360
q4	10741	859	951	859
q5	8581	2830	2957	2830
q6	223	142	143	142
q7	1066	635	625	625
q8	9433	1899	1945	1899
q9	8539	6597	6611	6597
q10	8687	3848	3836	3836
q11	419	256	249	249
q12	415	233	231	231
q13	17761	2955	2919	2919
q14	275	236	243	236
q15	530	481	496	481
q16	483	412	399	399
q17	993	898	882	882
q18	7949	7274	7236	7236
q19	1390	1212	1193	1193
q20	581	321	332	321
q21	5279	4803	4771	4771
q22	356	278	280	278
Total cold run time: 117234 ms
Total hot run time: 41713 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4082	4035	4057	4035
q2	325	220	218	218
q3	2977	2985	2976	2976
q4	1900	1838	1854	1838
q5	5242	5229	5246	5229
q6	217	132	137	132
q7	2089	1712	1705	1705
q8	3183	3243	3252	3243
q9	8320	8287	8307	8287
q10	3803	3847	3830	3830
q11	550	450	454	450
q12	743	540	535	535
q13	14935	2923	2923	2923
q14	284	266	248	248
q15	517	480	470	470
q16	442	406	403	403
q17	1707	1699	1699	1699
q18	7731	7301	7136	7136
q19	1662	1701	1669	1669
q20	1970	1737	1736	1736
q21	5389	5301	5201	5201
q22	526	457	473	457
Total cold run time: 68594 ms
Total hot run time: 54420 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 168394 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e051ed6be3dbbfdbbb99ec258333f73e1d5926d2, data reload: false

query1	908	378	372	372
query2	6483	1687	1682	1682
query3	6667	216	225	216
query4	19479	17308	17493	17308
query5	4307	526	534	526
query6	289	187	168	168
query7	4608	290	302	290
query8	259	198	199	198
query9	8525	2374	2337	2337
query10	467	272	266	266
query11	10494	10129	10038	10038
query12	138	88	83	83
query13	1635	373	378	373
query14	9874	6334	7538	6334
query15	204	160	172	160
query16	7082	437	447	437
query17	932	559	542	542
query18	1861	282	279	279
query19	191	141	142	141
query20	90	90	86	86
query21	206	98	97	97
query22	4215	4082	4025	4025
query23	33782	33026	32958	32958
query24	10262	3079	3028	3028
query25	688	388	376	376
query26	1770	147	153	147
query27	2928	272	276	272
query28	6919	1966	1951	1951
query29	1351	428	419	419
query30	286	151	152	151
query31	951	732	755	732
query32	108	52	57	52
query33	701	310	325	310
query34	950	475	490	475
query35	843	754	736	736
query36	1004	852	844	844
query37	300	79	78	78
query38	2855	2760	2738	2738
query39	855	811	815	811
query40	286	110	112	110
query41	47	48	43	43
query42	119	104	103	103
query43	473	407	407	407
query44	1199	746	743	743
query45	203	174	180	174
query46	1097	821	773	773
query47	1811	1720	1744	1720
query48	371	296	304	296
query49	1172	419	417	417
query50	894	432	430	430
query51	6886	6751	6654	6654
query52	103	90	95	90
query53	255	188	179	179
query54	629	497	479	479
query55	78	73	81	73
query56	275	270	254	254
query57	1161	1020	1071	1020
query58	273	286	282	282
query59	2483	2472	2411	2411
query60	296	278	269	269
query61	95	96	93	93
query62	928	666	684	666
query63	229	190	184	184
query64	5926	1928	1898	1898
query65	3179	3076	3148	3076
query66	1438	357	328	328
query67	15442	14911	14994	14911
query68	4389	569	588	569
query69	438	299	306	299
query70	1084	1062	1074	1062
query71	376	280	280	280
query72	7277	2704	2497	2497
query73	766	332	335	332
query74	6068	5619	5692	5619
query75	3396	2785	2724	2724
query76	2302	1224	1258	1224
query77	461	324	321	321
query78	9456	8921	8906	8906
query79	1959	533	551	533
query80	1234	512	508	508
query81	571	223	229	223
query82	1184	133	133	133
query83	248	173	170	170
query84	280	81	85	81
query85	1348	319	300	300
query86	425	309	296	296
query87	3253	3070	3091	3070
query88	3018	2501	2516	2501
query89	401	303	294	294
query90	1795	248	187	187
query91	127	100	101	100
query92	68	50	50	50
query93	1562	623	618	618
query94	921	299	290	290
query95	391	268	268	268
query96	600	283	282	282
query97	3236	3104	3074	3074
query98	211	203	193	193
query99	1657	1285	1271	1271
Total cold run time: 263317 ms
Total hot run time: 168394 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.92 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e051ed6be3dbbfdbbb99ec258333f73e1d5926d2, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.05	0.04
query3	0.22	0.06	0.06
query4	1.65	0.08	0.08
query5	0.51	0.48	0.48
query6	1.14	0.72	0.71
query7	0.02	0.02	0.01
query8	0.06	0.05	0.05
query9	0.58	0.52	0.52
query10	0.57	0.56	0.56
query11	0.15	0.12	0.12
query12	0.14	0.12	0.13
query13	0.61	0.60	0.60
query14	0.77	0.79	0.80
query15	0.92	0.86	0.86
query16	0.35	0.36	0.36
query17	1.00	1.01	1.00
query18	0.23	0.21	0.22
query19	1.84	1.79	1.75
query20	0.02	0.01	0.01
query21	15.42	0.75	0.65
query22	4.12	7.18	1.12
query23	17.70	1.33	1.33
query24	2.25	0.23	0.22
query25	0.19	0.08	0.08
query26	0.31	0.21	0.21
query27	0.46	0.22	0.24
query28	13.16	0.99	0.98
query29	12.55	3.33	3.30
query30	0.26	0.06	0.06
query31	2.83	0.41	0.40
query32	3.25	0.50	0.48
query33	2.93	2.98	2.92
query34	15.42	4.26	4.23
query35	4.27	4.28	4.29
query36	0.68	0.47	0.48
query37	0.19	0.17	0.16
query38	0.17	0.16	0.15
query39	0.04	0.03	0.04
query40	0.16	0.14	0.13
query41	0.11	0.05	0.05
query42	0.06	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 107.49 s
Total hot run time: 29.92 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 2, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41534 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9562e891bcec42d496b1aa72ad0276ce1013ad96, data reload: false

------ Round 1 ----------------------------------
q1	17589	4066	4047	4047
q2	2027	210	195	195
q3	10474	1249	1366	1249
q4	10174	802	943	802
q5	7638	2971	2954	2954
q6	217	134	136	134
q7	1052	615	607	607
q8	9435	1921	1930	1921
q9	8523	6604	6586	6586
q10	8786	3854	3852	3852
q11	439	252	245	245
q12	430	232	231	231
q13	17761	2929	2961	2929
q14	271	238	242	238
q15	523	486	493	486
q16	529	404	387	387
q17	948	928	920	920
q18	8046	7233	7211	7211
q19	1370	1215	1216	1215
q20	557	323	339	323
q21	5244	4838	4720	4720
q22	362	282	288	282
Total cold run time: 112395 ms
Total hot run time: 41534 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4066	4023	4055	4023
q2	331	225	223	223
q3	2987	2998	3118	2998
q4	1959	2042	2015	2015
q5	5578	5544	5472	5472
q6	219	131	136	131
q7	2095	1754	1793	1754
q8	3344	3358	3326	3326
q9	8643	8606	8763	8606
q10	3967	4040	3974	3974
q11	549	465	474	465
q12	755	591	611	591
q13	15651	3092	3101	3092
q14	320	272	294	272
q15	526	487	494	487
q16	473	437	437	437
q17	1733	1718	1749	1718
q18	8200	7875	7661	7661
q19	1754	1710	1714	1710
q20	2054	1927	1822	1822
q21	5724	5563	5483	5483
q22	537	459	481	459
Total cold run time: 71465 ms
Total hot run time: 56719 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170156 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9562e891bcec42d496b1aa72ad0276ce1013ad96, data reload: false

query1	920	381	371	371
query2	6482	1669	1676	1669
query3	6645	219	222	219
query4	20197	17377	17267	17267
query5	3643	511	508	508
query6	307	180	163	163
query7	4594	325	299	299
query8	266	200	198	198
query9	8509	2350	2362	2350
query10	443	271	271	271
query11	10520	10141	10130	10130
query12	129	90	86	86
query13	1622	384	384	384
query14	8319	7704	7628	7628
query15	212	164	167	164
query16	6864	459	480	459
query17	948	560	545	545
query18	1888	277	284	277
query19	197	144	142	142
query20	90	83	85	83
query21	201	100	98	98
query22	4157	4013	4146	4013
query23	33841	33825	33241	33241
query24	9386	3121	3057	3057
query25	672	398	398	398
query26	1336	152	148	148
query27	2985	288	299	288
query28	7559	2026	1992	1992
query29	979	433	460	433
query30	239	153	155	153
query31	969	786	761	761
query32	105	54	55	54
query33	669	310	332	310
query34	935	507	516	507
query35	884	782	744	744
query36	1047	882	909	882
query37	174	91	86	86
query38	2993	2880	2838	2838
query39	888	833	848	833
query40	201	110	114	110
query41	45	43	44	43
query42	133	98	96	96
query43	459	404	412	404
query44	1202	751	734	734
query45	210	178	179	178
query46	1080	783	797	783
query47	1782	1707	1715	1707
query48	373	300	302	300
query49	856	434	418	418
query50	897	434	436	434
query51	6776	6810	6717	6717
query52	104	88	88	88
query53	254	185	188	185
query54	608	454	455	454
query55	77	75	74	74
query56	267	256	256	256
query57	1135	1036	1025	1025
query58	259	265	271	265
query59	2619	2368	2269	2269
query60	324	276	275	275
query61	106	104	118	104
query62	888	650	665	650
query63	215	183	178	178
query64	4507	1902	1907	1902
query65	3188	3139	3105	3105
query66	828	328	326	326
query67	15189	14748	14830	14748
query68	4396	579	572	572
query69	464	368	302	302
query70	1135	1054	1076	1054
query71	395	281	279	279
query72	7135	2682	2517	2517
query73	775	333	337	333
query74	6071	5678	5614	5614
query75	3393	2699	2744	2699
query76	2182	1197	1266	1197
query77	419	313	310	310
query78	9403	8890	8967	8890
query79	1934	538	530	530
query80	1198	503	501	501
query81	578	226	230	226
query82	1054	132	138	132
query83	237	167	165	165
query84	266	83	83	83
query85	1121	320	294	294
query86	397	309	278	278
query87	3322	3125	3171	3125
query88	2996	2531	2528	2528
query89	393	292	296	292
query90	1707	193	186	186
query91	126	98	100	98
query92	56	49	50	49
query93	1550	610	621	610
query94	777	295	296	295
query95	380	265	265	265
query96	609	290	283	283
query97	3209	3098	3086	3086
query98	219	204	205	204
query99	1711	1286	1282	1282
Total cold run time: 257004 ms
Total hot run time: 170156 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.82 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9562e891bcec42d496b1aa72ad0276ce1013ad96, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.06
query5	0.47	0.48	0.48
query6	1.14	0.71	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.58	0.52	0.50
query10	0.55	0.56	0.56
query11	0.16	0.12	0.12
query12	0.16	0.12	0.13
query13	0.62	0.61	0.61
query14	0.79	0.81	0.83
query15	0.91	0.88	0.87
query16	0.37	0.37	0.36
query17	1.00	0.98	0.98
query18	0.22	0.21	0.22
query19	1.86	1.77	1.72
query20	0.02	0.01	0.01
query21	15.42	0.76	0.65
query22	4.20	9.23	0.94
query23	17.82	1.42	1.29
query24	2.28	0.23	0.22
query25	0.18	0.08	0.08
query26	0.32	0.23	0.22
query27	0.47	0.24	0.22
query28	13.18	1.01	0.98
query29	12.50	3.36	3.38
query30	0.26	0.06	0.05
query31	2.85	0.41	0.41
query32	3.23	0.50	0.48
query33	2.96	2.99	3.00
query34	15.46	4.23	4.26
query35	4.35	4.31	4.33
query36	0.67	0.49	0.47
query37	0.19	0.18	0.16
query38	0.17	0.16	0.16
query39	0.04	0.04	0.04
query40	0.15	0.12	0.14
query41	0.10	0.05	0.05
query42	0.06	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 107.86 s
Total hot run time: 29.82 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 2, 2024

run p0

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 5, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41386 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e99ea9d0036a993c32b2c42e5adfa91e1994641d, data reload: false

------ Round 1 ----------------------------------
q1	18065	4215	4147	4147
q2	2294	200	197	197
q3	10526	1297	1286	1286
q4	10171	812	876	812
q5	7616	2921	2952	2921
q6	218	138	133	133
q7	1051	609	615	609
q8	9439	1886	1969	1886
q9	8387	6564	6585	6564
q10	8698	3852	3828	3828
q11	422	251	249	249
q12	412	229	231	229
q13	17774	2936	2938	2936
q14	271	246	244	244
q15	524	484	494	484
q16	499	409	390	390
q17	962	923	884	884
q18	8174	7370	7149	7149
q19	1387	1212	1221	1212
q20	557	312	338	312
q21	5278	4640	4687	4640
q22	346	280	274	274
Total cold run time: 113071 ms
Total hot run time: 41386 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4076	4027	4110	4027
q2	357	224	216	216
q3	2982	2970	2986	2970
q4	1880	1870	1826	1826
q5	5213	5223	5217	5217
q6	219	129	127	127
q7	2054	1696	1681	1681
q8	3165	3238	3241	3238
q9	8285	8302	8288	8288
q10	3745	3811	3836	3811
q11	549	451	452	451
q12	747	549	572	549
q13	14227	2926	2933	2926
q14	292	255	250	250
q15	516	476	473	473
q16	441	396	391	391
q17	1716	1695	1690	1690
q18	7691	7253	7164	7164
q19	1663	1672	1650	1650
q20	1970	1787	1755	1755
q21	5408	5208	5121	5121
q22	518	453	435	435
Total cold run time: 67714 ms
Total hot run time: 54256 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 168182 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e99ea9d0036a993c32b2c42e5adfa91e1994641d, data reload: false

query1	911	360	358	358
query2	6495	1617	1646	1617
query3	6666	212	226	212
query4	19152	17456	17401	17401
query5	4359	519	528	519
query6	294	194	165	165
query7	4604	302	289	289
query8	264	200	191	191
query9	8509	2372	2349	2349
query10	446	274	282	274
query11	10590	10058	10117	10058
query12	139	93	90	90
query13	1645	409	367	367
query14	9820	7083	6816	6816
query15	199	157	163	157
query16	7086	467	452	452
query17	932	558	536	536
query18	1741	274	272	272
query19	198	143	147	143
query20	92	83	87	83
query21	206	116	96	96
query22	4358	3970	3936	3936
query23	33958	32813	33115	32813
query24	10270	3045	3012	3012
query25	687	378	375	375
query26	1703	145	145	145
query27	2858	264	282	264
query28	6826	1956	1942	1942
query29	1239	440	409	409
query30	283	148	148	148
query31	899	765	752	752
query32	98	54	53	53
query33	698	301	308	301
query34	891	465	482	465
query35	856	733	736	733
query36	981	857	873	857
query37	293	76	78	76
query38	2841	2778	2770	2770
query39	860	821	805	805
query40	283	110	111	110
query41	46	43	44	43
query42	124	102	99	99
query43	457	405	417	405
query44	1185	746	725	725
query45	203	176	174	174
query46	1068	820	781	781
query47	1795	1718	1702	1702
query48	357	289	287	287
query49	1164	423	442	423
query50	897	435	431	431
query51	6765	6720	6685	6685
query52	100	87	90	87
query53	251	181	216	181
query54	624	448	445	445
query55	73	76	78	76
query56	281	249	254	249
query57	1172	1059	1052	1052
query58	269	255	270	255
query59	2623	2416	2307	2307
query60	309	277	275	275
query61	98	93	96	93
query62	916	661	668	661
query63	213	178	181	178
query64	5874	1936	1876	1876
query65	3160	3077	3075	3075
query66	1404	342	328	328
query67	15465	14814	15152	14814
query68	4299	550	577	550
query69	453	297	296	296
query70	1070	1035	1068	1035
query71	372	286	274	274
query72	7058	2656	2463	2463
query73	775	318	332	318
query74	6015	5752	5639	5639
query75	3315	2735	2735	2735
query76	2333	1175	1208	1175
query77	436	311	317	311
query78	9415	8990	8985	8985
query79	1587	530	542	530
query80	1198	513	520	513
query81	575	237	227	227
query82	1048	130	127	127
query83	236	172	170	170
query84	273	82	78	78
query85	1257	321	300	300
query86	377	292	297	292
query87	3252	3079	3087	3079
query88	2892	2380	2410	2380
query89	383	289	292	289
query90	1793	194	189	189
query91	177	101	101	101
query92	62	52	51	51
query93	1429	606	610	606
query94	868	296	284	284
query95	381	267	266	266
query96	613	274	271	271
query97	3209	3048	3042	3042
query98	223	195	195	195
query99	1656	1293	1293	1293
Total cold run time: 261153 ms
Total hot run time: 168182 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.82 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e99ea9d0036a993c32b2c42e5adfa91e1994641d, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.05
query3	0.23	0.05	0.04
query4	1.69	0.07	0.06
query5	0.48	0.48	0.49
query6	1.18	0.72	0.71
query7	0.02	0.01	0.01
query8	0.06	0.04	0.04
query9	0.58	0.50	0.51
query10	0.56	0.56	0.56
query11	0.15	0.12	0.11
query12	0.15	0.12	0.13
query13	0.62	0.62	0.59
query14	0.78	0.80	0.80
query15	0.93	0.86	0.86
query16	0.36	0.35	0.36
query17	1.00	1.00	1.05
query18	0.22	0.22	0.21
query19	1.80	1.72	1.76
query20	0.01	0.01	0.01
query21	15.40	0.77	0.65
query22	4.96	7.35	1.13
query23	17.82	1.41	1.37
query24	2.30	0.21	0.22
query25	0.19	0.08	0.08
query26	0.32	0.22	0.21
query27	0.45	0.23	0.23
query28	13.17	0.99	0.98
query29	12.59	3.27	3.28
query30	0.25	0.06	0.05
query31	2.88	0.41	0.41
query32	3.26	0.49	0.48
query33	2.89	2.91	3.01
query34	15.44	4.24	4.25
query35	4.27	4.26	4.29
query36	0.67	0.48	0.48
query37	0.19	0.16	0.16
query38	0.17	0.15	0.15
query39	0.04	0.03	0.04
query40	0.16	0.14	0.14
query41	0.10	0.05	0.04
query42	0.05	0.05	0.06
query43	0.05	0.04	0.04
Total cold run time: 108.55 s
Total hot run time: 29.82 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 5, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41552 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 835e64536a2db354d733ee70a8e80669085dfa6d, data reload: false

------ Round 1 ----------------------------------
q1	17690	4065	4047	4047
q2	2026	204	199	199
q3	10465	1377	1404	1377
q4	10170	918	925	918
q5	7640	2938	2960	2938
q6	220	137	139	137
q7	1053	645	616	616
q8	9440	1736	1934	1736
q9	8543	6578	6543	6543
q10	8747	3828	3829	3828
q11	431	251	260	251
q12	407	231	233	231
q13	17764	2993	2959	2959
q14	278	244	244	244
q15	528	488	501	488
q16	522	394	404	394
q17	951	954	920	920
q18	7972	7396	7289	7289
q19	1743	1164	1204	1164
q20	561	324	339	324
q21	5336	4777	4667	4667
q22	363	282	284	282
Total cold run time: 112850 ms
Total hot run time: 41552 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4087	4042	4089	4042
q2	329	225	228	225
q3	2992	2969	3137	2969
q4	1993	2036	1983	1983
q5	5628	5477	5449	5449
q6	219	133	134	133
q7	2164	1881	1833	1833
q8	3338	3354	3390	3354
q9	8622	8709	8758	8709
q10	3944	4003	3959	3959
q11	560	475	483	475
q12	790	625	626	625
q13	16538	3124	3147	3124
q14	299	267	287	267
q15	520	475	506	475
q16	464	429	417	417
q17	1752	1738	1736	1736
q18	8193	7716	7670	7670
q19	1760	1709	1702	1702
q20	2057	1844	1837	1837
q21	5698	5488	5421	5421
q22	528	488	476	476
Total cold run time: 72475 ms
Total hot run time: 56881 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169658 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 835e64536a2db354d733ee70a8e80669085dfa6d, data reload: false

query1	912	371	365	365
query2	6472	1669	1639	1639
query3	6663	213	221	213
query4	19748	17578	17428	17428
query5	3622	527	513	513
query6	274	171	164	164
query7	4597	299	295	295
query8	253	195	198	195
query9	8516	2385	2363	2363
query10	459	279	266	266
query11	10584	10094	9956	9956
query12	122	86	84	84
query13	1609	374	369	369
query14	9144	7758	6555	6555
query15	203	166	161	161
query16	6921	444	422	422
query17	940	560	576	560
query18	1905	281	288	281
query19	195	142	146	142
query20	95	86	86	86
query21	197	98	96	96
query22	4141	3978	4174	3978
query23	33607	33567	33670	33567
query24	10209	3145	3089	3089
query25	695	413	404	404
query26	1797	159	161	159
query27	3024	281	306	281
query28	7661	2037	2000	2000
query29	1269	464	449	449
query30	245	156	154	154
query31	957	769	759	759
query32	102	55	58	55
query33	670	336	324	324
query34	937	506	513	506
query35	897	782	767	767
query36	1026	897	905	897
query37	306	109	82	82
query38	2909	2887	2844	2844
query39	860	825	816	816
query40	251	117	114	114
query41	47	45	44	44
query42	115	99	101	99
query43	482	418	434	418
query44	1206	748	742	742
query45	210	179	185	179
query46	1083	821	808	808
query47	1801	1707	1687	1687
query48	366	290	289	289
query49	925	428	433	428
query50	894	443	437	437
query51	6751	6668	6680	6668
query52	105	94	91	91
query53	255	193	189	189
query54	649	454	461	454
query55	78	76	76	76
query56	273	260	265	260
query57	1141	1051	1052	1051
query58	276	270	318	270
query59	2717	2499	2419	2419
query60	296	275	274	274
query61	98	97	97	97
query62	885	654	671	654
query63	212	190	184	184
query64	5643	1917	1917	1917
query65	3161	3096	3105	3096
query66	1317	340	338	338
query67	15277	15001	14769	14769
query68	4241	583	587	583
query69	459	312	311	311
query70	1076	1079	1026	1026
query71	376	291	287	287
query72	7235	2811	2605	2605
query73	764	329	329	329
query74	6064	5701	5633	5633
query75	3350	2745	2746	2745
query76	2169	1233	1247	1233
query77	431	324	325	324
query78	9586	8885	8930	8885
query79	2369	557	561	557
query80	1403	542	535	535
query81	565	231	233	231
query82	774	141	139	139
query83	245	187	185	185
query84	268	88	82	82
query85	1825	311	304	304
query86	481	332	298	298
query87	3312	3125	3050	3050
query88	3851	2412	2422	2412
query89	387	293	290	290
query90	1775	195	198	195
query91	131	101	103	101
query92	66	50	51	50
query93	2524	617	627	617
query94	827	289	306	289
query95	391	273	270	270
query96	621	281	279	279
query97	3213	3002	3043	3002
query98	224	207	202	202
query99	1676	1273	1290	1273
Total cold run time: 263936 ms
Total hot run time: 169658 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.07 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 835e64536a2db354d733ee70a8e80669085dfa6d, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.03	0.04
query3	0.22	0.05	0.05
query4	1.73	0.07	0.07
query5	0.49	0.48	0.49
query6	1.14	0.72	0.72
query7	0.02	0.01	0.01
query8	0.06	0.05	0.05
query9	0.57	0.52	0.52
query10	0.56	0.57	0.57
query11	0.16	0.11	0.12
query12	0.15	0.12	0.13
query13	0.61	0.61	0.60
query14	0.78	0.79	0.80
query15	0.90	0.86	0.88
query16	0.36	0.36	0.35
query17	1.00	1.02	1.06
query18	0.22	0.21	0.22
query19	1.87	1.74	1.79
query20	0.01	0.01	0.01
query21	15.79	0.75	0.66
query22	4.14	6.70	1.23
query23	18.05	1.36	1.31
query24	2.25	0.22	0.21
query25	0.19	0.09	0.08
query26	0.31	0.21	0.22
query27	0.46	0.22	0.22
query28	13.18	1.00	0.97
query29	12.51	3.30	3.28
query30	0.26	0.06	0.06
query31	2.87	0.42	0.42
query32	3.23	0.49	0.49
query33	2.95	2.98	2.97
query34	15.45	4.25	4.24
query35	4.31	4.29	4.29
query36	0.66	0.48	0.49
query37	0.19	0.17	0.17
query38	0.15	0.15	0.15
query39	0.04	0.03	0.04
query40	0.15	0.12	0.12
query41	0.09	0.06	0.05
query42	0.06	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 108.31 s
Total hot run time: 30.07 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 5, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41744 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 52f5df3d215416b8b13f4f745d10ea8dc178146e, data reload: false

------ Round 1 ----------------------------------
q1	18271	4157	4128	4128
q2	2553	212	203	203
q3	11553	1324	1359	1324
q4	10271	828	938	828
q5	7724	3024	3022	3022
q6	224	144	146	144
q7	1072	650	644	644
q8	9456	1815	1937	1815
q9	8404	6574	6621	6574
q10	8698	3808	3813	3808
q11	433	254	250	250
q12	410	225	225	225
q13	17760	2927	2930	2927
q14	279	240	251	240
q15	523	489	508	489
q16	497	397	389	389
q17	957	879	920	879
q18	8000	7265	7250	7250
q19	1377	1220	1215	1215
q20	578	317	326	317
q21	5281	4878	4798	4798
q22	350	285	275	275
Total cold run time: 114671 ms
Total hot run time: 41744 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4069	4021	4022	4021
q2	326	219	220	219
q3	3015	3004	2993	2993
q4	1858	1874	1860	1860
q5	5263	5229	5212	5212
q6	216	129	130	129
q7	2020	1712	1680	1680
q8	3177	3246	3250	3246
q9	8291	8242	8256	8242
q10	3759	3828	3828	3828
q11	550	458	459	458
q12	724	609	533	533
q13	15489	2946	2952	2946
q14	294	257	262	257
q15	517	489	478	478
q16	448	408	402	402
q17	1721	1683	1696	1683
q18	7768	7380	7117	7117
q19	1678	1674	1663	1663
q20	1985	1755	1768	1755
q21	5383	5171	5186	5171
q22	510	442	440	440
Total cold run time: 69061 ms
Total hot run time: 54333 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 168055 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 52f5df3d215416b8b13f4f745d10ea8dc178146e, data reload: false

query1	914	372	366	366
query2	6477	1677	1684	1677
query3	6683	213	225	213
query4	19416	17630	17312	17312
query5	4267	524	516	516
query6	285	167	160	160
query7	4608	291	287	287
query8	257	198	200	198
query9	8520	2379	2372	2372
query10	449	272	275	272
query11	10422	9917	9987	9917
query12	137	95	91	91
query13	1642	371	370	370
query14	9342	6756	7651	6756
query15	200	165	165	165
query16	7080	467	478	467
query17	954	585	564	564
query18	1787	287	284	284
query19	194	149	152	149
query20	99	89	92	89
query21	211	100	102	100
query22	4177	4102	3968	3968
query23	33710	32805	32831	32805
query24	10442	2995	3057	2995
query25	716	407	418	407
query26	1783	155	153	153
query27	2902	276	284	276
query28	6936	1989	1979	1979
query29	1304	493	403	403
query30	288	150	149	149
query31	934	761	761	761
query32	105	59	59	59
query33	705	310	332	310
query34	899	469	478	469
query35	845	730	717	717
query36	972	844	858	844
query37	289	77	75	75
query38	2881	2790	2772	2772
query39	863	797	810	797
query40	279	126	112	112
query41	46	46	44	44
query42	124	108	107	107
query43	490	420	421	420
query44	1162	727	733	727
query45	203	173	175	173
query46	1094	807	785	785
query47	1847	1720	1723	1720
query48	356	291	290	290
query49	1202	435	426	426
query50	906	431	427	427
query51	6663	6766	6660	6660
query52	111	89	90	89
query53	263	181	182	181
query54	635	469	451	451
query55	76	80	74	74
query56	286	262	258	258
query57	1147	1067	1040	1040
query58	288	262	287	262
query59	2669	2263	2337	2263
query60	291	268	268	268
query61	110	93	100	93
query62	916	652	675	652
query63	221	182	186	182
query64	5972	1905	1872	1872
query65	3158	3074	3102	3074
query66	1409	332	340	332
query67	15513	14992	14819	14819
query68	4455	574	575	574
query69	541	315	300	300
query70	1011	1045	1106	1045
query71	444	280	273	273
query72	7861	2693	2465	2465
query73	774	330	325	325
query74	5999	5621	5652	5621
query75	3858	2765	2700	2700
query76	2884	1157	1268	1157
query77	681	317	327	317
query78	9439	8912	8930	8912
query79	2722	542	554	542
query80	1036	532	510	510
query81	574	223	227	223
query82	786	137	135	135
query83	323	178	232	178
query84	284	77	91	77
query85	1678	330	299	299
query86	453	294	317	294
query87	3273	3079	3078	3078
query88	3812	2391	2411	2391
query89	383	287	291	287
query90	1966	197	232	197
query91	125	103	99	99
query92	59	53	53	53
query93	2296	614	623	614
query94	976	294	306	294
query95	372	270	258	258
query96	612	276	281	276
query97	3235	3071	3041	3041
query98	215	200	198	198
query99	1609	1293	1257	1257
Total cold run time: 266868 ms
Total hot run time: 168055 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.45 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 52f5df3d215416b8b13f4f745d10ea8dc178146e, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.07	0.07
query5	0.49	0.48	0.49
query6	1.14	0.72	0.72
query7	0.02	0.01	0.02
query8	0.06	0.05	0.04
query9	0.56	0.52	0.51
query10	0.56	0.58	0.58
query11	0.16	0.12	0.12
query12	0.14	0.12	0.12
query13	0.61	0.61	0.60
query14	0.78	0.81	0.80
query15	0.94	0.87	0.86
query16	0.36	0.36	0.36
query17	1.00	1.01	1.04
query18	0.22	0.22	0.21
query19	1.90	1.74	1.72
query20	0.01	0.01	0.02
query21	15.40	0.78	0.66
query22	4.34	7.35	1.60
query23	18.07	1.39	1.35
query24	2.23	0.23	0.22
query25	0.18	0.08	0.08
query26	0.33	0.22	0.22
query27	0.46	0.23	0.22
query28	13.19	1.00	0.99
query29	12.52	3.32	3.27
query30	0.26	0.06	0.06
query31	2.85	0.42	0.41
query32	3.22	0.50	0.48
query33	3.01	2.92	3.00
query34	15.45	4.25	4.26
query35	4.28	4.28	4.27
query36	0.70	0.49	0.49
query37	0.19	0.16	0.17
query38	0.17	0.15	0.16
query39	0.05	0.03	0.04
query40	0.17	0.13	0.13
query41	0.11	0.04	0.04
query42	0.05	0.06	0.06
query43	0.05	0.05	0.04
Total cold run time: 108.23 s
Total hot run time: 30.45 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 6, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41373 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3348ea188e842c0e88e0a8887ae4a3369ff20be4, data reload: false

------ Round 1 ----------------------------------
q1	17655	4123	4083	4083
q2	2022	204	204	204
q3	10433	1259	1313	1259
q4	10174	817	882	817
q5	7644	2969	2961	2961
q6	219	136	140	136
q7	1056	628	627	627
q8	9434	1842	1933	1842
q9	8555	6593	6539	6539
q10	8719	3837	3833	3833
q11	439	254	241	241
q12	433	234	232	232
q13	17764	2941	2945	2941
q14	269	247	243	243
q15	517	487	484	484
q16	523	394	393	393
q17	968	920	906	906
q18	8093	7316	7160	7160
q19	1783	1199	1218	1199
q20	569	321	331	321
q21	5277	4670	4764	4670
q22	347	282	285	282
Total cold run time: 112893 ms
Total hot run time: 41373 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4084	4056	4124	4056
q2	333	223	217	217
q3	3004	2990	3136	2990
q4	1981	2048	1972	1972
q5	5635	5434	5415	5415
q6	221	132	131	131
q7	2108	1766	1864	1766
q8	3294	3351	3327	3327
q9	8645	8584	8847	8584
q10	3950	4054	3895	3895
q11	551	459	466	459
q12	780	584	589	584
q13	16427	3105	3157	3105
q14	297	280	287	280
q15	519	481	496	481
q16	485	428	431	428
q17	1760	1760	1756	1756
q18	8238	7743	7638	7638
q19	1734	1740	1773	1740
q20	2058	1830	1837	1830
q21	5709	5380	5490	5380
q22	513	462	482	462
Total cold run time: 72326 ms
Total hot run time: 56496 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170471 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3348ea188e842c0e88e0a8887ae4a3369ff20be4, data reload: false

query1	908	379	368	368
query2	6466	1792	1731	1731
query3	6664	211	223	211
query4	20352	17389	17402	17389
query5	3642	529	522	522
query6	279	157	164	157
query7	4595	306	291	291
query8	260	194	196	194
query9	8497	2389	2379	2379
query10	450	288	274	274
query11	10633	10051	10161	10051
query12	119	86	90	86
query13	1627	384	376	376
query14	10092	7465	7762	7465
query15	211	169	165	165
query16	6865	467	485	467
query17	970	574	563	563
query18	1791	294	284	284
query19	203	152	150	150
query20	95	89	88	88
query21	208	101	101	101
query22	4182	4153	3946	3946
query23	33910	33629	33366	33366
query24	10319	3128	3156	3128
query25	699	450	502	450
query26	1666	153	157	153
query27	2808	287	290	287
query28	7414	2053	2037	2037
query29	1180	454	447	447
query30	240	158	161	158
query31	950	780	776	776
query32	104	53	56	53
query33	687	349	354	349
query34	932	501	510	501
query35	889	760	773	760
query36	1061	884	899	884
query37	280	88	88	88
query38	2994	2785	2779	2779
query39	898	830	836	830
query40	253	113	110	110
query41	45	47	44	44
query42	121	102	107	102
query43	489	460	418	418
query44	1213	737	734	734
query45	216	177	181	177
query46	1102	831	810	810
query47	1808	1732	1681	1681
query48	375	291	291	291
query49	949	420	433	420
query50	912	443	443	443
query51	6757	6605	6609	6605
query52	102	86	92	86
query53	258	190	180	180
query54	664	453	468	453
query55	82	74	77	74
query56	289	252	256	252
query57	1161	1051	1054	1051
query58	277	266	274	266
query59	2509	2524	2309	2309
query60	297	281	277	277
query61	100	95	95	95
query62	868	650	664	650
query63	227	186	190	186
query64	5706	1911	1884	1884
query65	3197	3106	3108	3106
query66	1293	327	328	327
query67	15225	14824	14848	14824
query68	5987	580	575	575
query69	702	390	324	324
query70	1139	1040	1087	1040
query71	480	286	280	280
query72	7533	2681	2524	2524
query73	932	328	326	326
query74	6040	5657	5701	5657
query75	3797	2735	2716	2716
query76	3572	1293	1297	1293
query77	663	316	318	316
query78	9514	8847	8896	8847
query79	2277	541	527	527
query80	847	522	514	514
query81	544	220	225	220
query82	1450	139	146	139
query83	198	169	171	169
query84	268	81	80	80
query85	1424	320	374	320
query86	490	298	341	298
query87	3191	3100	3101	3100
query88	3697	2418	2417	2417
query89	394	286	289	286
query90	1803	200	191	191
query91	128	106	104	104
query92	59	53	53	53
query93	2105	614	625	614
query94	764	311	293	293
query95	385	270	265	265
query96	607	286	281	281
query97	3212	3055	3057	3055
query98	220	209	203	203
query99	1573	1285	1316	1285
Total cold run time: 268630 ms
Total hot run time: 170471 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.15 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3348ea188e842c0e88e0a8887ae4a3369ff20be4, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.48	0.49	0.48
query6	1.16	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.53
query10	0.56	0.59	0.57
query11	0.16	0.12	0.11
query12	0.14	0.12	0.12
query13	0.61	0.60	0.60
query14	0.78	0.81	0.79
query15	0.90	0.86	0.86
query16	0.34	0.35	0.35
query17	0.97	1.00	1.02
query18	0.22	0.22	0.21
query19	1.88	1.74	1.76
query20	0.01	0.01	0.02
query21	15.41	0.73	0.64
query22	4.00	7.86	1.43
query23	18.03	1.38	1.33
query24	2.28	0.22	0.22
query25	0.18	0.07	0.08
query26	0.32	0.23	0.21
query27	0.46	0.23	0.22
query28	13.18	0.99	0.96
query29	12.54	3.25	3.27
query30	0.26	0.07	0.06
query31	2.85	0.40	0.41
query32	3.23	0.50	0.49
query33	2.93	2.97	2.95
query34	15.42	4.24	4.24
query35	4.32	4.28	4.28
query36	0.68	0.49	0.48
query37	0.19	0.16	0.16
query38	0.16	0.15	0.14
query39	0.04	0.04	0.04
query40	0.16	0.13	0.12
query41	0.10	0.05	0.05
query42	0.05	0.05	0.04
query43	0.05	0.05	0.04
Total cold run time: 107.72 s
Total hot run time: 30.15 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 6, 2024

run cloud_p0

1 similar comment
@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 7, 2024

run cloud_p0

zhannngchen
zhannngchen reviewed Aug 7, 2024
View reviewed changes
regression-test/suites/delete_p0/test_delete_predicate_on_value.groovy
@@ -134,23 +135,17 @@ suite("test_delete_on_value") {
// test mor table
sql "insert into ${tableName4} values(1,1,10);"
sql "insert into ${tableName4} values(1,1,5);"
qt_sql "select * from ${tableName4} order by x,y,z;"
sql "set skip_storage_engine_merge=true;"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why remove these operations?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's case irrelevant

zhannngchen
zhannngchen approved these changes Aug 8, 2024
View reviewed changes
Copy link
Contributor

@zhannngchen zhannngchen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 8, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 8, 2024

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 8, 2024

PR approved by anyone and no changes requested.

dataroaring
dataroaring approved these changes Aug 9, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

dataroaring
dataroaring approved these changes Aug 9, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit bc4390d into apache:master Aug 9, 2024
34 of 37 checks passed
dataroaring pushed a commit that referenced this pull request Aug 9, 2024
@bobhan1 @dataroaring
[fix](delete) Fix delete stmt on MOW table doesn't use partial update…
1aabe5a 
… in Nereids planner (#38751)

## Proposed changes

1. Fix nereids planner don't use partial update for delete statement on
merge-on-write table introduced in
#36782
2. add `IS_PARTIAL_UPDATE: true` in `OlapTableSink.getExplainString()`
3. don't convert the delete stmt to partial update if the table has
cluster key.
@bobhan1 bobhan1 mentioned this pull request Aug 12, 2024
Merged
dataroaring pushed a commit that referenced this pull request Aug 12, 2024
@bobhan1
[branch-2.1] Picks "[fix](delete) Fix delete stmt on MOW table doesn'…
c204440 
…t use partial update in Nereids planner #38751" (#39214)

## Proposed changes

picks #38751
wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request Aug 14, 2024
@bobhan1 @wyxxxcat
[fix](delete) Fix delete stmt on MOW table doesn't use partial update…
8e22b34 
… in Nereids planner (apache#38751)

## Proposed changes

1. Fix nereids planner don't use partial update for delete statement on
merge-on-write table introduced in
apache#36782
2. add `IS_PARTIAL_UPDATE: true` in `OlapTableSink.getExplainString()`
3. don't convert the delete stmt to partial update if the table has
cluster key.
@gavinchou gavinchou mentioned this pull request Aug 19, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zhannngchen zhannngchen zhannngchen approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.1-merged doing reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@bobhan1 @doris-robot @zhannngchen @dataroaring