Skip to content

[Test](nereids) Add materialized view availability regression test#30769

Merged
morrySnow merged 7 commits into
apache:masterfrom
seawinde:add_graceful_period_test
Feb 4, 2024
Merged

[Test](nereids) Add materialized view availability regression test#30769
morrySnow merged 7 commits into
apache:masterfrom
seawinde:add_graceful_period_test

Conversation

@seawinde
Copy link
Copy Markdown
Member

@seawinde seawinde commented Feb 2, 2024

Proposed changes

Add materialized view availability regression test

when mv refresh_time is in the grace_period(unit is second), materialized view will be use to
query rewrite regardless of the base table is update or not
when mv refresh_time is out of the grace_period(unit is second), will check the base table is update or not
if update the materialized view will not be used to query rewrite

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@seawinde
Copy link
Copy Markdown
Member Author

seawinde commented Feb 3, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 36715 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 255970328b78067adcdc1387576d86ea550ce8a5, data reload: false

------ Round 1 ----------------------------------
q1	17658	4523	4415	4415
q2	2036	137	134	134
q3	10613	909	921	909
q4	4649	680	737	680
q5	7686	2827	2885	2827
q6	181	122	115	115
q7	1142	719	703	703
q8	9309	1980	1994	1980
q9	7216	6313	6338	6313
q10	8068	2422	2413	2413
q11	414	215	214	214
q12	741	276	267	267
q13	18013	3289	3286	3286
q14	288	242	254	242
q15	527	495	499	495
q16	478	406	430	406
q17	934	557	524	524
q18	6812	5892	5979	5892
q19	1566	1342	1307	1307
q20	584	331	327	327
q21	6736	3053	2974	2974
q22	814	292	298	292
Total cold run time: 106465 ms
Total hot run time: 36715 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4412	4369	4353	4353
q2	334	222	228	222
q3	2949	2850	2800	2800
q4	1807	1676	1667	1667
q5	5156	5182	5200	5182
q6	192	113	112	112
q7	2127	1770	1731	1731
q8	3100	3266	3236	3236
q9	8373	8269	8289	8269
q10	5853	3539	3597	3539
q11	548	453	483	453
q12	717	569	571	569
q13	13174	3092	3062	3062
q14	289	256	255	255
q15	534	493	478	478
q16	509	471	484	471
q17	1856	1690	1707	1690
q18	8021	7633	7470	7470
q19	11182	1579	1561	1561
q20	2142	1927	1906	1906
q21	4787	4555	4492	4492
q22	530	495	464	464
Total cold run time: 78592 ms
Total hot run time: 53982 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 173878 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 255970328b78067adcdc1387576d86ea550ce8a5, data reload: false

query1	927	344	328	328
query2	6564	2031	1885	1885
query3	6689	211	213	211
query4	32181	22119	21994	21994
query5	4271	425	348	348
query6	257	169	169	169
query7	4617	278	277	277
query8	245	164	178	164
query9	9097	2328	2328	2328
query10	411	218	208	208
query11	18781	15362	15353	15353
query12	131	77	73	73
query13	1619	409	417	409
query14	9431	7089	6962	6962
query15	231	176	184	176
query16	8091	255	243	243
query17	1846	534	492	492
query18	2111	264	259	259
query19	355	139	136	136
query20	79	73	79	73
query21	194	131	129	129
query22	4830	4733	4338	4338
query23	30791	30043	29921	29921
query24	6317	2809	2799	2799
query25	536	346	349	346
query26	712	149	144	144
query27	1952	294	308	294
query28	3542	1883	1872	1872
query29	856	601	587	587
query30	264	132	144	132
query31	944	711	720	711
query32	88	49	49	49
query33	448	220	234	220
query34	813	447	470	447
query35	840	765	747	747
query36	1044	907	949	907
query37	93	56	55	55
query38	3239	3115	3096	3096
query39	1338	1258	1248	1248
query40	178	96	93	93
query41	37	34	34	34
query42	100	91	93	91
query43	533	460	497	460
query44	1044	694	708	694
query45	197	187	174	174
query46	1024	650	657	650
query47	1557	1533	1446	1446
query48	439	366	350	350
query49	925	298	285	285
query50	753	378	370	370
query51	5245	5119	5081	5081
query52	108	81	87	81
query53	331	273	270	270
query54	254	219	217	217
query55	83	72	76	72
query56	214	209	200	200
query57	981	907	885	885
query58	206	175	184	175
query59	2491	2411	2166	2166
query60	235	207	212	207
query61	84	91	84	84
query62	577	358	369	358
query63	287	269	269	269
query64	4578	3580	3702	3580
query65	3250	3226	3217	3217
query66	821	316	305	305
query67	14326	14044	13975	13975
query68	4049	548	546	546
query69	452	328	322	322
query70	1295	1256	1216	1216
query71	318	256	263	256
query72	6101	2843	2694	2694
query73	690	324	327	324
query74	6536	6282	6167	6167
query75	3023	2327	2362	2327
query76	2581	988	1013	988
query77	342	240	226	226
query78	9070	8914	8571	8571
query79	3006	511	479	479
query80	2037	348	333	333
query81	508	194	196	194
query82	752	82	87	82
query83	263	126	130	126
query84	285	81	90	81
query85	1821	347	338	338
query86	498	296	285	285
query87	3385	3148	3258	3148
query88	3822	2316	2321	2316
query89	463	371	371	371
query90	1951	165	165	165
query91	157	117	122	117
query92	56	43	43	43
query93	3123	488	463	463
query94	1198	171	172	171
query95	475	362	357	357
query96	593	271	271	271
query97	4244	4121	4105	4105
query98	224	194	196	194
query99	1184	683	686	683
Total cold run time: 272135 ms
Total hot run time: 173878 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 31.18 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 255970328b78067adcdc1387576d86ea550ce8a5, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.02
query3	0.23	0.06	0.06
query4	1.65	0.09	0.10
query5	0.53	0.51	0.51
query6	1.18	0.66	0.67
query7	0.02	0.02	0.01
query8	0.04	0.02	0.02
query9	0.56	0.49	0.49
query10	0.56	0.56	0.54
query11	0.12	0.08	0.09
query12	0.11	0.10	0.09
query13	0.60	0.60	0.61
query14	0.78	0.78	0.82
query15	0.81	0.79	0.77
query16	0.40	0.38	0.40
query17	1.03	1.00	1.02
query18	0.23	0.28	0.22
query19	1.85	1.76	1.72
query20	0.01	0.01	0.02
query21	15.42	0.60	0.58
query22	2.29	2.34	2.07
query23	17.14	0.85	0.76
query24	3.01	0.86	1.29
query25	0.31	0.11	0.16
query26	0.57	0.15	0.13
query27	0.06	0.06	0.06
query28	11.35	0.86	0.89
query29	12.53	3.27	3.25
query30	0.64	0.54	0.47
query31	2.78	0.35	0.35
query32	3.34	0.49	0.49
query33	3.22	3.27	3.24
query34	15.89	4.29	4.29
query35	4.28	4.30	4.25
query36	1.11	1.06	1.05
query37	0.06	0.05	0.05
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.14
query41	0.08	0.02	0.02
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 105.18 s
Total hot run time: 31.18 s

@doris-robot
Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 255970328b78067adcdc1387576d86ea550ce8a5 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@seawinde seawinde force-pushed the add_graceful_period_test branch from 2559703 to 97f9ba8 Compare February 4, 2024 01:06
@seawinde
Copy link
Copy Markdown
Member Author

seawinde commented Feb 4, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 36945 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97f9ba8e41803b9fbda7b01c937806d1c8b4b40c, data reload: false

------ Round 1 ----------------------------------
q1	17660	4455	4397	4397
q2	2038	139	138	138
q3	10592	903	946	903
q4	4645	675	736	675
q5	7701	2898	2914	2898
q6	183	120	121	120
q7	1108	725	721	721
q8	9268	1989	1972	1972
q9	7216	6396	6354	6354
q10	8049	2443	2450	2443
q11	417	203	213	203
q12	784	287	281	281
q13	18011	3288	3317	3288
q14	273	246	256	246
q15	527	498	487	487
q16	490	420	417	417
q17	927	479	510	479
q18	6715	5900	5980	5900
q19	1563	1361	1348	1348
q20	614	325	333	325
q21	6988	3059	3070	3059
q22	810	323	291	291
Total cold run time: 106579 ms
Total hot run time: 36945 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4389	4436	4383	4383
q2	340	233	227	227
q3	2984	2814	2797	2797
q4	1836	1584	1649	1584
q5	5202	5186	5142	5142
q6	189	113	114	113
q7	2094	1738	1741	1738
q8	3063	3253	3249	3249
q9	8248	8264	8255	8255
q10	5918	3547	3532	3532
q11	538	448	460	448
q12	703	592	559	559
q13	13016	3117	3114	3114
q14	294	245	260	245
q15	535	483	493	483
q16	511	468	463	463
q17	1837	1630	1671	1630
q18	7927	7841	7680	7680
q19	6722	1510	1518	1510
q20	2114	1911	1895	1895
q21	4690	4544	4517	4517
q22	544	475	507	475
Total cold run time: 73694 ms
Total hot run time: 54039 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 174012 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97f9ba8e41803b9fbda7b01c937806d1c8b4b40c, data reload: false

query1	926	342	328	328
query2	6561	2020	1964	1964
query3	6697	211	201	201
query4	31652	22048	21979	21979
query5	4256	358	412	358
query6	253	163	173	163
query7	4605	288	276	276
query8	248	172	179	172
query9	8963	2312	2313	2312
query10	421	205	208	205
query11	15929	15343	15302	15302
query12	126	74	75	74
query13	1640	417	424	417
query14	9549	6955	6831	6831
query15	238	179	182	179
query16	8146	256	238	238
query17	1891	537	505	505
query18	2124	270	258	258
query19	375	145	142	142
query20	79	76	78	76
query21	195	124	135	124
query22	4766	4599	4594	4594
query23	30740	30084	29977	29977
query24	6474	2760	2745	2745
query25	542	354	335	335
query26	709	141	148	141
query27	2134	298	295	295
query28	4920	1861	1858	1858
query29	862	626	595	595
query30	281	130	139	130
query31	947	709	722	709
query32	92	52	50	50
query33	477	217	214	214
query34	831	454	459	454
query35	865	770	749	749
query36	1047	898	916	898
query37	94	55	54	54
query38	3189	3132	3124	3124
query39	1304	1272	1242	1242
query40	181	96	89	89
query41	41	35	34	34
query42	96	87	90	87
query43	522	465	470	465
query44	1067	687	701	687
query45	190	179	176	176
query46	1041	660	661	660
query47	1614	1540	1517	1517
query48	421	348	359	348
query49	1043	285	284	284
query50	756	377	375	375
query51	5278	5118	5142	5118
query52	89	85	89	85
query53	327	274	269	269
query54	246	223	219	219
query55	83	70	74	70
query56	212	198	201	198
query57	989	867	899	867
query58	203	180	180	180
query59	2474	2305	2314	2305
query60	240	211	208	208
query61	83	83	82	82
query62	607	362	341	341
query63	290	270	266	266
query64	4728	3797	3401	3401
query65	3226	3223	3219	3219
query66	819	320	300	300
query67	14523	13954	14057	13954
query68	4440	526	529	526
query69	453	329	320	320
query70	1269	1257	1238	1238
query71	319	255	245	245
query72	5954	2847	2664	2664
query73	718	314	312	312
query74	6561	6212	6211	6211
query75	3068	2370	2356	2356
query76	2581	938	940	938
query77	346	223	233	223
query78	9177	8727	8581	8581
query79	2630	503	500	500
query80	1858	340	333	333
query81	544	192	195	192
query82	774	80	80	80
query83	247	130	123	123
query84	274	81	79	79
query85	2154	358	324	324
query86	479	288	286	286
query87	3372	3187	3255	3187
query88	3801	2320	2331	2320
query89	465	365	361	361
query90	1948	164	161	161
query91	148	118	121	118
query92	54	43	43	43
query93	2873	468	478	468
query94	1295	170	170	170
query95	7913	7761	348	348
query96	586	275	265	265
query97	4209	4107	4092	4092
query98	223	203	191	191
query99	1114	695	685	685
Total cold run time: 278384 ms
Total hot run time: 174012 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97f9ba8e41803b9fbda7b01c937806d1c8b4b40c, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.02
query3	0.23	0.06	0.06
query4	1.65	0.10	0.09
query5	0.53	0.52	0.52
query6	1.20	0.63	0.63
query7	0.03	0.01	0.01
query8	0.04	0.03	0.02
query9	0.55	0.51	0.49
query10	0.58	0.54	0.54
query11	0.13	0.09	0.09
query12	0.11	0.09	0.09
query13	0.61	0.60	0.59
query14	0.79	0.79	0.81
query15	0.80	0.78	0.77
query16	0.39	0.39	0.41
query17	1.01	1.02	0.99
query18	0.21	0.26	0.25
query19	1.77	1.78	1.78
query20	0.01	0.01	0.01
query21	15.40	0.58	0.59
query22	2.66	2.37	2.10
query23	17.31	0.85	0.89
query24	2.52	0.27	1.22
query25	0.31	0.14	0.20
query26	0.45	0.14	0.14
query27	0.05	0.05	0.05
query28	11.93	0.85	0.82
query29	12.49	3.21	3.30
query30	0.62	0.58	0.54
query31	2.79	0.34	0.35
query32	3.35	0.48	0.47
query33	3.19	3.22	3.22
query34	15.83	4.35	4.28
query35	4.36	4.30	4.31
query36	1.14	1.05	1.06
query37	0.06	0.04	0.05
query38	0.04	0.03	0.03
query39	0.02	0.01	0.02
query40	0.16	0.13	0.13
query41	0.07	0.02	0.01
query42	0.03	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 105.55 s
Total hot run time: 30.77 s

@doris-robot
Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 97f9ba8e41803b9fbda7b01c937806d1c8b4b40c with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.6 seconds inserted 10000000 Rows, about 735K ops/s

@seawinde
Copy link
Copy Markdown
Member Author

seawinde commented Feb 4, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 36818 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7182ed6375160685e568856b98e220f66e9a25aa, data reload: false

------ Round 1 ----------------------------------
q1	17656	4720	4401	4401
q2	2052	145	132	132
q3	10670	902	919	902
q4	4671	776	707	707
q5	7733	2787	2747	2747
q6	185	122	120	120
q7	1147	736	719	719
q8	9296	1970	1978	1970
q9	7295	6359	6301	6301
q10	8095	2405	2426	2405
q11	419	200	202	200
q12	761	290	291	290
q13	18010	3299	3302	3299
q14	284	245	246	245
q15	523	495	483	483
q16	474	431	409	409
q17	926	508	493	493
q18	6672	5941	5823	5823
q19	1551	1455	1390	1390
q20	640	335	333	333
q21	6644	3155	3160	3155
q22	813	318	294	294
Total cold run time: 106517 ms
Total hot run time: 36818 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4521	4327	4420	4327
q2	323	232	243	232
q3	2973	2813	2767	2767
q4	1829	1628	1598	1598
q5	5254	5268	5234	5234
q6	188	115	117	115
q7	2173	1769	1734	1734
q8	3104	3291	3288	3288
q9	8301	8263	8238	8238
q10	5795	3535	3574	3535
q11	528	463	457	457
q12	731	591	569	569
q13	11832	3089	3053	3053
q14	278	244	267	244
q15	522	490	478	478
q16	519	491	484	484
q17	1843	1677	1702	1677
q18	7978	7810	7571	7571
q19	9918	1548	1557	1548
q20	2105	1918	1901	1901
q21	4795	4500	4617	4500
q22	557	495	461	461
Total cold run time: 76067 ms
Total hot run time: 54011 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 181025 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7182ed6375160685e568856b98e220f66e9a25aa, data reload: false

query1	940	346	335	335
query2	6525	1883	1923	1883
query3	6696	210	202	202
query4	31837	21989	21974	21974
query5	4291	410	397	397
query6	250	160	164	160
query7	4598	285	272	272
query8	252	167	175	167
query9	8872	2314	2290	2290
query10	411	236	209	209
query11	19097	15363	15253	15253
query12	127	80	75	75
query13	1632	412	418	412
query14	9546	6495	6851	6495
query15	235	173	179	173
query16	8136	252	245	245
query17	1896	536	505	505
query18	2110	261	262	261
query19	373	140	142	140
query20	81	77	78	77
query21	191	132	128	128
query22	4925	4664	4690	4664
query23	30727	30002	29954	29954
query24	10121	2732	2725	2725
query25	535	357	338	338
query26	716	145	149	145
query27	2168	305	308	305
query28	5846	1875	1834	1834
query29	850	605	598	598
query30	284	132	142	132
query31	900	702	724	702
query32	90	51	54	51
query33	622	216	213	213
query34	863	446	471	446
query35	871	783	743	743
query36	1084	930	958	930
query37	91	59	55	55
query38	3200	3100	3084	3084
query39	1279	1235	1256	1235
query40	181	96	91	91
query41	38	36	32	32
query42	101	88	94	88
query43	514	463	490	463
query44	1007	683	697	683
query45	193	180	173	173
query46	1036	646	633	633
query47	1586	1436	1462	1436
query48	448	345	363	345
query49	1044	285	289	285
query50	773	375	390	375
query51	5256	5195	5114	5114
query52	110	82	91	82
query53	330	268	257	257
query54	285	215	219	215
query55	79	77	71	71
query56	209	200	204	200
query57	1001	916	881	881
query58	202	176	180	176
query59	2458	2245	2390	2245
query60	236	213	210	210
query61	87	86	82	82
query62	644	380	366	366
query63	295	274	268	268
query64	5007	3704	3487	3487
query65	3237	3217	3232	3217
query66	818	309	309	309
query67	14435	14115	14122	14115
query68	3998	524	533	524
query69	463	313	326	313
query70	1271	1239	1221	1221
query71	304	249	244	244
query72	5842	2842	2673	2673
query73	700	322	321	321
query74	6598	6242	6200	6200
query75	3046	2330	2338	2330
query76	2582	948	877	877
query77	350	229	222	222
query78	9208	8754	8566	8566
query79	3106	515	513	513
query80	2091	363	350	350
query81	539	198	202	198
query82	832	92	83	83
query83	251	130	123	123
query84	281	83	82	82
query85	2044	352	347	347
query86	494	303	310	303
query87	3353	3202	3175	3175
query88	3981	2330	2317	2317
query89	453	361	349	349
query90	1992	164	164	164
query91	160	127	124	124
query92	57	47	49	47
query93	3871	509	468	468
query94	1248	177	176	176
query95	8069	7814	7739	7739
query96	593	269	267	267
query97	4228	4128	4124	4124
query98	201	203	186	186
query99	1176	693	711	693
Total cold run time: 288260 ms
Total hot run time: 181025 ms

@morrySnow morrySnow requested a review from shuke987 February 4, 2024 03:22
@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.54 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7182ed6375160685e568856b98e220f66e9a25aa, data reload: false

query1	0.04	0.03	0.03
query2	0.05	0.03	0.03
query3	0.24	0.06	0.06
query4	1.67	0.10	0.10
query5	0.53	0.52	0.52
query6	1.20	0.64	0.64
query7	0.02	0.02	0.01
query8	0.03	0.02	0.02
query9	0.55	0.49	0.50
query10	0.56	0.56	0.54
query11	0.12	0.08	0.09
query12	0.11	0.10	0.09
query13	0.60	0.61	0.60
query14	0.77	0.81	0.79
query15	0.81	0.78	0.77
query16	0.37	0.37	0.40
query17	1.02	0.99	0.99
query18	0.23	0.27	0.23
query19	1.80	1.75	1.79
query20	0.01	0.01	0.01
query21	15.41	0.57	0.54
query22	2.35	2.57	1.31
query23	17.67	0.75	0.75
query24	2.59	1.48	0.99
query25	0.34	0.24	0.20
query26	0.51	0.13	0.15
query27	0.05	0.06	0.05
query28	10.78	0.84	0.86
query29	12.54	3.13	3.13
query30	0.62	0.56	0.54
query31	2.80	0.35	0.35
query32	3.35	0.48	0.48
query33	3.28	3.19	3.25
query34	15.82	4.34	4.31
query35	4.34	4.29	4.34
query36	1.09	1.06	1.06
query37	0.06	0.05	0.05
query38	0.04	0.03	0.03
query39	0.02	0.01	0.01
query40	0.16	0.13	0.13
query41	0.08	0.02	0.01
query42	0.03	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.68 s
Total hot run time: 30.54 s

@doris-robot
Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7182ed6375160685e568856b98e220f66e9a25aa with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.3 seconds inserted 10000000 Rows, about 751K ops/s

@zfr9527
Copy link
Copy Markdown
Contributor

zfr9527 commented Feb 4, 2024

Maybe added the combination of graceful period and switch case

Copy link
Copy Markdown
Contributor

@zfr9527 zfr9527 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Feb 4, 2024

PR approved by anyone and no changes requested.

@seawinde
Copy link
Copy Markdown
Member Author

seawinde commented Feb 4, 2024

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 37443 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 49d437a29cbef5a8704fa6e64ffb8066793664db, data reload: false

------ Round 1 ----------------------------------
q1	17963	4711	4505	4505
q2	2609	147	142	142
q3	11469	950	950	950
q4	5000	853	751	751
q5	7879	2879	2898	2879
q6	186	122	130	122
q7	1199	762	749	749
q8	9293	2042	2067	2042
q9	7645	6371	6376	6371
q10	8152	2424	2466	2424
q11	429	207	214	207
q12	763	271	286	271
q13	18012	3342	3342	3342
q14	272	267	244	244
q15	536	510	487	487
q16	482	398	420	398
q17	954	606	541	541
q18	6751	5976	5889	5889
q19	1572	1350	1388	1350
q20	591	359	356	356
q21	6948	3113	3203	3113
q22	818	313	310	310
Total cold run time: 109523 ms
Total hot run time: 37443 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4481	4451	4412	4412
q2	335	238	240	238
q3	3012	2892	2782	2782
q4	1823	1627	1705	1627
q5	5260	5259	5280	5259
q6	192	114	117	114
q7	2183	1737	1813	1737
q8	3155	3251	3279	3251
q9	8432	8332	8362	8332
q10	5814	3508	3633	3508
q11	577	450	477	450
q12	765	572	575	572
q13	6864	3107	3135	3107
q14	269	245	268	245
q15	553	496	488	488
q16	506	466	443	443
q17	1821	1707	1712	1707
q18	8083	7761	7594	7594
q19	7305	1533	1555	1533
q20	2124	1909	1901	1901
q21	4732	4586	4625	4586
q22	532	452	502	452
Total cold run time: 68818 ms
Total hot run time: 54338 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 174740 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 49d437a29cbef5a8704fa6e64ffb8066793664db, data reload: false

query1	941	357	343	343
query2	6517	1908	1901	1901
query3	6705	207	202	202
query4	31891	22054	22118	22054
query5	4337	361	356	356
query6	248	166	166	166
query7	4595	293	275	275
query8	245	175	176	175
query9	9118	2317	2313	2313
query10	413	223	210	210
query11	18366	15364	15302	15302
query12	137	79	76	76
query13	1625	414	417	414
query14	9588	7206	7195	7195
query15	248	185	197	185
query16	8138	267	244	244
query17	1993	546	514	514
query18	2117	261	267	261
query19	371	140	146	140
query20	81	78	79	78
query21	191	121	126	121
query22	4893	4682	4582	4582
query23	31530	30152	30151	30151
query24	10471	2760	2796	2760
query25	575	343	346	343
query26	1174	149	151	149
query27	2937	306	294	294
query28	7457	1869	1854	1854
query29	866	612	634	612
query30	281	130	139	130
query31	922	718	712	712
query32	90	51	49	49
query33	732	224	216	216
query34	1123	455	453	453
query35	874	771	741	741
query36	1063	935	879	879
query37	121	55	57	55
query38	3225	3113	3085	3085
query39	1311	1282	1250	1250
query40	180	95	94	94
query41	40	35	34	34
query42	102	90	96	90
query43	535	489	471	471
query44	1178	697	699	697
query45	191	180	176	176
query46	1085	666	674	666
query47	1532	1541	1520	1520
query48	419	341	357	341
query49	1077	285	286	285
query50	763	374	394	374
query51	5227	5138	5182	5138
query52	94	85	85	85
query53	346	272	275	272
query54	275	206	230	206
query55	78	76	73	73
query56	223	198	203	198
query57	1007	905	925	905
query58	208	183	174	174
query59	2625	2330	2285	2285
query60	252	215	217	215
query61	84	83	87	83
query62	674	347	348	347
query63	297	272	282	272
query64	5211	3298	3690	3298
query65	3276	3260	3226	3226
query66	809	338	326	326
query67	14265	14005	14095	14005
query68	3999	532	523	523
query69	464	332	316	316
query70	1257	1210	1190	1190
query71	322	255	255	255
query72	5988	2830	2656	2656
query73	715	317	322	317
query74	6484	6261	6245	6245
query75	3045	2356	2361	2356
query76	2518	972	964	964
query77	351	239	230	230
query78	9170	8950	8633	8633
query79	2520	499	486	486
query80	1165	356	336	336
query81	527	200	194	194
query82	623	77	79	77
query83	222	127	128	127
query84	227	82	77	77
query85	2020	330	344	330
query86	490	332	314	314
query87	3338	3204	3217	3204
query88	3704	2305	2301	2301
query89	446	362	352	352
query90	2000	163	169	163
query91	155	117	138	117
query92	53	43	44	43
query93	2084	472	481	472
query94	1262	170	173	170
query95	468	7952	347	347
query96	587	272	268	268
query97	4201	4136	4130	4130
query98	210	214	189	189
query99	1020	699	662	662
Total cold run time: 281198 ms
Total hot run time: 174740 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 31.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 49d437a29cbef5a8704fa6e64ffb8066793664db, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.02
query3	0.23	0.06	0.06
query4	1.65	0.10	0.10
query5	0.53	0.51	0.52
query6	1.26	0.65	0.64
query7	0.02	0.02	0.01
query8	0.04	0.02	0.02
query9	0.53	0.50	0.50
query10	0.55	0.57	0.55
query11	0.12	0.09	0.09
query12	0.11	0.10	0.09
query13	0.61	0.62	0.60
query14	0.79	0.80	0.79
query15	0.79	0.76	0.77
query16	0.38	0.39	0.37
query17	1.06	1.03	0.99
query18	0.21	0.28	0.24
query19	1.92	1.79	1.80
query20	0.01	0.01	0.02
query21	15.42	0.58	0.56
query22	2.87	3.14	2.68
query23	17.35	0.84	0.86
query24	2.60	1.03	1.36
query25	0.37	0.23	0.06
query26	0.63	0.14	0.14
query27	0.06	0.06	0.04
query28	12.29	0.87	0.84
query29	12.58	3.36	3.24
query30	0.59	0.53	0.53
query31	2.79	0.35	0.35
query32	3.34	0.47	0.48
query33	3.24	3.25	3.23
query34	15.83	4.35	4.22
query35	4.28	4.26	4.30
query36	1.14	1.05	1.06
query37	0.07	0.05	0.05
query38	0.03	0.03	0.03
query39	0.03	0.01	0.01
query40	0.16	0.12	0.12
query41	0.07	0.02	0.01
query42	0.03	0.02	0.01
query43	0.03	0.02	0.03
Total cold run time: 106.72 s
Total hot run time: 31.96 s

@doris-robot
Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 49d437a29cbef5a8704fa6e64ffb8066793664db with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       14.4 seconds inserted 10000000 Rows, about 694K ops/s

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Feb 4, 2024
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Feb 4, 2024

PR approved by at least one committer and no changes requested.

@morrySnow morrySnow merged commit 0cf4fcb into apache:master Feb 4, 2024
yiguolei pushed a commit that referenced this pull request Feb 4, 2024
Add materialized view availability regression test

when mv refresh_time is in the grace_period(unit is second), materialized view will be use to
query rewrite regardless of the base table is update or not
when mv refresh_time is out of the grace_period(unit is second), will check the base table is update or not
if update the materialized view will not be used to query rewrite
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
…he#30769)

Add materialized view availability regression test

when mv refresh_time is in the grace_period(unit is second), materialized view will be use to
query rewrite regardless of the base table is update or not
when mv refresh_time is out of the grace_period(unit is second), will check the base table is update or not
if update the materialized view will not be used to query rewrite
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants