Skip to content

[Improvement](materialized-view) adjust priority of materialized view…#33348

Merged
yiguolei merged 1 commit intoapache:branch-2.0from
BiteTheDDDDt:cp_0408_2
Apr 8, 2024
Merged

[Improvement](materialized-view) adjust priority of materialized view…#33348
yiguolei merged 1 commit intoapache:branch-2.0from
BiteTheDDDDt:cp_0408_2

Conversation

@BiteTheDDDDt
Copy link
Contributor

… match rule (#33305)

adjust priority of materialized view match rule

Proposed changes

pick from #33305

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

… match rule (apache#33305)

adjust priority of materialized view match rule
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@BiteTheDDDDt
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49975 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a890c204963a8da515d38010b664c32939b516dd, data reload: false

------ Round 1 ----------------------------------
q1	17986	4431	4383	4383
q2	2035	154	145	145
q3	10283	1901	1915	1901
q4	10135	1235	1335	1235
q5	8486	3974	4020	3974
q6	230	123	124	123
q7	2066	1598	1609	1598
q8	9531	2728	2719	2719
q9	14203	10790	10567	10567
q10	8583	3564	3459	3459
q11	409	245	241	241
q12	461	301	302	301
q13	18689	3979	4073	3979
q14	354	329	323	323
q15	512	461	466	461
q16	698	598	579	579
q17	1113	922	897	897
q18	7228	6780	6803	6780
q19	1681	1549	1522	1522
q20	503	306	311	306
q21	4473	4145	4081	4081
q22	502	410	401	401
Total cold run time: 120161 ms
Total hot run time: 49975 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4352	4273	4319	4273
q2	315	218	224	218
q3	4175	4173	4107	4107
q4	2753	2747	2747	2747
q5	7361	7252	7239	7239
q6	237	122	121	121
q7	3269	2870	2809	2809
q8	4311	4450	4475	4450
q9	17727	17411	17400	17400
q10	4254	4280	4282	4280
q11	751	666	695	666
q12	1024	841	845	841
q13	6919	3768	3708	3708
q14	442	445	423	423
q15	501	465	458	458
q16	757	720	697	697
q17	3868	3782	3806	3782
q18	8888	8762	8797	8762
q19	1719	1706	1685	1685
q20	2363	2118	2179	2118
q21	8510	8614	8570	8570
q22	1054	966	975	966
Total cold run time: 85550 ms
Total hot run time: 80320 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201485 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a890c204963a8da515d38010b664c32939b516dd, data reload: false

query1	932	394	384	384
query2	6540	2165	2019	2019
query3	6914	204	199	199
query4	20027	18038	17945	17945
query5	19721	6535	6586	6535
query6	293	222	231	222
query7	4155	307	299	299
query8	247	251	238	238
query9	3134	2702	2634	2634
query10	420	282	303	282
query11	11322	10762	10865	10762
query12	116	82	71	71
query13	5571	657	646	646
query14	17921	13600	13497	13497
query15	363	225	236	225
query16	6437	272	265	265
query17	1718	1449	878	878
query18	2321	427	424	424
query19	203	149	150	149
query20	78	78	74	74
query21	186	90	90	90
query22	5333	5072	4983	4983
query23	32366	31813	31796	31796
query24	6892	6507	6692	6507
query25	529	427	428	427
query26	518	166	157	157
query27	1846	292	297	292
query28	6077	2276	2228	2228
query29	2850	2660	2872	2660
query30	234	160	166	160
query31	925	744	724	724
query32	66	68	59	59
query33	397	246	249	246
query34	845	466	479	466
query35	1152	920	914	914
query36	1291	1053	1071	1053
query37	94	64	59	59
query38	3065	2891	2956	2891
query39	1366	1322	1313	1313
query40	197	95	95	95
query41	36	34	33	33
query42	85	90	90	90
query43	782	600	616	600
query44	1202	723	727	723
query45	241	225	228	225
query46	1248	977	953	953
query47	1797	1674	1679	1674
query48	990	676	661	661
query49	611	366	383	366
query50	884	579	629	579
query51	4750	4615	4661	4615
query52	91	80	73	73
query53	454	318	318	318
query54	2653	2436	2415	2415
query55	90	68	75	68
query56	222	195	211	195
query57	1268	1115	1081	1081
query58	213	204	184	184
query59	3364	3335	3297	3297
query60	203	196	212	196
query61	87	88	89	88
query62	820	582	471	471
query63	472	331	332	331
query64	2476	1437	1376	1376
query65	3626	3557	3558	3557
query66	762	367	365	365
query67	16593	15542	17497	15542
query68	6811	652	653	652
query69	554	351	351	351
query70	1517	1340	1496	1340
query71	399	297	311	297
query72	6507	3449	3459	3449
query73	726	327	326	326
query74	6273	5877	5923	5877
query75	4621	3807	3702	3702
query76	4361	1122	1114	1114
query77	531	247	249	247
query78	12740	11792	11505	11505
query79	7292	657	627	627
query80	1028	404	389	389
query81	504	230	233	230
query82	1499	94	99	94
query83	166	142	131	131
query84	263	71	71	71
query85	876	293	287	287
query86	342	298	336	298
query87	3231	2991	3076	2991
query88	4956	2435	2432	2432
query89	348	287	285	285
query90	1931	212	204	204
query91	153	120	119	119
query92	61	50	46	46
query93	3359	555	590	555
query94	759	195	194	194
query95	1092	1065	1067	1065
query96	660	342	337	337
query97	6560	6323	6410	6323
query98	195	180	187	180
query99	2945	888	823	823
Total cold run time: 303942 ms
Total hot run time: 201485 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a890c204963a8da515d38010b664c32939b516dd, data reload: false

query1	0.03	0.02	0.02
query2	0.06	0.03	0.02
query3	0.25	0.05	0.04
query4	1.81	0.06	0.07
query5	0.53	0.53	0.51
query6	1.24	0.61	0.61
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.52	0.49	0.48
query10	0.54	0.53	0.54
query11	0.12	0.09	0.09
query12	0.12	0.10	0.10
query13	0.62	0.61	0.61
query14	0.79	0.77	0.78
query15	0.79	0.75	0.76
query16	0.39	0.36	0.36
query17	1.01	1.01	0.99
query18	0.23	0.26	0.24
query19	1.96	1.87	1.84
query20	0.01	0.01	0.01
query21	15.46	0.56	0.54
query22	2.05	2.35	1.86
query23	16.93	1.14	0.96
query24	7.27	0.96	1.79
query25	0.36	0.13	0.04
query26	0.88	0.17	0.16
query27	0.05	0.04	0.04
query28	5.18	0.72	0.71
query29	12.71	2.30	2.32
query30	0.61	0.61	0.54
query31	2.81	0.39	0.38
query32	3.38	0.50	0.49
query33	3.08	3.08	3.13
query34	15.24	4.82	4.80
query35	4.88	4.88	4.87
query36	1.06	1.02	1.01
query37	0.06	0.05	0.05
query38	0.03	0.03	0.02
query39	0.02	0.01	0.01
query40	0.17	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.01
Total cold run time: 103.42 s
Total hot run time: 31.05 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a890c204963a8da515d38010b664c32939b516dd with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.9 seconds inserted 10000000 Rows, about 478K ops/s

@yiguolei yiguolei merged commit bf2d528 into apache:branch-2.0 Apr 8, 2024
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 8, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Apr 8, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Apr 8, 2024

PR approved by anyone and no changes requested.

mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
… match rule (apache#33305) (apache#33348)

adjust priority of materialized view match rule
@BiteTheDDDDt BiteTheDDDDt deleted the cp_0408_2 branch January 20, 2025 06:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/nereids kind/test reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants