Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](nereids): fix PlanPostProcessor use visitor (#35244) #35265

Merged
merged 1 commit into from
May 23, 2024

Conversation

jackwener
Copy link
Member

Proposed changes

Issue Number: close #xxx

(cherry picked from commit 46e004a)

pick #35244

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@jackwener
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50167 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, data reload: false

------ Round 1 ----------------------------------
q1	18039	4455	4384	4384
q2	2037	157	147	147
q3	10264	1917	1951	1917
q4	10109	1262	1363	1262
q5	8418	4009	3911	3911
q6	239	127	127	127
q7	2074	1618	1617	1617
q8	9317	2786	2754	2754
q9	10637	10385	10404	10385
q10	8681	3557	3558	3557
q11	409	248	258	248
q12	468	310	319	310
q13	18357	3965	4057	3965
q14	361	334	337	334
q15	509	474	469	469
q16	679	577	577	577
q17	1159	974	986	974
q18	7295	6907	6906	6906
q19	1711	1563	1477	1477
q20	529	326	279	279
q21	4522	4219	4170	4170
q22	500	397	399	397
Total cold run time: 116314 ms
Total hot run time: 50167 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4381	4319	4309	4309
q2	321	227	225	225
q3	4202	4177	4172	4172
q4	2766	2766	2785	2766
q5	7205	7125	7158	7125
q6	243	121	125	121
q7	3280	2829	2816	2816
q8	4357	4500	4532	4500
q9	16955	16943	16857	16857
q10	4272	4301	4294	4294
q11	755	716	705	705
q12	1034	848	858	848
q13	7288	3799	3698	3698
q14	455	437	425	425
q15	505	463	449	449
q16	738	682	698	682
q17	3877	3809	3828	3809
q18	8907	8978	8815	8815
q19	1730	1712	1666	1666
q20	2390	2199	2196	2196
q21	8621	8527	8500	8500
q22	1046	928	991	928
Total cold run time: 85328 ms
Total hot run time: 79906 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204519 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, data reload: false

query1	929	406	382	382
query2	6529	2825	2884	2825
query3	6923	208	207	207
query4	20701	18088	18135	18088
query5	19739	6573	6494	6494
query6	283	216	221	216
query7	4163	315	316	315
query8	262	260	237	237
query9	3162	2737	2663	2663
query10	420	294	328	294
query11	11468	10856	10787	10787
query12	129	76	73	73
query13	5584	704	703	703
query14	17620	13509	13284	13284
query15	363	223	238	223
query16	6480	273	258	258
query17	1531	1491	896	896
query18	2248	417	414	414
query19	213	148	157	148
query20	80	77	81	77
query21	201	95	101	95
query22	5248	5033	5011	5011
query23	32827	32071	32024	32024
query24	7026	6601	6533	6533
query25	528	432	438	432
query26	524	173	165	165
query27	1887	301	308	301
query28	6143	2379	2316	2316
query29	3015	2744	2785	2744
query30	243	171	172	171
query31	901	738	717	717
query32	69	64	62	62
query33	410	268	258	258
query34	857	473	485	473
query35	1108	946	943	943
query36	1373	1143	1238	1143
query37	92	64	65	64
query38	3099	2944	2935	2935
query39	1380	1347	1335	1335
query40	199	87	86	86
query41	42	40	36	36
query42	80	81	83	81
query43	755	785	668	668
query44	1154	719	723	719
query45	249	231	231	231
query46	1232	948	974	948
query47	1829	1690	1758	1690
query48	1020	726	721	721
query49	622	388	390	388
query50	875	571	602	571
query51	4829	4778	4819	4778
query52	100	85	85	85
query53	465	326	327	326
query54	2721	2524	2497	2497
query55	107	75	81	75
query56	233	220	211	211
query57	1184	1331	1127	1127
query58	210	195	204	195
query59	4104	3816	3889	3816
query60	205	190	226	190
query61	89	85	88	85
query62	806	518	496	496
query63	485	339	347	339
query64	2423	1558	1541	1541
query65	3718	3656	3597	3597
query66	799	391	377	377
query67	15480	16939	15154	15154
query68	8371	690	671	671
query69	581	357	358	357
query70	1700	1426	1639	1426
query71	399	312	321	312
query72	6436	3476	3420	3420
query73	733	323	326	323
query74	6304	5874	5885	5874
query75	5052	3749	3758	3749
query76	5125	1158	1233	1158
query77	774	254	260	254
query78	12394	11891	13180	11891
query79	7233	646	664	646
query80	988	398	395	395
query81	496	244	235	235
query82	328	104	97	97
query83	175	134	138	134
query84	255	68	71	68
query85	953	304	292	292
query86	343	296	311	296
query87	3202	2999	3045	2999
query88	4765	2357	2386	2357
query89	362	282	289	282
query90	1907	211	220	211
query91	168	150	137	137
query92	61	54	53	53
query93	2149	591	546	546
query94	730	203	211	203
query95	1116	1059	1049	1049
query96	676	341	342	341
query97	6514	6457	6386	6386
query98	194	179	176	176
query99	2870	847	862	847
Total cold run time: 305127 ms
Total hot run time: 204519 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.79	0.10	0.07
query5	0.54	0.54	0.52
query6	1.25	0.61	0.62
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.52	0.49	0.48
query10	0.54	0.53	0.53
query11	0.12	0.09	0.08
query12	0.12	0.08	0.09
query13	0.62	0.62	0.61
query14	0.79	0.79	0.79
query15	0.78	0.75	0.76
query16	0.36	0.39	0.36
query17	1.04	1.01	1.00
query18	0.23	0.25	0.24
query19	1.93	1.88	1.85
query20	0.01	0.01	0.01
query21	15.45	0.56	0.54
query22	2.00	1.83	1.46
query23	17.32	1.00	0.82
query24	4.24	0.84	4.43
query25	0.38	0.13	0.05
query26	0.79	0.15	0.16
query27	0.03	0.04	0.03
query28	5.62	0.71	0.71
query29	12.60	2.30	2.32
query30	0.56	0.52	0.52
query31	2.82	0.38	0.38
query32	3.38	0.51	0.49
query33	3.08	3.08	3.11
query34	15.26	4.83	4.81
query35	4.91	4.87	4.87
query36	1.05	1.01	1.03
query37	0.06	0.04	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.13
query41	0.07	0.02	0.01
query42	0.02	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 100.9 s
Total hot run time: 30.4 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@jackwener jackwener merged commit e4c3533 into apache:branch-2.0 May 23, 2024
23 of 25 checks passed
@jackwener jackwener deleted the post branch May 23, 2024 06:08
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants