Skip to content

Conversation

@zy-kkk
Copy link
Member

@zy-kkk zy-kkk commented Mar 5, 2024

Proposed changes

Issue Number: close #xxx

pick #31783

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 5, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50254 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a6e4d5b8f4966b37ea4eb3cadb10bf62cd3185e1, data reload: false

------ Round 1 ----------------------------------
q1	17742	4388	4409	4388
q2	2074	154	142	142
q3	10384	1925	1939	1925
q4	10105	1249	1327	1249
q5	8594	4001	4001	4001
q6	224	126	123	123
q7	2079	1585	1618	1585
q8	9309	2729	2729	2729
q9	11132	10812	10693	10693
q10	8667	3550	3519	3519
q11	428	237	240	237
q12	471	289	292	289
q13	18335	3955	4029	3955
q14	350	329	317	317
q15	506	452	464	452
q16	680	587	583	583
q17	1131	969	965	965
q18	7239	6945	6793	6793
q19	1644	1573	1524	1524
q20	526	297	314	297
q21	4435	4131	4096	4096
q22	492	392	419	392
Total cold run time: 116547 ms
Total hot run time: 50254 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4278	4331	4288	4288
q2	318	228	224	224
q3	4164	4156	4128	4128
q4	2742	2764	2758	2758
q5	7273	7165	7235	7165
q6	238	119	122	119
q7	3229	2822	2874	2822
q8	4355	4510	4445	4445
q9	17619	17246	17207	17207
q10	4211	4255	4288	4255
q11	739	682	673	673
q12	1016	828	859	828
q13	7215	3720	3723	3720
q14	464	427	419	419
q15	491	453	457	453
q16	747	691	700	691
q17	3863	3827	3860	3827
q18	8840	8819	8777	8777
q19	1700	1685	1649	1649
q20	2363	2189	2094	2094
q21	8529	8412	8538	8412
q22	1021	957	961	957
Total cold run time: 85415 ms
Total hot run time: 79911 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201839 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a6e4d5b8f4966b37ea4eb3cadb10bf62cd3185e1, data reload: false

query1	919	395	378	378
query2	6540	2184	2147	2147
query3	6917	206	204	204
query4	19903	17900	18015	17900
query5	19728	6527	6562	6527
query6	299	214	220	214
query7	4209	294	301	294
query8	256	228	270	228
query9	3147	2694	2624	2624
query10	421	298	334	298
query11	11266	10707	10699	10699
query12	117	74	71	71
query13	5572	643	619	619
query14	18142	13245	13407	13245
query15	355	230	242	230
query16	6426	269	281	269
query17	1704	1448	863	863
query18	2320	416	410	410
query19	205	153	146	146
query20	68	75	71	71
query21	185	92	98	92
query22	5328	5139	5001	5001
query23	32502	32019	31876	31876
query24	6875	6565	6483	6483
query25	520	436	424	424
query26	517	167	161	161
query27	1877	298	291	291
query28	6012	2234	2184	2184
query29	2866	2677	2732	2677
query30	238	163	160	160
query31	914	716	736	716
query32	66	60	58	58
query33	401	233	255	233
query34	843	470	480	470
query35	1133	888	954	888
query36	1559	1368	1673	1368
query37	89	57	56	56
query38	3071	2930	2922	2922
query39	1374	1331	1314	1314
query40	188	95	93	93
query41	34	33	32	32
query42	88	85	84	84
query43	720	654	639	639
query44	1121	705	720	705
query45	240	232	224	224
query46	1231	988	990	988
query47	1839	1630	1693	1630
query48	964	701	661	661
query49	613	375	367	367
query50	869	622	605	605
query51	4743	4726	4668	4668
query52	88	80	70	70
query53	436	334	329	329
query54	2639	2468	2458	2458
query55	91	81	78	78
query56	197	202	222	202
query57	1144	1093	1077	1077
query58	204	204	204	204
query59	3526	3111	3565	3111
query60	207	184	188	184
query61	90	85	83	83
query62	794	510	502	502
query63	467	334	332	332
query64	2517	1506	1441	1441
query65	3638	3579	3598	3579
query66	760	375	370	370
query67	15692	15478	15210	15210
query68	10969	668	656	656
query69	577	347	335	335
query70	2444	1743	1624	1624
query71	410	304	308	304
query72	6470	3511	3465	3465
query73	743	314	321	314
query74	6300	5838	5829	5829
query75	5525	3729	3634	3634
query76	6955	1151	1187	1151
query77	1177	246	244	244
query78	12662	11754	11841	11754
query79	7071	632	627	627
query80	995	394	396	394
query81	477	226	225	225
query82	745	97	92	92
query83	162	130	137	130
query84	253	66	67	66
query85	847	291	295	291
query86	384	376	383	376
query87	3222	3003	3015	3003
query88	4358	2330	2357	2330
query89	385	299	286	286
query90	1907	197	211	197
query91	157	129	123	123
query92	58	50	52	50
query93	6296	534	561	534
query94	697	213	207	207
query95	1111	1076	1047	1047
query96	656	335	323	323
query97	6477	6397	6473	6397
query98	177	172	176	172
query99	2991	934	922	922
Total cold run time: 313682 ms
Total hot run time: 201839 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.94 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a6e4d5b8f4966b37ea4eb3cadb10bf62cd3185e1, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.04
query4	1.80	0.06	0.07
query5	0.53	0.52	0.52
query6	1.24	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.03	0.02
query9	0.51	0.48	0.48
query10	0.54	0.53	0.53
query11	0.11	0.09	0.08
query12	0.12	0.09	0.08
query13	0.62	0.62	0.62
query14	0.78	0.80	0.78
query15	0.77	0.76	0.76
query16	0.37	0.36	0.36
query17	1.02	1.02	1.03
query18	0.22	0.24	0.25
query19	1.91	1.82	1.82
query20	0.02	0.01	0.00
query21	15.46	0.56	0.56
query22	2.18	2.37	1.87
query23	17.64	0.90	0.91
query24	4.36	2.95	0.95
query25	0.36	0.15	0.05
query26	0.68	0.13	0.14
query27	0.04	0.04	0.03
query28	6.96	0.74	0.79
query29	12.64	2.32	2.29
query30	0.58	0.52	0.51
query31	2.81	0.37	0.37
query32	3.39	0.50	0.49
query33	3.02	3.09	3.06
query34	15.63	4.83	4.80
query35	4.87	4.85	4.87
query36	1.09	1.02	1.03
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.03	0.01	0.02
Total cold run time: 103.05 s
Total hot run time: 30.94 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a6e4d5b8f4966b37ea4eb3cadb10bf62cd3185e1 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.5 seconds inserted 10000000 Rows, about 487K ops/s

@zy-kkk zy-kkk merged commit 546cb16 into apache:branch-2.0 Mar 5, 2024
@zy-kkk zy-kkk deleted the druid_fix2 branch March 6, 2024 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants