Skip to content

Conversation

@morrySnow
Copy link
Contributor

Proposed changes

pick from master PR #30071

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49919 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bdfd0c6e73cfb032697168ffbfe9203da73f729b, data reload: false

------ Round 1 ----------------------------------
q1	17776	4457	4396	4396
q2	2034	154	143	143
q3	10447	1915	1956	1915
q4	10323	1209	1301	1209
q5	8455	3881	3954	3881
q6	228	125	122	122
q7	2018	1628	1608	1608
q8	9526	2703	2702	2702
q9	13893	10380	10451	10380
q10	8660	3544	3530	3530
q11	414	251	236	236
q12	461	297	306	297
q13	18352	3963	4006	3963
q14	349	323	330	323
q15	508	457	453	453
q16	676	595	587	587
q17	1104	951	919	919
q18	7157	6896	6971	6896
q19	1666	1548	1543	1543
q20	517	316	316	316
q21	4443	4114	4097	4097
q22	501	403	403	403
Total cold run time: 119508 ms
Total hot run time: 49919 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4307	4329	4313	4313
q2	319	228	216	216
q3	4133	4136	4127	4127
q4	2754	2743	2774	2743
q5	7227	7198	7239	7198
q6	238	122	121	121
q7	3230	2837	2855	2837
q8	4373	4443	4491	4443
q9	17132	16960	16995	16960
q10	4242	4276	4234	4234
q11	765	694	681	681
q12	1019	866	859	859
q13	6794	3701	3750	3701
q14	454	417	418	417
q15	493	467	454	454
q16	761	698	712	698
q17	3843	3881	3832	3832
q18	8724	8747	8836	8747
q19	1722	1650	1649	1649
q20	2352	2154	2162	2154
q21	8477	8609	8484	8484
q22	1065	956	955	955
Total cold run time: 84424 ms
Total hot run time: 79823 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 242306 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bdfd0c6e73cfb032697168ffbfe9203da73f729b, data reload: false

query1	915	390	382	382
query2	6548	2205	2170	2170
query3	6926	202	196	196
query4	19891	17856	17953	17856
query5	19724	6198	6225	6198
query6	279	205	218	205
query7	4152	302	316	302
query8	255	249	265	249
query9	3114	2677	2614	2614
query10	413	289	307	289
query11	11310	10662	10646	10646
query12	124	76	74	74
query13	5635	644	624	624
query14	17550	13306	13456	13306
query15	385	246	230	230
query16	6457	259	261	259
query17	3242	900	896	896
query18	2252	410	405	405
query19	216	143	155	143
query20	77	74	74	74
query21	183	100	95	95
query22	5281	5106	5067	5067
query23	32387	31797	31891	31797
query24	6941	6487	6426	6426
query25	529	434	423	423
query26	523	157	158	157
query27	1867	303	302	302
query28	6126	2260	2235	2235
query29	2936	2784	2792	2784
query30	244	161	163	161
query31	906	744	736	736
query32	64	57	58	57
query33	395	257	248	248
query34	849	467	485	467
query35	1103	922	918	918
query36	1672	1447	1513	1447
query37	90	68	65	65
query38	3049	2941	2894	2894
query39	1369	1335	1324	1324
query40	205	98	96	96
query41	34	31	32	31
query42	86	82	82	82
query43	656	564	628	564
query44	1093	710	714	710
query45	240	231	225	225
query46	1236	959	945	945
query47	1852	1824	1887	1824
query48	961	680	656	656
query49	604	368	347	347
query50	850	590	577	577
query51	5655	5536	5556	5536
query52	83	87	75	75
query53	431	330	319	319
query54	2405	2264	2233	2233
query55	84	74	82	74
query56	213	221	199	199
query57	1131	1057	1034	1034
query58	211	178	199	178
query59	3649	3224	3402	3224
query60	216	182	197	182
query61	84	83	90	83
query62	836	468	477	468
query63	473	336	332	332
query64	2000	1300	1318	1300
query65	3660	3596	3607	3596
query66	793	374	364	364
query67	15578	16637	14969	14969
query68	10007	655	661	655
query69	556	340	343	340
query70	2285	1953	1721	1721
query71	384	309	307	307
query72	4387	3309	3358	3309
query73	721	318	317	317
query74	6305	5868	5930	5868
query75	4948	3473	3535	3473
query76	6521	1181	1210	1181
query77	1012	254	258	254
query78	31640	52251	54308	52251
query79	15812	662	618	618
query80	4969	387	385	385
query81	561	228	226	226
query82	1297	105	89	89
query83	326	138	134	134
query84	263	68	69	68
query85	2387	279	279	279
query86	464	428	375	375
query87	3200	3047	2982	2982
query88	7149	2298	2310	2298
query89	444	273	302	273
query90	2512	204	211	204
query91	157	122	119	119
query92	66	54	52	52
query93	6370	597	593	593
query94	1830	208	209	208
query95	1113	1085	1077	1077
query96	644	322	325	322
query97	6464	6339	6322	6322
query98	208	172	166	166
query99	3752	896	909	896
Total cold run time: 350052 ms
Total hot run time: 242306 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.73 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bdfd0c6e73cfb032697168ffbfe9203da73f729b, data reload: false

query1	0.02	0.03	0.02
query2	0.06	0.03	0.02
query3	0.25	0.04	0.04
query4	1.82	0.07	0.06
query5	0.54	0.53	0.51
query6	1.24	0.61	0.61
query7	0.01	0.01	0.01
query8	0.04	0.03	0.02
query9	0.53	0.47	0.48
query10	0.53	0.54	0.54
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.62	0.60	0.61
query14	0.80	0.79	0.78
query15	0.77	0.76	0.76
query16	0.35	0.37	0.35
query17	1.04	0.98	1.03
query18	0.22	0.27	0.24
query19	1.90	1.87	1.87
query20	0.02	0.02	0.01
query21	15.46	0.58	0.57
query22	2.21	2.79	1.89
query23	17.64	0.94	0.97
query24	7.55	2.03	1.43
query25	2.38	0.16	0.15
query26	0.15	0.13	0.15
query27	0.14	0.17	0.15
query28	4.86	0.78	0.73
query29	12.65	2.34	2.39
query30	0.58	0.54	0.52
query31	2.83	0.38	0.37
query32	3.42	0.50	0.49
query33	3.08	3.06	3.10
query34	15.25	4.79	4.79
query35	4.84	4.87	4.86
query36	1.05	1.03	1.01
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.15	0.13
query41	0.07	0.02	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 105.47 s
Total hot run time: 31.73 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bdfd0c6e73cfb032697168ffbfe9203da73f729b with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s

@morrySnow morrySnow merged commit d34ef4d into apache:branch-2.0 Jan 25, 2024
@morrySnow morrySnow deleted the 2.0_30071 branch February 27, 2024 10:04
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants