Skip to content

Conversation

@morrySnow
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.2 seconds
stream load tsv: 577 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 27.4 seconds inserted 10000000 Rows, about 364K ops/s
storage size: 17183879966 Bytes

@github-actions
Copy link
Contributor

github-actions bot commented Jan 8, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jan 8, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Jan 8, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 38461 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 72d92b2a39e163c29a4887d1766bbcdd1f5067c9, data reload: false

------ Round 1 ----------------------------------
q1	17678	4934	4937	4934
q2	2030	152	142	142
q3	10606	1075	1110	1075
q4	10316	779	780	779
q5	7840	2967	2919	2919
q6	201	124	124	124
q7	913	505	491	491
q8	9284	2030	1998	1998
q9	6448	6378	6321	6321
q10	8245	3063	3061	3061
q11	421	227	212	212
q12	385	226	224	224
q13	17983	3447	3427	3427
q14	255	220	203	203
q15	556	513	508	508
q16	449	386	395	386
q17	941	713	611	611
q18	7250	6678	6596	6596
q19	1540	1531	1502	1502
q20	712	314	327	314
q21	2713	2419	2327	2327
q22	355	307	311	307
Total cold run time: 107121 ms
Total hot run time: 38461 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4925	4908	4870	4870
q2	337	252	271	252
q3	3347	3317	3271	3271
q4	2133	2030	2034	2030
q5	5818	5770	5787	5770
q6	207	117	120	117
q7	2292	1867	1892	1867
q8	3358	3426	3677	3426
q9	8813	8724	8747	8724
q10	3782	3813	3845	3813
q11	544	450	461	450
q12	803	655	625	625
q13	4818	3229	3189	3189
q14	290	294	256	256
q15	535	505	509	505
q16	557	488	478	478
q17	1855	1879	1852	1852
q18	8637	8380	8185	8185
q19	1567	1617	1610	1610
q20	2173	1955	1943	1943
q21	5538	5232	5304	5232
q22	503	465	469	465
Total cold run time: 62832 ms
Total hot run time: 58930 ms

@morrySnow morrySnow merged commit 996b4cb into apache:master Jan 8, 2024
@morrySnow morrySnow added the not-merge/2.0 do not merge into 2.0 branch label Jan 8, 2024
@doris-robot
Copy link

TPC-DS: Total hot run time: 184114 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 72d92b2a39e163c29a4887d1766bbcdd1f5067c9, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	957	346	329	329
query2	6586	2000	2046	2000
query3	6732	225	227	225
query4	26859	22693	22405	22405
query5	4794	652	617	617
query6	340	215	210	210
query7	4650	328	318	318
query8	263	227	220	220
query9	8700	3022	3000	3000
query10	535	318	312	312
query11	16425	15737	15589	15589
query12	164	104	94	94
query13	1686	348	348	348
query14	13645	7693	7640	7640
query15	257	237	204	204
query16	6540	336	329	329
query17	1709	523	521	521
query18	1971	305	314	305
query19	228	163	164	163
query20	114	101	101	101
query21	182	94	95	94
query22	4740	4772	4838	4772
query23	32233	31108	31183	31108
query24	12085	2986	2969	2969
query25	600	368	366	366
query26	1771	176	173	173
query27	3044	309	312	309
query28	7044	2176	2157	2157
query29	2024	419	415	415
query30	286	141	148	141
query31	1018	847	821	821
query32	139	85	77	77
query33	838	356	340	340
query34	852	482	482	482
query35	977	847	912	847
query36	1393	1273	1255	1255
query37	229	89	96	89
query38	3516	3327	3325	3325
query39	1363	1302	1296	1296
query40	310	90	87	87
query41	39	37	40	37
query42	108	104	112	104
query43	578	514	549	514
query44	1161	816	808	808
query45	219	220	209	209
query46	1068	710	713	710
query47	1761	1625	1659	1625
query48	378	298	291	291
query49	1212	318	316	316
query50	737	322	366	322
query51	5495	5297	5294	5294
query52	121	96	102	96
query53	236	172	166	166
query54	1533	668	657	657
query55	106	103	97	97
query56	301	262	271	262
query57	1044	1027	1009	1009
query58	290	291	281	281
query59	3096	2954	2885	2885
query60	318	287	292	287
query61	155	130	150	130
query62	575	480	469	469
query63	196	187	173	173
query64	6037	1728	1707	1707
query65	3400	3360	3321	3321
query66	1439	390	380	380
query67	15934	15136	15816	15136
query68	12788	560	558	558
query69	629	301	316	301
query70	1695	1538	1548	1538
query71	615	297	278	278
query72	5293	3429	3450	3429
query73	3037	350	338	338
query74	7062	6590	6582	6582
query75	5285	2330	2259	2259
query76	6261	1097	1126	1097
query77	762	320	321	320
query78	9193	8564	8594	8564
query79	3927	529	516	516
query80	729	342	344	342
query81	457	216	217	216
query82	264	113	116	113
query83	194	139	140	139
query84	255	55	60	55
query85	957	277	277	277
query86	446	422	432	422
query87	3677	3485	3449	3449
query88	3339	2500	2519	2500
query89	355	286	276	276
query90	2006	266	254	254
query91	124	93	101	93
query92	92	73	69	69
query93	2071	455	502	455
query94	986	233	249	233
query95	560	505	508	505
query96	653	341	336	336
query97	4343	4273	4204	4204
query98	233	219	218	218
query99	1178	839	854	839
Total cold run time: 304802 ms
Total hot run time: 184114 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.0-merged dev/3.0.0-merged not-merge/2.0 do not merge into 2.0 branch reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants