Skip to content

Conversation

@starocean999
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@starocean999
Copy link
Contributor Author

run buildall

@wm1581066 wm1581066 requested a review from yiguolei January 27, 2024 14:11
Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TPC-H: Total hot run time: 37998 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 04b7649c5d9614dc172e938569cdfb01c26204a3, data reload: false

------ Round 1 ----------------------------------
q1	17753	4887	4947	4887
q2	2041	143	131	131
q3	10708	911	962	911
q4	4711	730	714	714
q5	7842	2784	2875	2784
q6	186	149	126	126
q7	1160	730	725	725
q8	9372	2010	2010	2010
q9	7231	6397	6394	6394
q10	8151	2447	2440	2440
q11	412	204	193	193
q12	761	272	271	271
q13	18871	3572	3600	3572
q14	296	272	287	272
q15	553	509	494	494
q16	495	439	433	433
q17	953	585	532	532
q18	8670	6406	6115	6115
q19	4387	1397	1291	1291
q20	640	333	344	333
q21	7113	3091	3113	3091
q22	812	310	279	279
Total cold run time: 113118 ms
Total hot run time: 37998 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5219	5016	5021	5016
q2	349	227	235	227
q3	3026	2788	2676	2676
q4	1834	1567	1501	1501
q5	5247	5258	5289	5258
q6	200	115	117	115
q7	2185	1846	1764	1764
q8	3075	3185	3264	3185
q9	8734	8442	18931	8442
q10	5863	3456	3382	3382
q11	574	457	474	457
q12	759	611	622	611
q13	16936	3087	3114	3087
q14	293	245	247	245
q15	539	490	492	490
q16	501	474	465	465
q17	2111	1629	1756	1629
q18	8968	8434	10699	8434
q19	23909	1561	1516	1516
q20	4582	1902	1884	1884
q21	14911	4955	5011	4955
q22	1005	480	465	465
Total cold run time: 110820 ms
Total hot run time: 55804 ms

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 27, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Collaborator

@wm1581066 wm1581066 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TPC-DS: Total hot run time: 173194 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 04b7649c5d9614dc172e938569cdfb01c26204a3, data reload: false

query1	937	343	326	326
query2	6563	2101	2005	2005
query3	6695	196	198	196
query4	32895	22029	22082	22029
query5	4450	349	341	341
query6	243	154	153	153
query7	4630	257	257	257
query8	254	176	170	170
query9	8578	2252	2232	2232
query10	417	216	198	198
query11	17348	15348	15394	15348
query12	117	66	65	65
query13	1683	375	377	375
query14	9208	6531	6454	6454
query15	211	177	181	177
query16	5703	256	251	251
query17	948	465	464	464
query18	1795	249	251	249
query19	171	135	130	130
query20	68	69	71	69
query21	205	137	132	132
query22	4924	4836	4754	4754
query23	31059	30541	30357	30357
query24	10189	2790	2778	2778
query25	534	313	308	308
query26	888	138	135	135
query27	3027	288	280	280
query28	6071	1842	1838	1838
query29	932	630	602	602
query30	290	131	141	131
query31	881	705	715	705
query32	79	48	54	48
query33	576	211	215	211
query34	837	466	467	466
query35	845	774	747	747
query36	1311	1233	1178	1178
query37	92	60	54	54
query38	3236	3203	3182	3182
query39	1303	1253	1240	1240
query40	191	82	85	82
query41	37	38	34	34
query42	86	81	86	81
query43	544	498	522	498
query44	1085	673	682	673
query45	192	180	174	174
query46	1049	656	634	634
query47	1546	1557	1509	1509
query48	371	299	302	299
query49	1089	284	278	278
query50	681	306	308	306
query51	5268	5146	5182	5146
query52	107	73	86	73
query53	324	255	266	255
query54	229	185	188	185
query55	82	78	71	71
query56	180	154	152	152
query57	955	914	916	914
query58	172	153	145	145
query59	2618	2730	2491	2491
query60	208	170	178	170
query61	84	88	79	79
query62	578	356	376	356
query63	278	276	258	258
query64	4035	1772	1738	1738
query65	3320	3251	3225	3225
query66	1201	309	306	306
query67	14498	14319	14109	14109
query68	3712	479	494	479
query69	445	308	300	300
query70	1525	1454	1483	1454
query71	252	213	232	213
query72	3698	2850	2852	2850
query73	677	311	318	311
query74	6608	6283	6269	6269
query75	2783	2315	2264	2264
query76	2598	1056	997	997
query77	363	234	231	231
query78	9069	8895	8488	8488
query79	2459	496	485	485
query80	1930	318	312	312
query81	500	199	198	198
query82	671	76	79	76
query83	243	118	117	117
query84	286	72	75	72
query85	1840	332	327	327
query86	507	398	380	380
query87	3433	3301	3333	3301
query88	3661	2132	2143	2132
query89	415	371	358	358
query90	1907	185	183	183
query91	147	134	122	122
query92	55	44	46	44
query93	2227	412	435	412
query94	1262	163	157	157
query95	494	456	452	452
query96	619	321	314	314
query97	4193	4135	4141	4135
query98	210	193	182	182
query99	996	704	703	703
Total cold run time: 270986 ms
Total hot run time: 173194 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.63 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 04b7649c5d9614dc172e938569cdfb01c26204a3, data reload: false

query1	0.04	0.03	0.03
query2	0.05	0.02	0.02
query3	0.23	0.06	0.06
query4	1.68	0.09	0.10
query5	0.52	0.51	0.52
query6	1.22	0.62	0.61
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.54	0.50	0.51
query10	0.55	0.53	0.53
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.60	0.61	0.59
query14	0.80	0.80	0.81
query15	0.80	0.77	0.78
query16	0.37	0.38	0.39
query17	0.97	1.01	1.03
query18	0.20	0.28	0.25
query19	1.88	1.77	1.77
query20	0.02	0.01	0.01
query21	15.44	0.58	0.57
query22	2.69	2.51	2.00
query23	17.32	0.73	0.83
query24	2.40	1.44	0.44
query25	0.30	0.20	0.26
query26	0.48	0.13	0.14
query27	0.05	0.04	0.04
query28	11.88	0.86	0.87
query29	12.54	3.17	3.08
query30	0.58	0.55	0.56
query31	2.80	0.35	0.35
query32	3.35	0.47	0.48
query33	3.20	3.23	3.21
query34	15.75	4.27	4.36
query35	4.26	4.42	4.28
query36	1.07	1.04	1.06
query37	0.06	0.05	0.06
query38	0.03	0.02	0.03
query39	0.02	0.01	0.01
query40	0.18	0.13	0.13
query41	0.07	0.02	0.01
query42	0.03	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 105.28 s
Total hot run time: 30.63 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 04b7649c5d9614dc172e938569cdfb01c26204a3 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.2 seconds inserted 10000000 Rows, about 757K ops/s

@eldenmoon eldenmoon merged commit 65a0d3d into apache:master Jan 27, 2024
yiguolei pushed a commit that referenced this pull request Jan 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants