Skip to content

Conversation

@HappenLee
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@HappenLee
Copy link
Contributor Author

run buildall

@HappenLee
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37732 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7659c572406fb41133b5901d205bb24e83018297, data reload: false

------ Round 1 ----------------------------------
q1	17706	3979	4008	3979
q2	2038	138	129	129
q3	10583	931	921	921
q4	4657	932	935	932
q5	7596	2902	2976	2902
q6	181	121	122	121
q7	1227	746	742	742
q8	9235	2000	2026	2000
q9	7128	6314	6260	6260
q10	8168	2467	2477	2467
q11	425	206	198	198
q12	730	315	317	315
q13	17952	3204	3252	3204
q14	283	251	248	248
q15	554	495	488	488
q16	462	398	400	398
q17	926	897	861	861
q18	6725	6031	6155	6031
q19	1550	1502	1493	1493
q20	537	297	259	259
q21	6495	3492	3586	3492
q22	797	302	292	292
Total cold run time: 105955 ms
Total hot run time: 37732 ms

----- Round 2, with runtime_filter_mode=off -----
q1	3978	3984	3978	3978
q2	307	218	213	213
q3	2995	2923	2929	2923
q4	1846	1822	1787	1787
q5	5104	5089	5114	5089
q6	203	113	115	113
q7	2133	1732	1736	1732
q8	3091	3177	3188	3177
q9	8243	8229	8189	8189
q10	6093	3686	3635	3635
q11	528	429	443	429
q12	698	547	566	547
q13	10276	3083	3069	3069
q14	274	246	258	246
q15	546	491	495	491
q16	514	468	463	463
q17	1692	1687	1667	1667
q18	7925	7551	7554	7551
q19	1645	1610	1634	1610
q20	2090	1905	1913	1905
q21	4781	4655	4640	4640
q22	522	449	443	443
Total cold run time: 65484 ms
Total hot run time: 53897 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169215 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7659c572406fb41133b5901d205bb24e83018297, data reload: false

query1	929	337	334	334
query2	6547	1670	1678	1670
query3	6704	208	204	204
query4	23177	20566	20581	20566
query5	4336	361	355	355
query6	262	173	166	166
query7	4606	303	304	303
query8	272	193	188	188
query9	8364	2228	2212	2212
query10	409	229	216	216
query11	14628	14223	14121	14121
query12	130	91	93	91
query13	1651	439	417	417
query14	8500	6794	6665	6665
query15	201	173	176	173
query16	7082	260	252	252
query17	1043	513	508	508
query18	1894	279	274	274
query19	190	148	143	143
query20	87	81	83	81
query21	201	127	130	127
query22	4730	4593	4603	4593
query23	30447	29960	29872	29872
query24	11832	3058	3116	3058
query25	655	355	341	341
query26	1800	151	169	151
query27	2957	310	316	310
query28	6951	1822	1800	1800
query29	1197	559	551	551
query30	291	131	142	131
query31	854	676	691	676
query32	91	59	55	55
query33	724	235	222	222
query34	1047	473	493	473
query35	830	763	759	759
query36	914	864	816	816
query37	168	61	68	61
query38	3093	3085	3012	3012
query39	1308	1247	1246	1246
query40	283	107	103	103
query41	39	42	34	34
query42	105	91	101	91
query43	458	418	413	413
query44	1073	702	719	702
query45	190	182	178	178
query46	1029	805	797	797
query47	1515	1467	1460	1460
query48	411	337	339	337
query49	1164	281	285	281
query50	765	370	376	370
query51	4397	4303	4251	4251
query52	103	92	91	91
query53	334	269	270	269
query54	296	214	222	214
query55	86	79	86	79
query56	220	195	191	191
query57	1005	867	902	867
query58	212	190	189	189
query59	2081	2137	1928	1928
query60	233	216	218	216
query61	83	85	84	84
query62	611	362	353	353
query63	278	254	256	254
query64	6562	3004	3156	3004
query65	3230	3219	3212	3212
query66	1422	318	304	304
query67	14559	14404	14053	14053
query68	5044	563	554	554
query69	537	380	375	375
query70	1177	1291	1275	1275
query71	366	244	241	241
query72	6219	2813	2660	2660
query73	701	327	316	316
query74	6366	5945	5929	5929
query75	3028	2422	2374	2374
query76	2817	1041	1161	1041
query77	342	239	234	234
query78	8934	8571	8436	8436
query79	1436	534	533	533
query80	1070	360	351	351
query81	472	198	197	197
query82	1193	89	86	86
query83	221	122	125	122
query84	278	75	78	75
query85	1318	359	341	341
query86	344	301	289	289
query87	3293	3084	3107	3084
query88	2686	2275	2250	2250
query89	391	319	340	319
query90	1855	168	165	165
query91	145	124	121	121
query92	56	50	48	48
query93	1304	534	517	517
query94	1245	184	180	180
query95	439	339	344	339
query96	582	256	263	256
query97	4267	4125	4137	4125
query98	219	205	200	200
query99	1044	664	718	664
Total cold run time: 263235 ms
Total hot run time: 169215 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.85 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7659c572406fb41133b5901d205bb24e83018297, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.02	0.03
query3	0.24	0.05	0.06
query4	1.68	0.10	0.10
query5	0.51	0.52	0.50
query6	1.31	0.69	0.67
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.55	0.51	0.50
query10	0.57	0.56	0.55
query11	0.13	0.10	0.09
query12	0.13	0.10	0.10
query13	0.63	0.62	0.62
query14	0.79	0.80	0.80
query15	0.84	0.83	0.82
query16	0.36	0.39	0.36
query17	1.02	0.98	0.99
query18	0.26	0.23	0.26
query19	1.75	1.79	1.67
query20	0.02	0.01	0.01
query21	15.40	0.66	0.64
query22	3.44	3.63	2.23
query23	17.54	1.06	0.94
query24	2.13	0.38	0.38
query25	0.33	0.06	0.04
query26	0.16	0.14	0.13
query27	0.03	0.03	0.03
query28	12.36	0.85	0.83
query29	12.61	3.26	3.19
query30	0.62	0.47	0.58
query31	2.78	0.36	0.35
query32	3.35	0.48	0.48
query33	3.19	3.24	3.22
query34	15.37	4.72	4.76
query35	4.74	4.75	4.75
query36	1.13	1.06	1.06
query37	0.06	0.05	0.05
query38	0.03	0.03	0.03
query39	0.02	0.02	0.01
query40	0.16	0.13	0.14
query41	0.08	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 106.51 s
Total hot run time: 31.85 s

yiguolei
yiguolei previously approved these changes Feb 29, 2024
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 29, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Feb 29, 2024
@HappenLee
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37901 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3714f717c00e45e75d6c7057ef8867b493a5618f, data reload: false

------ Round 1 ----------------------------------
q1	17675	4225	4073	4073
q2	2051	148	144	144
q3	10671	988	929	929
q4	4720	930	941	930
q5	7649	2893	3032	2893
q6	178	130	123	123
q7	1297	825	819	819
q8	9655	2044	2060	2044
q9	7428	6484	6448	6448
q10	8313	2559	2527	2527
q11	435	217	211	211
q12	1425	312	320	312
q13	18111	3056	2961	2961
q14	275	254	246	246
q15	466	439	456	439
q16	490	396	399	396
q17	949	882	846	846
q18	6347	5840	5878	5840
q19	1563	1507	1514	1507
q20	547	306	279	279
q21	7245	3712	3646	3646
q22	778	329	288	288
Total cold run time: 108268 ms
Total hot run time: 37901 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4073	3996	3986	3986
q2	314	212	220	212
q3	2940	2909	2894	2894
q4	1842	1813	1789	1789
q5	5234	5219	5239	5219
q6	199	116	120	116
q7	2269	1832	1822	1822
q8	3191	3303	3268	3268
q9	8492	8542	8493	8493
q10	6267	3731	3695	3695
q11	527	458	444	444
q12	690	558	528	528
q13	3505	2876	2803	2803
q14	268	251	238	238
q15	476	444	430	430
q16	447	427	412	412
q17	1667	1663	1652	1652
q18	7686	7386	7280	7280
q19	1626	1608	1603	1603
q20	1975	1719	1753	1719
q21	4923	4849	4787	4787
q22	520	418	456	418
Total cold run time: 59131 ms
Total hot run time: 53808 ms

@HappenLee
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38204 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ddb7c11a80572c38e863651f8710951999787b06, data reload: false

------ Round 1 ----------------------------------
q1	17790	4058	4056	4056
q2	2048	145	138	138
q3	10676	920	923	920
q4	4825	919	931	919
q5	7664	2865	3025	2865
q6	200	129	120	120
q7	1280	825	818	818
q8	9618	2051	2082	2051
q9	7524	6590	6540	6540
q10	8338	2617	2589	2589
q11	431	213	220	213
q12	790	310	321	310
q13	17990	3007	2973	2973
q14	290	253	254	253
q15	476	445	431	431
q16	478	393	396	393
q17	948	875	854	854
q18	6818	5937	6210	5937
q19	1588	1544	1546	1544
q20	582	297	296	296
q21	7683	3684	3713	3684
q22	836	300	323	300
Total cold run time: 108873 ms
Total hot run time: 38204 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4206	4121	4120	4120
q2	331	226	240	226
q3	3085	3023	2945	2945
q4	1846	1808	1791	1791
q5	5287	5293	5254	5254
q6	200	114	116	114
q7	2218	1870	1847	1847
q8	3177	3269	3272	3269
q9	8517	8544	8483	8483
q10	6136	3755	3726	3726
q11	524	451	437	437
q12	672	529	559	529
q13	8188	2883	2785	2785
q14	276	249	247	247
q15	461	428	433	428
q16	451	409	408	408
q17	1671	1634	1647	1634
q18	7822	7523	7267	7267
q19	5377	1621	1602	1602
q20	1944	1712	1709	1709
q21	4937	4682	4639	4639
q22	460	420	470	420
Total cold run time: 67786 ms
Total hot run time: 53880 ms

@HappenLee
Copy link
Contributor Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

struct WriteCooldownMetaExecutors {
WriteCooldownMetaExecutors(size_t executor_nums = 5);

~WriteCooldownMetaExecutors() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use '= default' to define a trivial destructor [modernize-use-equals-default]

    ~WriteCooldownMetaExecutors() {
    ^

@doris-robot
Copy link

TPC-H: Total hot run time: 38214 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9d4d90f2f7930f3f7073cb2096fe36b3226d9b56, data reload: false

------ Round 1 ----------------------------------
q1	17653	4048	4037	4037
q2	2061	159	147	147
q3	10547	961	934	934
q4	4670	959	954	954
q5	7619	2931	3092	2931
q6	192	123	124	123
q7	1301	835	823	823
q8	9489	2092	2101	2092
q9	7411	6501	6484	6484
q10	8243	2553	2555	2553
q11	420	219	215	215
q12	771	311	318	311
q13	17974	2934	2946	2934
q14	277	251	273	251
q15	478	450	438	438
q16	458	390	390	390
q17	951	886	910	886
q18	6692	6016	5908	5908
q19	1566	1525	1535	1525
q20	561	293	277	277
q21	7572	3748	3712	3712
q22	802	289	320	289
Total cold run time: 107708 ms
Total hot run time: 38214 ms

----- Round 2, with runtime_filter_mode=off -----
q1	3986	3985	4011	3985
q2	318	225	220	220
q3	2968	2944	2912	2912
q4	1855	1816	1826	1816
q5	5246	5263	5258	5258
q6	216	115	119	115
q7	2294	1847	1836	1836
q8	3199	3288	3281	3281
q9	8540	8547	8502	8502
q10	6138	3750	3722	3722
q11	542	449	429	429
q12	708	534	545	534
q13	10799	2809	2799	2799
q14	274	258	254	254
q15	468	427	432	427
q16	451	409	425	409
q17	1694	1670	1670	1670
q18	7927	7488	7234	7234
q19	3124	1624	1611	1611
q20	1933	1760	1734	1734
q21	5104	4859	4879	4859
q22	528	485	471	471
Total cold run time: 68312 ms
Total hot run time: 54078 ms

@yiguolei
Copy link
Contributor

yiguolei commented Mar 2, 2024

run buildall

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants