Skip to content

[Opt](exec) enable top opt in string, float, double type#31489

Merged
BiteTheDDDDt merged 1 commit intoapache:masterfrom
HappenLee:rf
Feb 28, 2024
Merged

[Opt](exec) enable top opt in string, float, double type#31489
BiteTheDDDDt merged 1 commit intoapache:masterfrom
HappenLee:rf

Conversation

@HappenLee
Copy link
Contributor

Proposed changes

before:

select l_shipinstruct from lineitem order by l_shipinstruct limit 100;

14s

after:

select l_shipinstruct from lineitem order by l_shipinstruct limit 100;

2.2s

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@HappenLee
Copy link
Contributor Author

run buildall

morrySnow
morrySnow previously approved these changes Feb 27, 2024
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 27, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

BiteTheDDDDt
BiteTheDDDDt previously approved these changes Feb 27, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 37583 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a5b9d38cf21b4317f03321d59c578de5bffec423, data reload: false

------ Round 1 ----------------------------------
q1	17739	4000	4046	4000
q2	2050	148	134	134
q3	10571	935	950	935
q4	4972	971	952	952
q5	7617	2859	2970	2859
q6	179	123	122	122
q7	1219	758	741	741
q8	9246	1999	2002	1999
q9	7181	6304	6260	6260
q10	8194	2460	2500	2460
q11	409	214	219	214
q12	826	311	300	300
q13	17941	3201	3196	3196
q14	280	252	247	247
q15	529	499	497	497
q16	466	408	393	393
q17	941	851	828	828
q18	6776	5895	5987	5895
q19	1565	1499	1503	1499
q20	554	277	289	277
q21	6878	3570	3497	3497
q22	817	287	278	278
Total cold run time: 106950 ms
Total hot run time: 37583 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4053	3985	4013	3985
q2	304	215	224	215
q3	2948	2948	2941	2941
q4	1854	1812	1819	1812
q5	5094	5067	5076	5067
q6	194	116	117	116
q7	2155	1701	1716	1701
q8	3086	3158	3172	3158
q9	8227	8277	8206	8206
q10	6086	3645	3620	3620
q11	512	424	436	424
q12	684	537	543	537
q13	7076	3074	3021	3021
q14	268	247	256	247
q15	536	487	492	487
q16	504	493	478	478
q17	1678	1680	1673	1673
q18	7654	7490	7382	7382
q19	1630	1613	1620	1613
q20	2087	1897	1904	1897
q21	4706	4627	4625	4625
q22	497	452	418	418
Total cold run time: 61833 ms
Total hot run time: 53623 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.70% (8545/23938)
Line Coverage: 27.51% (69350/252066)
Region Coverage: 26.67% (35963/134868)
Branch Coverage: 23.47% (18380/78316)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a5b9d38cf21b4317f03321d59c578de5bffec423_a5b9d38cf21b4317f03321d59c578de5bffec423/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 168575 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a5b9d38cf21b4317f03321d59c578de5bffec423, data reload: false

query1	927	346	341	341
query2	6509	1660	1837	1660
query3	6687	204	199	199
query4	23279	20451	20426	20426
query5	4309	357	348	348
query6	264	169	170	169
query7	4614	293	308	293
query8	264	190	205	190
query9	8481	2308	2277	2277
query10	421	223	217	217
query11	14507	14159	14231	14159
query12	135	83	82	82
query13	1653	425	428	425
query14	8364	6623	6543	6543
query15	202	175	178	175
query16	7084	258	246	246
query17	1048	506	500	500
query18	1905	297	271	271
query19	198	151	149	149
query20	86	78	84	78
query21	189	126	114	114
query22	4580	4607	4478	4478
query23	30619	29799	29784	29784
query24	11814	3064	3063	3063
query25	657	359	361	359
query26	1855	162	160	160
query27	3009	311	312	311
query28	6980	1840	1825	1825
query29	1260	560	564	560
query30	285	132	137	132
query31	879	677	668	668
query32	100	59	59	59
query33	720	222	223	222
query34	1041	474	496	474
query35	844	735	729	729
query36	965	844	835	835
query37	180	62	59	59
query38	3111	3017	2933	2933
query39	1308	1266	1245	1245
query40	280	98	98	98
query41	37	40	35	35
query42	97	102	98	98
query43	448	424	420	420
query44	1060	694	717	694
query45	191	175	172	172
query46	1032	796	795	795
query47	1491	1447	1441	1441
query48	422	338	340	338
query49	1166	284	295	284
query50	766	377	375	375
query51	4363	4286	4260	4260
query52	100	90	85	85
query53	332	263	274	263
query54	281	220	219	219
query55	90	80	82	80
query56	222	200	195	195
query57	977	875	899	875
query58	214	191	194	191
query59	2161	2094	2084	2084
query60	242	210	227	210
query61	84	89	83	83
query62	608	366	354	354
query63	286	260	254	254
query64	6538	3012	3134	3012
query65	3234	3191	3183	3183
query66	1435	311	308	308
query67	14327	13815	14145	13815
query68	4927	555	564	555
query69	530	367	377	367
query70	1224	1242	1258	1242
query71	323	248	253	248
query72	6245	2775	2640	2640
query73	702	317	324	317
query74	6223	5991	5982	5982
query75	3034	2417	2391	2391
query76	2780	1003	1147	1003
query77	351	226	232	226
query78	8914	8410	8341	8341
query79	1548	518	520	518
query80	1076	367	346	346
query81	499	195	193	193
query82	929	87	83	83
query83	223	122	115	115
query84	280	82	77	77
query85	1329	343	335	335
query86	427	295	292	292
query87	3243	3062	3078	3062
query88	2777	2384	2350	2350
query89	392	314	312	312
query90	1908	161	163	161
query91	149	121	122	121
query92	57	46	49	46
query93	1250	518	515	515
query94	1313	176	180	176
query95	427	333	337	333
query96	566	271	269	269
query97	4225	4139	4128	4128
query98	220	202	197	197
query99	1092	655	669	655
Total cold run time: 263000 ms
Total hot run time: 168575 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a5b9d38cf21b4317f03321d59c578de5bffec423, data reload: false

query1	0.04	0.03	0.04
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.68	0.11	0.10
query5	0.52	0.51	0.52
query6	1.31	0.68	0.70
query7	0.02	0.02	0.01
query8	0.04	0.02	0.02
query9	0.55	0.48	0.52
query10	0.56	0.56	0.56
query11	0.12	0.10	0.09
query12	0.12	0.11	0.10
query13	0.62	0.62	0.62
query14	0.78	0.81	0.79
query15	0.83	0.82	0.82
query16	0.38	0.37	0.37
query17	0.98	0.97	0.98
query18	0.26	0.23	0.23
query19	1.86	1.71	1.70
query20	0.01	0.00	0.01
query21	15.43	0.62	0.62
query22	3.68	3.24	1.53
query23	17.36	0.96	0.97
query24	2.07	0.74	0.21
query25	0.45	0.15	0.06
query26	0.17	0.14	0.13
query27	0.05	0.04	0.05
query28	12.04	0.84	0.83
query29	12.82	3.54	3.28
query30	0.55	0.54	0.47
query31	2.78	0.34	0.35
query32	3.37	0.49	0.48
query33	3.19	3.17	3.24
query34	15.35	4.73	4.74
query35	4.75	4.73	4.70
query36	1.12	1.06	1.06
query37	0.07	0.05	0.05
query38	0.05	0.03	0.02
query39	0.02	0.02	0.02
query40	0.16	0.14	0.13
query41	0.07	0.01	0.02
query42	0.03	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 106.57 s
Total hot run time: 31.05 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a5b9d38cf21b4317f03321d59c578de5bffec423 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       17.2 seconds inserted 10000000 Rows, about 581K ops/s

@HappenLee HappenLee dismissed stale reviews from BiteTheDDDDt and morrySnow via f98b43c February 27, 2024 16:41
@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Feb 27, 2024
@HappenLee
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38227 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f98b43cceb174d0bd7f311eaa97097327eff8aca, data reload: false

------ Round 1 ----------------------------------
q1	17712	4069	4018	4018
q2	2047	149	134	134
q3	10565	959	957	957
q4	4658	954	955	954
q5	7629	2936	3021	2936
q6	183	123	124	123
q7	1273	771	757	757
q8	9318	2044	2026	2026
q9	7198	6270	6304	6270
q10	8284	2494	2505	2494
q11	410	203	205	203
q12	808	315	321	315
q13	17961	3229	3212	3212
q14	278	249	258	249
q15	534	518	484	484
q16	474	407	416	407
q17	941	902	889	889
q18	6779	6103	6121	6103
q19	1557	1508	1505	1505
q20	551	282	278	278
q21	6702	3619	3630	3619
q22	801	295	294	294
Total cold run time: 106663 ms
Total hot run time: 38227 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4012	3998	4027	3998
q2	307	216	216	216
q3	2998	2947	2949	2947
q4	1889	1840	1860	1840
q5	5086	5098	5121	5098
q6	197	120	118	118
q7	2160	1734	1758	1734
q8	3112	3194	3188	3188
q9	8293	8263	8273	8263
q10	6090	3661	3643	3643
q11	508	419	426	419
q12	697	539	561	539
q13	8426	3095	3080	3080
q14	287	250	256	250
q15	539	504	488	488
q16	506	464	462	462
q17	1693	1677	1672	1672
q18	7830	7582	7419	7419
q19	1680	1631	1635	1631
q20	2092	1908	1897	1897
q21	4826	4670	4733	4670
q22	508	447	465	447
Total cold run time: 63736 ms
Total hot run time: 54019 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.69% (8548/23951)
Line Coverage: 27.49% (69389/252401)
Region Coverage: 26.65% (35974/134999)
Branch Coverage: 23.46% (18392/78392)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f98b43cceb174d0bd7f311eaa97097327eff8aca_f98b43cceb174d0bd7f311eaa97097327eff8aca/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 169090 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f98b43cceb174d0bd7f311eaa97097327eff8aca, data reload: false

query1	935	345	332	332
query2	6532	1674	1797	1674
query3	6702	219	215	215
query4	23261	20582	20613	20582
query5	4316	363	356	356
query6	255	171	167	167
query7	4600	306	293	293
query8	267	192	195	192
query9	8390	2230	2217	2217
query10	416	223	218	218
query11	14593	14180	14074	14074
query12	139	81	89	81
query13	1633	435	432	432
query14	8670	6370	6668	6370
query15	206	181	176	176
query16	7074	261	251	251
query17	1057	513	500	500
query18	1902	278	261	261
query19	191	153	148	148
query20	85	80	82	80
query21	191	124	122	122
query22	4699	4634	4580	4580
query23	30557	29955	29966	29955
query24	11888	3095	3042	3042
query25	664	357	346	346
query26	1864	154	158	154
query27	3051	304	318	304
query28	7080	1790	1783	1783
query29	1191	567	576	567
query30	289	141	140	140
query31	858	675	697	675
query32	90	60	62	60
query33	729	227	217	217
query34	1059	474	487	474
query35	875	763	753	753
query36	962	867	886	867
query37	149	63	61	61
query38	3079	3020	2998	2998
query39	1331	1265	1262	1262
query40	281	103	106	103
query41	38	37	35	35
query42	108	99	105	99
query43	457	433	440	433
query44	1072	685	703	685
query45	187	189	174	174
query46	1042	786	768	768
query47	1543	1377	1363	1363
query48	422	338	371	338
query49	1149	297	305	297
query50	772	374	372	372
query51	4361	4308	4289	4289
query52	101	94	91	91
query53	332	264	267	264
query54	286	235	224	224
query55	87	80	79	79
query56	221	199	195	195
query57	983	935	879	879
query58	219	198	188	188
query59	2066	2077	2167	2077
query60	239	211	230	211
query61	87	111	85	85
query62	591	329	362	329
query63	290	254	259	254
query64	6523	2988	3160	2988
query65	3229	3217	3180	3180
query66	1428	320	326	320
query67	14322	14195	13919	13919
query68	5061	544	564	544
query69	513	384	397	384
query70	1215	1243	1222	1222
query71	326	259	254	254
query72	6260	2799	2687	2687
query73	719	328	322	322
query74	6271	6032	6016	6016
query75	3071	2387	2421	2387
query76	2759	1034	1131	1034
query77	350	238	239	238
query78	8996	8463	8419	8419
query79	1011	529	536	529
query80	779	359	356	356
query81	468	198	198	198
query82	583	86	88	86
query83	235	123	123	123
query84	276	78	84	78
query85	1303	351	342	342
query86	357	290	294	290
query87	3235	3083	3120	3083
query88	2736	2341	2293	2293
query89	391	326	322	322
query90	1862	171	164	164
query91	159	137	124	124
query92	57	53	50	50
query93	1099	511	499	499
query94	1307	176	182	176
query95	432	349	350	349
query96	584	267	264	264
query97	4272	4171	4198	4171
query98	220	204	195	195
query99	1069	702	673	673
Total cold run time: 262242 ms
Total hot run time: 169090 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f98b43cceb174d0bd7f311eaa97097327eff8aca, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.02	0.02
query3	0.23	0.06	0.06
query4	1.66	0.09	0.09
query5	0.52	0.52	0.52
query6	1.34	0.68	0.67
query7	0.01	0.01	0.02
query8	0.04	0.02	0.02
query9	0.57	0.51	0.50
query10	0.56	0.55	0.59
query11	0.13	0.10	0.09
query12	0.12	0.10	0.10
query13	0.62	0.62	0.61
query14	0.79	0.80	0.80
query15	0.84	0.81	0.82
query16	0.37	0.37	0.37
query17	0.95	0.97	0.97
query18	0.27	0.25	0.24
query19	1.85	1.74	1.68
query20	0.01	0.00	0.01
query21	15.45	0.62	0.62
query22	2.87	3.11	3.23
query23	17.34	1.01	1.04
query24	1.97	0.98	0.19
query25	0.47	0.15	0.06
query26	0.15	0.13	0.12
query27	0.05	0.05	0.05
query28	11.97	0.84	0.83
query29	12.68	3.25	3.43
query30	0.61	0.52	0.53
query31	2.80	0.35	0.35
query32	3.35	0.48	0.48
query33	3.20	3.24	3.16
query34	15.36	4.77	4.74
query35	4.77	4.75	4.73
query36	1.13	1.07	1.07
query37	0.07	0.05	0.05
query38	0.05	0.03	0.03
query39	0.01	0.01	0.02
query40	0.16	0.13	0.12
query41	0.06	0.01	0.02
query42	0.03	0.01	0.02
query43	0.03	0.02	0.01
Total cold run time: 105.56 s
Total hot run time: 32.67 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f98b43cceb174d0bd7f311eaa97097327eff8aca with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       16.9 seconds inserted 10000000 Rows, about 591K ops/s

@HappenLee
Copy link
Contributor Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

uint16_t _evaluate_inner(const vectorized::IColumn& column, uint16_t* sel,
uint16_t size) const override {
if (column.has_null()) {
if (size == 0) return 0;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: statement should be inside braces [readability-braces-around-statements]

Suggested change
if (size == 0) return 0;
if (size == 0) { return 0;
}

@doris-robot
Copy link

TPC-H: Total hot run time: 37964 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 16966e9cc927c783b14059febcdd01c3de9d6239, data reload: false

------ Round 1 ----------------------------------
q1	17679	4122	4033	4033
q2	2047	138	136	136
q3	10665	997	930	930
q4	4670	937	922	922
q5	7659	2937	2979	2937
q6	180	121	119	119
q7	1234	754	741	741
q8	9381	2001	1999	1999
q9	7245	6280	6282	6280
q10	8285	2498	2481	2481
q11	414	214	213	213
q12	1409	306	308	306
q13	18126	3212	3222	3212
q14	281	256	253	253
q15	532	505	484	484
q16	506	416	404	404
q17	922	887	856	856
q18	6477	6068	6016	6016
q19	1554	1503	1507	1503
q20	476	271	269	269
q21	6074	3580	3584	3580
q22	521	300	290	290
Total cold run time: 106337 ms
Total hot run time: 37964 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4085	4071	3996	3996
q2	297	216	207	207
q3	2963	2935	2913	2913
q4	1841	1812	1798	1798
q5	5046	5111	5116	5111
q6	201	114	116	114
q7	2101	1718	1714	1714
q8	3107	3161	3211	3161
q9	8238	8214	8214	8214
q10	3799	3631	3639	3631
q11	518	433	430	430
q12	712	508	537	508
q13	3705	3097	3048	3048
q14	270	247	249	247
q15	549	497	498	497
q16	507	465	478	465
q17	1692	1675	1680	1675
q18	7824	7445	7332	7332
q19	1644	1622	1612	1612
q20	2107	1900	1909	1900
q21	4924	4585	4652	4585
q22	529	451	463	451
Total cold run time: 56659 ms
Total hot run time: 53609 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 168978 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 16966e9cc927c783b14059febcdd01c3de9d6239, data reload: false

query1	925	344	329	329
query2	6534	1854	1819	1819
query3	6717	218	209	209
query4	23340	20643	20590	20590
query5	4361	361	366	361
query6	257	165	172	165
query7	4618	293	296	293
query8	252	198	204	198
query9	8383	2219	2207	2207
query10	413	215	210	210
query11	14680	14265	14305	14265
query12	135	81	82	81
query13	1647	430	427	427
query14	8853	6545	6187	6187
query15	216	176	175	175
query16	7081	257	251	251
query17	1046	499	490	490
query18	1901	276	266	266
query19	198	145	144	144
query20	82	82	86	82
query21	204	116	127	116
query22	4658	4638	4476	4476
query23	30581	29811	29956	29811
query24	11959	3102	3068	3068
query25	637	354	355	354
query26	1785	148	159	148
query27	2995	313	325	313
query28	6938	1790	1782	1782
query29	1149	561	544	544
query30	282	133	137	133
query31	876	682	694	682
query32	93	58	53	53
query33	702	223	228	223
query34	1039	477	493	477
query35	837	759	759	759
query36	995	870	861	861
query37	151	62	61	61
query38	3092	2969	3018	2969
query39	1329	1254	1236	1236
query40	282	100	99	99
query41	37	35	35	35
query42	103	94	97	94
query43	457	422	439	422
query44	1052	689	693	689
query45	193	176	172	172
query46	1032	802	805	802
query47	1490	1361	1479	1361
query48	416	349	351	349
query49	1155	283	304	283
query50	781	366	367	366
query51	4471	4269	4278	4269
query52	99	90	92	90
query53	333	264	264	264
query54	307	225	231	225
query55	84	85	80	80
query56	213	210	192	192
query57	955	865	907	865
query58	208	197	193	193
query59	2150	2201	2186	2186
query60	252	232	221	221
query61	84	84	82	82
query62	591	359	356	356
query63	297	263	250	250
query64	6548	2990	3176	2990
query65	3236	3237	3197	3197
query66	1441	317	312	312
query67	14763	14261	14069	14069
query68	4921	546	569	546
query69	536	379	369	369
query70	1226	1186	1291	1186
query71	352	242	248	242
query72	6187	2826	2673	2673
query73	695	320	312	312
query74	6352	5940	5935	5935
query75	3086	2451	2405	2405
query76	2819	1059	1165	1059
query77	342	234	240	234
query78	8933	8551	8431	8431
query79	1045	539	522	522
query80	670	365	346	346
query81	449	196	194	194
query82	1277	86	85	85
query83	238	122	120	120
query84	279	79	73	73
query85	1152	348	342	342
query86	318	300	288	288
query87	3341	3120	3106	3106
query88	2742	2320	2295	2295
query89	405	318	340	318
query90	1951	168	161	161
query91	148	123	126	123
query92	53	48	53	48
query93	1037	496	504	496
query94	1001	173	176	173
query95	430	335	333	333
query96	574	263	264	263
query97	4236	4144	4125	4125
query98	222	195	201	195
query99	1085	683	652	652
Total cold run time: 263073 ms
Total hot run time: 168978 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.68% (8546/23951)
Line Coverage: 27.48% (69358/252399)
Region Coverage: 26.64% (35958/134998)
Branch Coverage: 23.45% (18380/78390)
Coverage Report: http://coverage.selectdb-in.cc/coverage/16966e9cc927c783b14059febcdd01c3de9d6239_16966e9cc927c783b14059febcdd01c3de9d6239/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 32.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 16966e9cc927c783b14059febcdd01c3de9d6239, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.02	0.02
query3	0.23	0.06	0.06
query4	1.67	0.10	0.10
query5	0.52	0.51	0.52
query6	1.39	0.67	0.67
query7	0.02	0.01	0.02
query8	0.03	0.02	0.02
query9	0.54	0.51	0.52
query10	0.56	0.57	0.57
query11	0.12	0.09	0.10
query12	0.12	0.10	0.11
query13	0.63	0.62	0.60
query14	0.79	0.81	0.79
query15	0.83	0.82	0.80
query16	0.36	0.36	0.36
query17	0.96	1.01	0.96
query18	0.27	0.26	0.26
query19	1.79	1.71	1.71
query20	0.02	0.01	0.01
query21	15.41	0.64	0.59
query22	3.02	3.99	2.83
query23	17.33	1.06	0.89
query24	2.15	0.22	0.76
query25	0.45	0.14	0.07
query26	0.16	0.12	0.14
query27	0.05	0.05	0.04
query28	11.97	0.82	0.84
query29	12.58	3.33	3.30
query30	0.59	0.50	0.53
query31	2.78	0.35	0.35
query32	3.36	0.49	0.48
query33	3.25	3.20	3.25
query34	15.36	4.75	4.71
query35	4.75	4.71	4.75
query36	1.14	1.07	1.06
query37	0.07	0.05	0.05
query38	0.04	0.03	0.03
query39	0.02	0.02	0.02
query40	0.16	0.14	0.15
query41	0.08	0.02	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 105.72 s
Total hot run time: 32.35 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 16966e9cc927c783b14059febcdd01c3de9d6239 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       18.1 seconds inserted 10000000 Rows, about 552K ops/s

@HappenLee
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38076 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4eb3e56d779dfca773c710ba8a5301396d6951bf, data reload: false

------ Round 1 ----------------------------------
q1	17945	4185	4152	4152
q2	2373	142	137	137
q3	11414	971	964	964
q4	5247	957	950	950
q5	7937	2901	2992	2901
q6	180	121	119	119
q7	1225	758	744	744
q8	9254	2001	2017	2001
q9	7144	6267	6291	6267
q10	8175	2503	2505	2503
q11	421	208	192	192
q12	768	309	310	309
q13	17949	3241	3206	3206
q14	275	253	251	251
q15	528	492	489	489
q16	481	401	407	401
q17	936	861	828	828
q18	6711	6168	6020	6020
q19	1571	1516	1516	1516
q20	539	277	280	277
q21	6808	3569	3573	3569
q22	804	289	280	280
Total cold run time: 108685 ms
Total hot run time: 38076 ms

----- Round 2, with runtime_filter_mode=off -----
q1	3999	3992	4001	3992
q2	300	213	219	213
q3	2974	2948	2949	2948
q4	1827	1797	1832	1797
q5	5149	5097	5110	5097
q6	198	115	116	115
q7	2147	1686	1763	1686
q8	3108	3172	3207	3172
q9	8305	8251	8229	8229
q10	6104	3672	3666	3666
q11	512	429	427	427
q12	683	536	563	536
q13	7007	3100	3053	3053
q14	277	263	252	252
q15	532	486	483	483
q16	515	450	461	450
q17	1688	1679	1663	1663
q18	7823	7331	7516	7331
q19	1635	1628	1635	1628
q20	2118	1914	1895	1895
q21	4743	4613	4661	4613
q22	505	457	450	450
Total cold run time: 62149 ms
Total hot run time: 53696 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 168865 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4eb3e56d779dfca773c710ba8a5301396d6951bf, data reload: false

query1	922	349	334	334
query2	6528	1714	1677	1677
query3	6695	222	213	213
query4	23142	20551	20502	20502
query5	4322	360	374	360
query6	261	171	180	171
query7	4606	306	291	291
query8	254	202	192	192
query9	8362	2234	2210	2210
query10	413	215	209	209
query11	14557	14136	14203	14136
query12	134	82	84	82
query13	1629	435	434	434
query14	8642	6279	6568	6279
query15	207	178	174	174
query16	7081	267	256	256
query17	1047	511	510	510
query18	1900	272	265	265
query19	188	149	145	145
query20	85	79	84	79
query21	202	119	119	119
query22	4806	4625	4461	4461
query23	30478	29817	29782	29782
query24	11872	3106	3102	3102
query25	653	357	353	353
query26	1852	158	160	158
query27	3040	318	312	312
query28	7033	1798	1792	1792
query29	1202	555	558	555
query30	288	136	140	136
query31	868	678	687	678
query32	99	65	57	57
query33	712	223	231	223
query34	1062	472	482	472
query35	860	746	732	732
query36	947	858	860	858
query37	150	59	62	59
query38	3136	2947	2957	2947
query39	1296	1253	1261	1253
query40	274	98	101	98
query41	37	36	35	35
query42	106	98	95	95
query43	441	433	431	431
query44	1064	678	689	678
query45	190	180	176	176
query46	1056	782	786	782
query47	1511	1483	1473	1473
query48	418	343	356	343
query49	1154	296	308	296
query50	769	368	367	367
query51	4294	4291	4280	4280
query52	110	87	97	87
query53	340	266	267	266
query54	301	222	229	222
query55	97	83	88	83
query56	216	204	196	196
query57	975	869	871	869
query58	210	205	195	195
query59	2172	2114	1903	1903
query60	239	213	215	213
query61	90	96	86	86
query62	606	362	372	362
query63	276	251	249	249
query64	6554	3149	3109	3109
query65	3237	3212	3196	3196
query66	1440	319	316	316
query67	14304	14203	14148	14148
query68	4995	540	552	540
query69	536	373	374	373
query70	1196	1215	1167	1167
query71	347	241	240	240
query72	6240	2830	2711	2711
query73	717	318	319	318
query74	6356	5990	6008	5990
query75	3044	2422	2414	2414
query76	2829	1021	1170	1021
query77	341	230	228	228
query78	8909	8539	8500	8500
query79	1241	510	510	510
query80	952	364	347	347
query81	479	198	195	195
query82	956	85	83	83
query83	219	133	120	120
query84	280	78	77	77
query85	1334	360	342	342
query86	377	297	291	291
query87	3268	3075	3087	3075
query88	2702	2360	2320	2320
query89	391	315	333	315
query90	1841	164	167	164
query91	148	126	124	124
query92	56	50	49	49
query93	1192	518	494	494
query94	1289	178	177	177
query95	436	346	343	343
query96	568	265	267	265
query97	4236	4180	4129	4129
query98	233	205	191	191
query99	1070	630	640	630
Total cold run time: 262790 ms
Total hot run time: 168865 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.69% (8547/23951)
Line Coverage: 27.49% (69370/252392)
Region Coverage: 26.65% (35969/134992)
Branch Coverage: 23.45% (18382/78392)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4eb3e56d779dfca773c710ba8a5301396d6951bf_4eb3e56d779dfca773c710ba8a5301396d6951bf/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 32.32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4eb3e56d779dfca773c710ba8a5301396d6951bf, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.02	0.02
query3	0.23	0.05	0.06
query4	1.68	0.09	0.10
query5	0.52	0.52	0.52
query6	1.25	0.67	0.68
query7	0.02	0.02	0.01
query8	0.04	0.02	0.02
query9	0.56	0.52	0.51
query10	0.56	0.59	0.57
query11	0.13	0.09	0.10
query12	0.12	0.10	0.10
query13	0.61	0.62	0.61
query14	0.78	0.79	0.79
query15	0.83	0.82	0.81
query16	0.36	0.37	0.38
query17	1.01	0.99	0.96
query18	0.25	0.24	0.25
query19	1.82	1.66	1.75
query20	0.01	0.01	0.02
query21	15.41	0.64	0.55
query22	3.35	4.02	2.61
query23	17.30	1.01	1.00
query24	1.99	0.37	0.76
query25	0.48	0.14	0.06
query26	0.16	0.13	0.12
query27	0.05	0.04	0.03
query28	11.99	0.84	0.82
query29	12.72	3.27	3.46
query30	0.59	0.52	0.52
query31	2.79	0.35	0.35
query32	3.36	0.48	0.48
query33	3.21	3.27	3.24
query34	15.35	4.74	4.73
query35	4.75	4.76	4.73
query36	1.13	1.07	1.05
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 105.91 s
Total hot run time: 32.32 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 4eb3e56d779dfca773c710ba8a5301396d6951bf with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       19.0 seconds inserted 10000000 Rows, about 526K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 28, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@BiteTheDDDDt BiteTheDDDDt merged commit fa7b476 into apache:master Feb 28, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Feb 28, 2024
yiguolei pushed a commit that referenced this pull request Feb 28, 2024
yiguolei pushed a commit that referenced this pull request Feb 29, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.6-merged p0_b reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants