Skip to content

Conversation

@mrhhsg
Copy link
Member

@mrhhsg mrhhsg commented Mar 12, 2024

Proposed changes

pick #32103 from master into branch-2.0

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@mrhhsg
Copy link
Member Author

mrhhsg commented Mar 12, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 50029 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c1f3b37e3f06bed07b0839216e3ca6e876e5ba73, data reload: false

------ Round 1 ----------------------------------
q1	17900	4431	4351	4351
q2	2035	146	145	145
q3	10279	1853	1923	1853
q4	10148	1261	1326	1261
q5	8495	4025	3949	3949
q6	229	123	123	123
q7	2019	1586	1610	1586
q8	9302	2716	2721	2716
q9	10998	10836	10694	10694
q10	8638	3504	3467	3467
q11	421	240	247	240
q12	460	296	306	296
q13	18357	3969	4015	3969
q14	349	317	323	317
q15	500	452	452	452
q16	699	580	590	580
q17	1139	962	981	962
q18	7238	6977	6820	6820
q19	1678	1570	1472	1472
q20	540	296	292	292
q21	4469	4086	4137	4086
q22	502	412	398	398
Total cold run time: 116395 ms
Total hot run time: 50029 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4294	4306	4274	4274
q2	321	215	223	215
q3	4151	4149	4130	4130
q4	2741	2727	2809	2727
q5	7341	7303	7188	7188
q6	233	124	121	121
q7	3217	2859	2846	2846
q8	4354	4513	4498	4498
q9	17645	17278	17263	17263
q10	4227	4262	4249	4249
q11	771	695	671	671
q12	1030	835	851	835
q13	7113	3764	3765	3764
q14	456	418	427	418
q15	499	451	447	447
q16	753	707	693	693
q17	3826	3921	3842	3842
q18	8824	8666	8818	8666
q19	1738	1702	1614	1614
q20	2410	2150	2131	2131
q21	8494	8487	8441	8441
q22	1052	962	968	962
Total cold run time: 85490 ms
Total hot run time: 79995 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.78% (8036/21268)
Line Coverage: 29.47% (65569/222498)
Region Coverage: 28.94% (33739/116588)
Branch Coverage: 24.78% (17313/69854)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c1f3b37e3f06bed07b0839216e3ca6e876e5ba73_c1f3b37e3f06bed07b0839216e3ca6e876e5ba73/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 202414 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c1f3b37e3f06bed07b0839216e3ca6e876e5ba73, data reload: false

query1	924	395	378	378
query2	6555	2281	2162	2162
query3	6916	194	193	193
query4	21469	17940	18002	17940
query5	19728	6576	6731	6576
query6	309	218	225	218
query7	4155	296	307	296
query8	262	237	239	237
query9	3114	2696	2621	2621
query10	412	295	306	295
query11	11394	10609	10688	10609
query12	122	75	73	73
query13	5585	640	622	622
query14	18044	13551	13541	13541
query15	385	244	236	236
query16	6444	277	260	260
query17	1752	1444	857	857
query18	2330	407	394	394
query19	203	145	155	145
query20	78	78	76	76
query21	189	95	93	93
query22	5175	5040	5084	5040
query23	32727	31971	32034	31971
query24	6947	6533	6480	6480
query25	517	432	419	419
query26	525	165	158	158
query27	1847	294	297	294
query28	6009	2202	2198	2198
query29	2933	2857	2670	2670
query30	245	162	159	159
query31	903	752	752	752
query32	68	62	58	58
query33	382	259	250	250
query34	849	452	475	452
query35	1153	951	970	951
query36	1526	1601	1313	1313
query37	90	62	59	59
query38	3069	2960	2910	2910
query39	1378	1333	1310	1310
query40	203	95	97	95
query41	35	34	33	33
query42	82	93	83	83
query43	600	660	562	562
query44	1141	714	712	712
query45	243	227	224	224
query46	1228	981	978	978
query47	1983	1730	1761	1730
query48	973	681	649	649
query49	603	378	354	354
query50	860	614	588	588
query51	4871	4755	4659	4659
query52	90	91	78	78
query53	442	321	318	318
query54	2631	2451	2457	2451
query55	89	67	81	67
query56	185	194	208	194
query57	1148	1076	1112	1076
query58	216	205	198	198
query59	3675	3323	3194	3194
query60	196	194	183	183
query61	83	83	83	83
query62	822	462	440	440
query63	479	335	335	335
query64	2220	1446	1398	1398
query65	3615	3534	3560	3534
query66	791	367	365	365
query67	17734	15718	15516	15516
query68	5671	649	627	627
query69	572	334	336	334
query70	1721	1984	1655	1655
query71	401	300	309	300
query72	6485	3473	3446	3446
query73	719	315	315	315
query74	6290	5875	5779	5779
query75	4364	3677	3704	3677
query76	3171	1171	1217	1171
query77	509	238	246	238
query78	12794	11894	11825	11825
query79	6788	630	628	628
query80	2414	391	388	388
query81	511	234	232	232
query82	1351	96	96	96
query83	176	136	127	127
query84	228	68	66	66
query85	1408	283	277	277
query86	415	395	369	369
query87	3165	3022	3048	3022
query88	4881	2311	2293	2293
query89	335	281	292	281
query90	1853	201	203	201
query91	145	111	113	111
query92	54	51	51	51
query93	2234	567	567	567
query94	1016	202	201	201
query95	1113	1068	1060	1060
query96	634	338	319	319
query97	6501	6370	6367	6367
query98	192	182	175	175
query99	1693	876	853	853
Total cold run time: 303755 ms
Total hot run time: 202414 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.38 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c1f3b37e3f06bed07b0839216e3ca6e876e5ba73, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.02
query3	0.24	0.05	0.05
query4	1.81	0.06	0.06
query5	0.54	0.52	0.52
query6	1.27	0.63	0.63
query7	0.01	0.00	0.01
query8	0.04	0.02	0.02
query9	0.51	0.49	0.48
query10	0.54	0.53	0.52
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.62	0.62	0.62
query14	0.79	0.79	0.77
query15	0.78	0.76	0.75
query16	0.36	0.38	0.37
query17	0.99	0.97	1.00
query18	0.20	0.28	0.23
query19	1.93	1.87	1.88
query20	0.01	0.00	0.00
query21	15.49	0.53	0.55
query22	1.92	2.06	0.94
query23	17.10	0.87	0.88
query24	5.51	1.78	1.30
query25	0.38	0.13	0.04
query26	0.69	0.16	0.16
query27	0.05	0.03	0.04
query28	6.95	0.72	0.74
query29	12.61	2.33	2.32
query30	0.51	0.52	0.52
query31	2.80	0.39	0.37
query32	3.41	0.50	0.49
query33	3.07	3.07	3.10
query34	15.28	4.83	4.81
query35	4.87	4.89	4.88
query36	1.06	1.03	1.01
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.01
query42	0.01	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 103.01 s
Total hot run time: 30.38 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c1f3b37e3f06bed07b0839216e3ca6e876e5ba73 with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.8 seconds inserted 10000000 Rows, about 480K ops/s

@yiguolei yiguolei merged commit 5b21951 into apache:branch-2.0 Mar 12, 2024
@mrhhsg mrhhsg deleted the pick_fix_eq_null branch March 12, 2024 14:38
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants