Skip to content

Conversation

@dataroaring
Copy link
Contributor

@dataroaring dataroaring commented Jun 11, 2024

Proposed changes

pick #35805 #36026

Issue Number: close #xxx

…ache#35805)


We encounter a problem that tcp connections created by libevent is in
established while there is no corresponding endpoint in the other
endpoint. So we enable keepalive to recycle the tcp connection.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@dataroaring
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.80% (8097/21423)
Line Coverage: 29.44% (66086/224461)
Region Coverage: 28.94% (34080/117758)
Branch Coverage: 24.79% (17487/70542)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e23a12c1e43065e7bc800b28bb2fa33dd2156de5_e23a12c1e43065e7bc800b28bb2fa33dd2156de5/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49895 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e23a12c1e43065e7bc800b28bb2fa33dd2156de5, data reload: false

------ Round 1 ----------------------------------
q1	17628	4345	4308	4308
q2	2067	158	149	149
q3	10286	1877	1919	1877
q4	10375	1244	1328	1244
q5	8430	3814	3904	3814
q6	233	150	125	125
q7	2027	1599	1612	1599
q8	9321	2717	2691	2691
q9	11025	10479	10395	10395
q10	8719	3537	3572	3537
q11	420	256	241	241
q12	467	302	298	298
q13	18412	4043	4183	4043
q14	367	338	342	338
q15	518	460	467	460
q16	726	602	602	602
q17	1151	974	964	964
q18	7346	6872	6830	6830
q19	1681	1574	1554	1554
q20	576	306	292	292
q21	4462	4114	4197	4114
q22	529	420	425	420
Total cold run time: 116766 ms
Total hot run time: 49895 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4549	4445	4418	4418
q2	349	268	258	258
q3	4335	4272	4242	4242
q4	2838	2802	2860	2802
q5	7491	7299	7234	7234
q6	247	128	129	128
q7	3261	2906	2894	2894
q8	4398	4450	4486	4450
q9	17465	16837	17040	16837
q10	4267	4293	4276	4276
q11	754	721	694	694
q12	1040	846	833	833
q13	7393	3730	3741	3730
q14	456	438	421	421
q15	511	452	466	452
q16	734	682	687	682
q17	3933	3819	3837	3819
q18	8814	8705	8803	8705
q19	1678	1703	1622	1622
q20	2387	2173	2082	2082
q21	8475	8429	8405	8405
q22	986	959	936	936
Total cold run time: 86361 ms
Total hot run time: 79920 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204411 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e23a12c1e43065e7bc800b28bb2fa33dd2156de5, data reload: false

query1	948	424	376	376
query2	6535	2858	2538	2538
query3	6926	212	206	206
query4	20536	18048	18014	18014
query5	19742	6587	6496	6496
query6	300	224	230	224
query7	4188	312	311	311
query8	252	246	265	246
query9	3134	2713	2651	2651
query10	423	326	312	312
query11	11318	10673	10638	10638
query12	123	83	75	75
query13	5597	707	688	688
query14	18156	13539	13885	13539
query15	378	227	246	227
query16	6481	285	264	264
query17	1717	1438	904	904
query18	2301	425	420	420
query19	221	155	151	151
query20	82	78	77	77
query21	196	94	98	94
query22	5197	4915	4955	4915
query23	32567	31868	31985	31868
query24	7013	6572	6603	6572
query25	533	442	444	442
query26	523	172	166	166
query27	1802	303	295	295
query28	6144	2382	2332	2332
query29	2937	2759	2700	2700
query30	251	170	181	170
query31	909	779	789	779
query32	67	63	59	59
query33	405	246	255	246
query34	887	477	469	469
query35	1126	993	951	951
query36	1306	1140	1292	1140
query37	92	62	66	62
query38	3092	2930	3000	2930
query39	1378	1337	1326	1326
query40	208	102	92	92
query41	41	38	39	38
query42	83	87	88	87
query43	767	739	645	645
query44	1156	718	723	718
query45	252	228	240	228
query46	1238	964	1002	964
query47	1762	1763	1955	1763
query48	1014	711	720	711
query49	641	384	390	384
query50	858	628	625	625
query51	4725	4654	4721	4654
query52	101	87	86	86
query53	450	322	323	322
query54	2643	2440	2483	2440
query55	87	96	88	88
query56	242	230	217	217
query57	1182	1211	1131	1131
query58	221	231	209	209
query59	4289	3840	4019	3840
query60	215	210	221	210
query61	99	104	96	96
query62	756	547	465	465
query63	496	349	350	349
query64	2568	1554	1500	1500
query65	3682	3579	3553	3553
query66	770	383	380	380
query67	15584	15756	15288	15288
query68	10322	675	670	670
query69	602	359	340	340
query70	1999	1388	1384	1384
query71	423	305	326	305
query72	6516	3515	3462	3462
query73	751	332	324	324
query74	6250	5924	5897	5897
query75	5336	3734	3746	3734
query76	6601	1186	1237	1186
query77	1107	281	258	258
query78	12757	11906	11789	11789
query79	6861	658	659	658
query80	941	416	414	414
query81	495	237	237	237
query82	1753	103	98	98
query83	173	134	134	134
query84	264	76	76	76
query85	883	331	326	326
query86	346	310	322	310
query87	3234	3028	3066	3028
query88	4665	2364	2358	2358
query89	372	293	296	293
query90	1977	226	221	221
query91	174	158	157	157
query92	63	59	59	59
query93	5657	574	602	574
query94	704	213	219	213
query95	1105	1074	1065	1065
query96	634	334	339	334
query97	6475	6485	6522	6485
query98	191	180	172	172
query99	2906	894	944	894
Total cold run time: 314450 ms
Total hot run time: 204411 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.88 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e23a12c1e43065e7bc800b28bb2fa33dd2156de5, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.03
query3	0.25	0.05	0.05
query4	1.81	0.08	0.09
query5	0.54	0.53	0.52
query6	1.25	0.61	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.49	0.48
query10	0.53	0.53	0.55
query11	0.12	0.09	0.10
query12	0.12	0.09	0.09
query13	0.63	0.62	0.61
query14	0.78	0.79	0.80
query15	0.77	0.76	0.77
query16	0.39	0.36	0.37
query17	0.97	1.03	1.02
query18	0.23	0.26	0.24
query19	1.91	1.88	1.81
query20	0.02	0.01	0.01
query21	15.52	0.56	0.56
query22	1.96	2.33	2.05
query23	17.36	1.13	1.02
query24	6.72	0.40	1.00
query25	0.40	0.10	0.05
query26	0.63	0.15	0.15
query27	0.04	0.04	0.04
query28	7.04	0.80	0.73
query29	12.78	2.35	2.36
query30	0.58	0.56	0.53
query31	2.81	0.40	0.38
query32	3.37	0.51	0.50
query33	3.08	3.13	3.08
query34	15.25	4.81	4.80
query35	4.90	4.87	4.84
query36	1.05	1.02	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.85 s
Total hot run time: 30.88 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e23a12c1e43065e7bc800b28bb2fa33dd2156de5 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s

@dataroaring dataroaring merged commit c58146e into apache:branch-2.0 Jun 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants