Skip to content

[improve](fe) Support to config max msg/frame size of the thrift server#35845

Merged
dataroaring merged 1 commit intoapache:masterfrom
w41ter:config_max_message_size
Jun 4, 2024
Merged

[improve](fe) Support to config max msg/frame size of the thrift server#35845
dataroaring merged 1 commit intoapache:masterfrom
w41ter:config_max_message_size

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Jun 4, 2024

No description provided.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jun 4, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39797 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b1208804687d629889da624163819ed016330b1, data reload: false

------ Round 1 ----------------------------------
q1	5598	4620	4265	4265
q2	419	191	194	191
q3	10026	1090	1215	1090
q4	10502	833	827	827
q5	7463	2714	2626	2626
q6	217	136	137	136
q7	937	610	589	589
q8	9217	2053	2084	2053
q9	8870	6500	6535	6500
q10	8952	3698	3677	3677
q11	456	248	235	235
q12	436	228	217	217
q13	17790	2991	2996	2991
q14	254	228	230	228
q15	517	473	461	461
q16	462	378	373	373
q17	988	644	761	644
q18	7967	7488	7361	7361
q19	3931	1548	1479	1479
q20	645	331	318	318
q21	4876	3201	3320	3201
q22	392	335	340	335
Total cold run time: 100915 ms
Total hot run time: 39797 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4338	4216	4292	4216
q2	364	267	274	267
q3	2963	2728	2731	2728
q4	1846	1607	1589	1589
q5	5273	5305	5292	5292
q6	220	126	126	126
q7	2080	1737	1765	1737
q8	3229	3314	3316	3314
q9	8350	8312	8358	8312
q10	3877	3653	3680	3653
q11	575	498	496	496
q12	803	609	595	595
q13	16487	3005	2989	2989
q14	290	261	260	260
q15	513	484	477	477
q16	473	410	405	405
q17	1763	1514	1456	1456
q18	7794	7598	7333	7333
q19	1744	1622	1564	1564
q20	1986	1784	1759	1759
q21	4871	4717	4715	4715
q22	602	525	532	525
Total cold run time: 70441 ms
Total hot run time: 53808 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 171093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b1208804687d629889da624163819ed016330b1, data reload: false

query1	932	385	367	367
query2	6468	2474	2468	2468
query3	6644	208	214	208
query4	19303	17612	17305	17305
query5	4137	450	463	450
query6	241	167	175	167
query7	4595	313	296	296
query8	313	286	280	280
query9	8378	2461	2448	2448
query10	459	301	282	282
query11	10558	10100	10035	10035
query12	141	90	88	88
query13	1640	365	365	365
query14	8920	6209	6341	6209
query15	225	184	190	184
query16	7164	294	283	283
query17	1108	524	537	524
query18	1913	298	284	284
query19	203	167	163	163
query20	95	89	89	89
query21	220	134	138	134
query22	4337	4089	3977	3977
query23	33778	33136	33138	33136
query24	11440	2859	2885	2859
query25	656	375	376	375
query26	1291	153	153	153
query27	3038	310	322	310
query28	7683	2089	2082	2082
query29	951	599	599	599
query30	291	148	151	148
query31	928	715	732	715
query32	88	55	53	53
query33	781	280	274	274
query34	1005	473	482	473
query35	747	619	620	619
query36	1105	967	935	935
query37	164	66	69	66
query38	2847	2747	2711	2711
query39	843	809	766	766
query40	213	127	122	122
query41	56	63	51	51
query42	123	95	98	95
query43	570	554	546	546
query44	1228	726	738	726
query45	199	179	163	163
query46	1079	691	720	691
query47	1833	1774	1818	1774
query48	367	295	297	295
query49	1067	431	411	411
query50	773	384	393	384
query51	6807	6845	6816	6816
query52	108	91	89	89
query53	355	295	289	289
query54	862	490	459	459
query55	72	71	73	71
query56	272	251	255	251
query57	1125	1058	1034	1034
query58	277	242	240	240
query59	3538	3195	3203	3195
query60	300	272	269	269
query61	92	86	86	86
query62	668	466	441	441
query63	316	288	287	287
query64	8919	2233	1685	1685
query65	3172	3095	3129	3095
query66	944	330	326	326
query67	15667	15256	14995	14995
query68	4607	539	544	539
query69	479	313	311	311
query70	1158	1157	1151	1151
query71	391	283	277	277
query72	7347	5578	4000	4000
query73	738	330	329	329
query74	5952	5452	5491	5452
query75	3355	2697	2663	2663
query76	2476	939	895	895
query77	470	303	292	292
query78	10551	9878	9794	9794
query79	2897	520	516	516
query80	2112	466	456	456
query81	588	222	214	214
query82	778	107	104	104
query83	328	177	173	173
query84	271	87	93	87
query85	1836	277	281	277
query86	479	331	302	302
query87	3282	3033	3042	3033
query88	4012	2445	2478	2445
query89	495	384	371	371
query90	1808	189	189	189
query91	126	96	96	96
query92	66	47	48	47
query93	3965	515	503	503
query94	1198	192	183	183
query95	402	315	320	315
query96	599	267	272	267
query97	3205	3035	3003	3003
query98	248	225	214	214
query99	1223	858	829	829
Total cold run time: 274074 ms
Total hot run time: 171093 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.09 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b1208804687d629889da624163819ed016330b1, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.06	0.05
query4	1.68	0.07	0.08
query5	0.50	0.50	0.51
query6	1.13	0.73	0.73
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.53	0.50	0.50
query10	0.54	0.57	0.55
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.60	0.59	0.60
query14	0.77	0.78	0.79
query15	0.83	0.80	0.81
query16	0.38	0.38	0.38
query17	1.03	1.04	1.03
query18	0.22	0.25	0.23
query19	1.84	1.74	1.82
query20	0.01	0.02	0.01
query21	15.73	0.69	0.67
query22	4.89	6.52	2.24
query23	18.27	1.42	1.29
query24	2.03	0.21	0.21
query25	0.14	0.09	0.09
query26	0.27	0.18	0.18
query27	0.07	0.08	0.07
query28	13.35	1.02	0.99
query29	13.46	3.35	3.32
query30	0.24	0.06	0.05
query31	2.87	0.40	0.39
query32	3.25	0.47	0.47
query33	2.93	2.94	2.86
query34	17.06	4.43	4.40
query35	4.53	4.48	4.59
query36	0.65	0.45	0.46
query37	0.18	0.16	0.16
query38	0.15	0.15	0.15
query39	0.05	0.03	0.04
query40	0.16	0.14	0.15
query41	0.09	0.05	0.05
query42	0.06	0.04	0.04
query43	0.04	0.04	0.04
Total cold run time: 111.26 s
Total hot run time: 31.09 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Jun 4, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 4, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Jun 4, 2024

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit 2b4b60a into apache:master Jun 4, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Jun 5, 2024
@w41ter w41ter deleted the config_max_message_size branch June 5, 2024 13:09
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jun 7, 2024
dataroaring pushed a commit that referenced this pull request Jun 8, 2024
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jun 20, 2024
dataroaring pushed a commit that referenced this pull request Jun 20, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants