Skip to content

[conf](pool) incrase fragment_mgr_async_work_pool_thread_num_max#54437

Merged
Gabriel39 merged 1 commit intoapache:masterfrom
Gabriel39:conf_1
Aug 8, 2025
Merged

[conf](pool) incrase fragment_mgr_async_work_pool_thread_num_max#54437
Gabriel39 merged 1 commit intoapache:masterfrom
Gabriel39:conf_1

Conversation

@Gabriel39
Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Copy Markdown
Contributor

Thearas commented Aug 7, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Gabriel39
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 33972 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fce794a1dee2f152218a8594ee157f41780cf1e2, data reload: false

------ Round 1 ----------------------------------
q1	17598	5315	5325	5315
q2	1954	296	183	183
q3	10288	1439	690	690
q4	10223	1006	515	515
q5	7548	2318	2307	2307
q6	178	166	133	133
q7	870	755	602	602
q8	9292	1284	1085	1085
q9	6838	5107	5092	5092
q10	6915	2373	1957	1957
q11	447	271	251	251
q12	354	367	221	221
q13	17775	3462	2994	2994
q14	251	260	225	225
q15	543	470	466	466
q16	435	410	369	369
q17	572	824	355	355
q18	7322	7120	7082	7082
q19	2479	977	574	574
q20	323	315	223	223
q21	3353	3092	2342	2342
q22	1031	1038	991	991
Total cold run time: 106589 ms
Total hot run time: 33972 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5454	5291	5289	5289
q2	235	325	212	212
q3	2088	2529	2199	2199
q4	1308	1708	1339	1339
q5	4125	4521	4452	4452
q6	224	178	133	133
q7	1964	1972	1757	1757
q8	2562	2413	2478	2413
q9	7503	7377	7274	7274
q10	3304	3445	2845	2845
q11	541	491	490	490
q12	710	814	684	684
q13	3413	3765	3191	3191
q14	315	343	313	313
q15	522	466	465	465
q16	467	489	471	471
q17	1337	1583	1379	1379
q18	7965	7805	7722	7722
q19	5410	889	946	889
q20	3687	2020	1869	1869
q21	13951	4418	4370	4370
q22	1119	998	987	987
Total cold run time: 68204 ms
Total hot run time: 50743 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 170672 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fce794a1dee2f152218a8594ee157f41780cf1e2, data reload: false

============================================
query1	1003	388	445	388
query2	6519	1755	1700	1700
query3	6745	228	220	220
query4	27228	23758	23491	23491
query5	4342	652	533	533
query6	328	276	241	241
query7	4640	525	302	302
query8	281	234	220	220
query9	8596	2989	3006	2989
query10	477	369	306	306
query11	15784	15032	14704	14704
query12	186	134	135	134
query13	1653	543	427	427
query14	8636	5779	5794	5779
query15	215	181	166	166
query16	7109	616	427	427
query17	960	771	674	674
query18	2027	446	334	334
query19	233	229	188	188
query20	150	145	134	134
query21	215	126	111	111
query22	4098	4064	3861	3861
query23	34479	34150	34529	34150
query24	8191	2382	2419	2382
query25	616	563	466	466
query26	1254	301	170	170
query27	2709	525	353	353
query28	4416	2337	2320	2320
query29	821	636	524	524
query30	323	248	198	198
query31	912	879	713	713
query32	96	76	78	76
query33	591	439	386	386
query34	819	876	509	509
query35	821	834	755	755
query36	1013	1028	958	958
query37	138	116	93	93
query38	3920	3915	3893	3893
query39	1499	1373	1360	1360
query40	251	144	128	128
query41	60	60	64	60
query42	145	127	126	126
query43	526	528	494	494
query44	1456	887	869	869
query45	196	203	186	186
query46	955	1085	667	667
query47	1811	1857	1771	1771
query48	410	436	329	329
query49	762	508	444	444
query50	682	739	436	436
query51	4166	4148	4171	4148
query52	127	140	117	117
query53	261	298	225	225
query54	660	656	579	579
query55	96	92	91	91
query56	386	360	355	355
query57	1209	1225	1133	1133
query58	338	364	337	337
query59	2556	2644	2556	2556
query60	410	411	393	393
query61	123	123	123	123
query62	826	743	659	659
query63	255	213	217	213
query64	4361	1084	747	747
query65	4308	4180	4137	4137
query66	1199	433	317	317
query67	query68	18449	868	1125	868
query69	1014	270	284	270
query70	1419	1137	1028	1028
query71	673	321	330	321
query72	9078	2319	2334	2319
query73	4085	642	363	363
query74	9019	9032	8776	8776
query75	7167	3155	2704	2704
query76	8458	1228	786	786
query77	1183	406	335	335
query78	9620	10952	9475	9475
query79	15378	635	588	588
query80	2067	561	505	505
query81	553	254	315	254
query82	448	151	119	119
query83	381	298	275	275
query84	302	100	78	78
query85	1225	430	337	337
query86	362	347	299	299
query87	4220	4103	4057	4057
query88	5562	2235	2244	2235
query89	498	370	318	318
query90	2532	236	231	231
query91	146	140	110	110
query92	90	72	68	68
query93	6358	1000	657	657
query94	1174	415	280	280
query95	424	334	330	330
query96	506	593	281	281
query97	2705	2762	2583	2583
query98	259	237	223	223
query99	1499	1431	1324	1324
Total cold run time: 309432 ms
Total hot run time: 170672 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 33.39 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fce794a1dee2f152218a8594ee157f41780cf1e2, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.05	0.04
query3	0.24	0.07	0.07
query4	1.61	0.10	0.11
query5	0.44	0.42	0.44
query6	1.16	0.69	0.68
query7	0.03	0.01	0.02
query8	0.04	0.03	0.04
query9	0.58	0.48	0.47
query10	0.53	0.53	0.52
query11	0.16	0.11	0.11
query12	0.14	0.10	0.10
query13	0.64	0.66	0.64
query14	0.96	1.08	1.12
query15	0.92	0.86	0.88
query16	0.37	0.41	0.38
query17	1.06	1.06	1.08
query18	0.21	0.19	0.20
query19	1.95	1.79	1.86
query20	0.01	0.01	0.02
query21	15.38	0.92	0.54
query22	0.78	1.38	0.73
query23	14.71	1.20	0.65
query24	6.51	1.28	1.54
query25	0.50	0.20	0.06
query26	0.47	0.15	0.13
query27	0.06	0.05	0.06
query28	10.10	0.82	0.44
query29	12.65	3.85	3.32
query30	3.03	2.98	2.94
query31	2.82	0.57	0.39
query32	3.24	0.56	0.50
query33	3.00	3.23	3.08
query34	15.91	5.29	4.90
query35	4.82	5.04	4.94
query36	0.69	0.52	0.50
query37	0.09	0.07	0.07
query38	0.06	0.05	0.04
query39	0.04	0.02	0.03
query40	0.17	0.14	0.15
query41	0.09	0.04	0.03
query42	0.03	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 106.36 s
Total hot run time: 33.39 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 7, 2025
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Aug 7, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Aug 7, 2025

PR approved by anyone and no changes requested.

@doris-robot
Copy link
Copy Markdown

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 58.31% (16385/28098)
Line Coverage 47.20% (148121/313789)
Region Coverage 36.16% (110822/306470)
Branch Coverage 39.09% (49263/126040)

@hello-stephen
Copy link
Copy Markdown
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 81.26% (22421/27591)
Line Coverage 73.87% (232048/314135)
Region Coverage 61.02% (192289/315121)
Branch Coverage 65.17% (83247/127739)

@Gabriel39 Gabriel39 merged commit 3256f17 into apache:master Aug 8, 2025
25 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants