Skip to content

Conversation

@hello-stephen
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Aug 4, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@hello-stephen hello-stephen changed the title 32 NoMergeLatest perf debug Aug 4, 2025
@hello-stephen
Copy link
Contributor Author

run performance

@hello-stephen hello-stephen changed the title NoMergeLatest perf debug NoMergeLatest perf debug 24 first Aug 4, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 34051 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 73d3b7e63af371803f50af57729f9c6129ff67a9, data reload: false

------ Round 1 ----------------------------------
q1	17584	5303	5215	5215
q2	1935	307	188	188
q3	10291	1466	736	736
q4	10219	969	517	517
q5	7544	2362	2306	2306
q6	179	169	132	132
q7	892	750	624	624
q8	9298	1300	1053	1053
q9	6837	5146	5083	5083
q10	6954	2363	1968	1968
q11	479	290	266	266
q12	348	369	239	239
q13	17786	3560	3063	3063
q14	237	231	213	213
q15	542	472	472	472
q16	436	438	371	371
q17	588	812	377	377
q18	8910	7196	7390	7196
q19	2276	974	539	539
q20	572	319	218	218
q21	6411	3027	2286	2286
q22	1018	1060	989	989
Total cold run time: 111336 ms
Total hot run time: 34051 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5607	5548	5413	5413
q2	602	315	216	216
q3	2085	2587	2220	2220
q4	1317	1777	1561	1561
q5	4556	4464	4434	4434
q6	229	177	131	131
q7	1934	1953	1813	1813
q8	2565	2587	2588	2587
q9	7245	7425	7515	7425
q10	3200	3279	2850	2850
q11	562	511	507	507
q12	711	772	653	653
q13	3497	3865	3311	3311
q14	304	307	291	291
q15	504	467	471	467
q16	448	521	491	491
q17	1191	1418	1352	1352
q18	7855	7749	7920	7749
q19	4184	908	1050	908
q20	3710	2060	1956	1956
q21	6207	4643	4405	4405
q22	1113	1020	967	967
Total cold run time: 59626 ms
Total hot run time: 51707 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170963 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 73d3b7e63af371803f50af57729f9c6129ff67a9, data reload: false

============================================
query1	1027	383	417	383
query2	6512	1848	1711	1711
query3	6744	221	223	221
query4	27254	23466	23245	23245
query5	4297	608	533	533
query6	319	239	232	232
query7	4637	526	310	310
query8	285	247	236	236
query9	8601	3079	3043	3043
query10	455	361	301	301
query11	15399	15026	14764	14764
query12	186	136	134	134
query13	1668	573	442	442
query14	8508	5808	5765	5765
query15	213	198	166	166
query16	7134	654	502	502
query17	1224	788	662	662
query18	2189	445	334	334
query19	263	222	198	198
query20	150	152	141	141
query21	225	128	108	108
query22	4039	3964	3841	3841
query23	34482	34227	33980	33980
query24	8055	2410	2436	2410
query25	605	537	450	450
query26	1232	304	166	166
query27	2644	536	359	359
query28	4339	2383	2379	2379
query29	788	609	497	497
query30	308	227	201	201
query31	892	822	714	714
query32	92	78	77	77
query33	553	431	369	369
query34	819	849	534	534
query35	793	848	760	760
query36	1025	1043	934	934
query37	140	107	90	90
query38	4087	4069	3894	3894
query39	1591	1381	1345	1345
query40	241	147	135	135
query41	69	59	60	59
query42	140	125	127	125
query43	534	529	505	505
query44	1409	908	897	897
query45	197	184	189	184
query46	957	1071	694	694
query47	1822	1854	1766	1766
query48	410	455	326	326
query49	722	517	449	449
query50	673	689	446	446
query51	4136	4162	4117	4117
query52	127	135	129	129
query53	273	288	214	214
query54	675	664	576	576
query55	93	92	91	91
query56	391	381	374	374
query57	1186	1249	1123	1123
query58	348	339	332	332
query59	2639	2735	2551	2551
query60	416	428	389	389
query61	123	130	127	127
query62	796	760	678	678
query63	259	213	216	213
query64	4338	1090	768	768
query65	4220	4128	4088	4088
query66	1080	451	345	345
query67	query68	17786	890	976	890
query69	1015	289	289	289
query70	1465	1073	1146	1073
query71	673	332	329	329
query72	9164	2260	2239	2239
query73	4038	692	367	367
query74	8986	9097	8556	8556
query75	7246	3169	2686	2686
query76	8505	1216	799	799
query77	1164	424	338	338
query78	9702	10951	9658	9658
query79	15463	604	628	604
query80	2606	605	518	518
query81	630	278	234	234
query82	461	151	123	123
query83	418	289	275	275
query84	301	99	91	91
query85	1141	387	338	338
query86	389	351	324	324
query87	4288	4249	4166	4166
query88	5586	2411	2426	2411
query89	513	383	332	332
query90	2522	238	237	237
query91	151	140	117	117
query92	93	75	71	71
query93	6407	1033	670	670
query94	1137	418	289	289
query95	433	352	348	348
query96	544	633	302	302
query97	2712	2722	2650	2650
query98	263	247	231	231
query99	1478	1419	1276	1276
Total cold run time: 309328 ms
Total hot run time: 170963 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.26 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 73d3b7e63af371803f50af57729f9c6129ff67a9, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.07	0.07
query4	1.61	0.11	0.12
query5	0.41	0.42	0.42
query6	1.16	0.67	0.67
query7	0.03	0.02	0.02
query8	0.04	0.04	0.04
query9	0.56	0.48	0.47
query10	0.53	0.52	0.54
query11	0.16	0.11	0.10
query12	0.15	0.12	0.12
query13	0.68	0.65	0.64
query14	0.91	1.10	1.15
query15	0.93	0.90	0.90
query16	0.38	0.39	0.38
query17	1.05	1.06	1.09
query18	0.24	0.21	0.21
query19	2.00	1.89	1.87
query20	0.02	0.01	0.02
query21	15.38	0.87	0.55
query22	0.79	1.18	0.73
query23	14.86	1.21	0.64
query24	6.74	0.57	0.83
query25	0.50	0.12	0.14
query26	0.57	0.17	0.14
query27	0.06	0.06	0.05
query28	9.84	0.90	0.44
query29	12.58	3.81	3.30
query30	3.06	3.01	3.04
query31	2.81	0.58	0.40
query32	3.24	0.56	0.49
query33	3.05	3.37	3.30
query34	16.12	5.31	4.93
query35	4.91	4.98	4.95
query36	0.68	0.52	0.51
query37	0.10	0.07	0.08
query38	0.05	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.04	0.02
query42	0.03	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 106.92 s
Total hot run time: 33.26 s

@hello-stephen hello-stephen changed the title NoMergeLatest perf debug 24 first NoMergeLatest Aug 4, 2025
@hello-stephen
Copy link
Contributor Author

run performance

@hello-stephen
Copy link
Contributor Author

run performance

@hello-stephen
Copy link
Contributor Author

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 33087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 17edd0267ff696a2ab1d2040ad3b6f5d9105cf15, data reload: false

------ Round 1 ----------------------------------
q1	17577	5200	5109	5109
q2	1952	270	190	190
q3	10304	1234	673	673
q4	10235	991	508	508
q5	7536	2321	2314	2314
q6	179	158	127	127
q7	882	740	592	592
q8	9309	1244	1089	1089
q9	7114	5164	5118	5118
q10	6895	2378	1955	1955
q11	498	279	278	278
q12	338	340	208	208
q13	17765	3689	3096	3096
q14	231	229	228	228
q15	565	483	481	481
q16	422	422	368	368
q17	574	867	345	345
q18	7442	7184	7069	7069
q19	1316	928	551	551
q20	339	339	215	215
q21	3652	2523	2282	2282
q22	360	310	291	291
Total cold run time: 105485 ms
Total hot run time: 33087 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5216	5103	5118	5103
q2	231	327	221	221
q3	2154	2629	2310	2310
q4	1353	1774	1368	1368
q5	4159	4104	4098	4098
q6	206	161	122	122
q7	1845	1790	1657	1657
q8	2457	2503	2440	2440
q9	6686	6790	6825	6790
q10	2949	3136	2739	2739
q11	559	500	469	469
q12	613	708	567	567
q13	3290	3717	3067	3067
q14	272	285	260	260
q15	509	465	463	463
q16	430	467	421	421
q17	1076	1488	1314	1314
q18	7312	7163	7094	7094
q19	735	782	1033	782
q20	1893	1959	1851	1851
q21	4710	4356	4289	4289
q22	655	584	561	561
Total cold run time: 49310 ms
Total hot run time: 47986 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188269 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 17edd0267ff696a2ab1d2040ad3b6f5d9105cf15, data reload: false

query1	987	379	407	379
query2	6523	1678	1665	1665
query3	6753	205	212	205
query4	26154	23167	23519	23167
query5	4989	588	450	450
query6	312	214	193	193
query7	4630	506	297	297
query8	289	225	208	208
query9	8658	2636	2643	2636
query10	513	373	278	278
query11	15832	15177	14887	14887
query12	174	106	104	104
query13	1666	533	401	401
query14	10738	6124	6086	6086
query15	235	200	177	177
query16	7735	461	259	259
query17	1642	754	598	598
query18	2026	419	313	313
query19	232	201	188	188
query20	131	122	119	119
query21	223	131	110	110
query22	4521	4323	4194	4194
query23	34308	33453	33228	33228
query24	8176	2386	2390	2386
query25	503	481	386	386
query26	1208	279	145	145
query27	2698	517	339	339
query28	4266	2146	2118	2118
query29	719	602	423	423
query30	296	230	187	187
query31	928	839	748	748
query32	75	66	63	63
query33	542	330	290	290
query34	801	930	503	503
query35	619	658	547	547
query36	967	1044	933	933
query37	119	103	78	78
query38	4225	4237	4095	4095
query39	1516	1435	1439	1435
query40	208	117	105	105
query41	57	58	51	51
query42	120	109	113	109
query43	501	525	506	506
query44	1368	819	817	817
query45	173	172	171	171
query46	884	1093	629	629
query47	1750	1872	1813	1813
query48	383	429	307	307
query49	745	470	401	401
query50	659	753	419	419
query51	5557	5521	5516	5516
query52	109	104	101	101
query53	225	258	189	189
query54	572	559	498	498
query55	82	78	79	78
query56	302	299	270	270
query57	1204	1240	1142	1142
query58	266	243	261	243
query59	2679	2689	2575	2575
query60	338	312	298	298
query61	131	153	116	116
query62	792	708	645	645
query63	225	190	186	186
query64	4295	1208	797	797
query65	4272	4180	4179	4179
query66	1065	425	317	317
query67	16000	15828	15578	15578
query68	8213	911	529	529
query69	507	331	260	260
query70	1255	1182	1135	1135
query71	481	334	291	291
query72	5647	4721	4890	4721
query73	710	634	350	350
query74	9072	8875	8868	8868
query75	3933	3201	2734	2734
query76	3735	1247	732	732
query77	798	383	285	285
query78	10938	11193	10364	10364
query79	2664	835	577	577
query80	621	513	433	433
query81	516	264	222	222
query82	315	133	98	98
query83	258	253	236	236
query84	242	103	85	85
query85	806	373	305	305
query86	390	320	307	307
query87	4573	4504	4302	4302
query88	3813	2325	2306	2306
query89	407	323	291	291
query90	1933	213	205	205
query91	144	141	116	116
query92	83	63	57	57
query93	2176	1021	599	599
query94	624	333	199	199
query95	366	288	281	281
query96	500	621	289	289
query97	2724	2739	2690	2690
query98	240	212	207	207
query99	1333	1420	1321	1321
Total cold run time: 281908 ms
Total hot run time: 188269 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 17edd0267ff696a2ab1d2040ad3b6f5d9105cf15, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.05
query3	0.24	0.08	0.07
query4	1.61	0.11	0.10
query5	0.45	0.43	0.42
query6	1.16	0.65	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.61	0.50	0.51
query10	0.58	0.56	0.59
query11	0.15	0.10	0.10
query12	0.14	0.12	0.12
query13	0.63	0.61	0.61
query14	0.80	0.83	0.79
query15	0.90	0.86	0.87
query16	0.38	0.39	0.38
query17	1.08	1.07	1.09
query18	0.23	0.21	0.20
query19	1.96	1.81	1.82
query20	0.01	0.01	0.01
query21	15.40	0.89	0.55
query22	0.76	1.32	0.78
query23	14.66	1.40	0.60
query24	7.15	1.92	0.59
query25	0.46	0.27	0.08
query26	0.60	0.17	0.13
query27	0.06	0.05	0.05
query28	9.91	0.85	0.44
query29	12.53	4.00	3.29
query30	3.06	2.96	2.96
query31	2.82	0.58	0.39
query32	3.24	0.55	0.47
query33	3.15	3.18	3.08
query34	16.05	5.41	4.83
query35	4.84	4.87	4.85
query36	0.68	0.52	0.50
query37	0.08	0.07	0.06
query38	0.06	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.15	0.13
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.05	0.04	0.03
Total cold run time: 107.01 s
Total hot run time: 32.29 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants