Skip to content

branch-3.0: [opt](paimon)Remove unnecessary fields #44906#45097

Merged
morningman merged 1 commit intobranch-3.0from
auto-pick-44906-branch-3.0
Dec 6, 2024
Merged

branch-3.0: [opt](paimon)Remove unnecessary fields #44906#45097
morningman merged 1 commit intobranch-3.0from
auto-pick-44906-branch-3.0

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Dec 6, 2024

Cherry-picked from #44906

### What problem does this PR solve?

Related PR: #44274

Problem Summary:

We have already set the serialization table in `TFileScanRangeParams`,
so there is no need to repeat it for each split.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Dec 6, 2024
@dataroaring dataroaring reopened this Dec 6, 2024
@doris-robot
Copy link

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40643 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8c4c20378ed9d7e50282ab69fb9a5d3369524415, data reload: false

------ Round 1 ----------------------------------
q1	17606	7432	7323	7323
q2	2059	164	151	151
q3	10583	1109	1150	1109
q4	10211	692	745	692
q5	7744	2888	2808	2808
q6	235	144	143	143
q7	961	613	591	591
q8	9344	1958	2016	1958
q9	7495	6425	6433	6425
q10	7050	2259	2337	2259
q11	466	259	251	251
q12	555	217	213	213
q13	17770	2965	2936	2936
q14	241	213	205	205
q15	562	516	517	516
q16	682	604	615	604
q17	985	534	567	534
q18	7364	6657	6649	6649
q19	1382	1061	1037	1037
q20	462	201	196	196
q21	4046	3211	3071	3071
q22	1082	992	972	972
Total cold run time: 108885 ms
Total hot run time: 40643 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7271	7242	7214	7214
q2	329	232	226	226
q3	2895	2707	2736	2707
q4	1894	1666	1642	1642
q5	5431	5417	5423	5417
q6	214	135	136	135
q7	2034	1690	1685	1685
q8	3174	3375	3389	3375
q9	8522	8496	8493	8493
q10	3488	3392	3391	3391
q11	583	484	490	484
q12	803	589	561	561
q13	16876	2998	2987	2987
q14	287	256	252	252
q15	560	514	513	513
q16	701	642	655	642
q17	1823	1679	1557	1557
q18	7816	7478	7234	7234
q19	1640	1550	1590	1550
q20	2015	1819	1769	1769
q21	5129	4965	5115	4965
q22	1087	981	980	980
Total cold run time: 74572 ms
Total hot run time: 57779 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190284 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8c4c20378ed9d7e50282ab69fb9a5d3369524415, data reload: false

query1	966	375	371	371
query2	6525	2112	1989	1989
query3	6698	224	221	221
query4	33924	23394	23366	23366
query5	4322	430	426	426
query6	256	172	173	172
query7	4616	303	305	303
query8	279	225	219	219
query9	9537	2684	2678	2678
query10	472	256	257	256
query11	18115	15306	15373	15306
query12	155	101	104	101
query13	1645	424	397	397
query14	10560	6779	6831	6779
query15	229	169	172	169
query16	8056	472	462	462
query17	1625	562	548	548
query18	2092	311	308	308
query19	220	160	154	154
query20	118	112	113	112
query21	204	103	103	103
query22	4452	4303	4180	4180
query23	34604	33870	33496	33496
query24	11824	2872	2866	2866
query25	681	404	413	404
query26	1801	171	173	171
query27	2904	299	301	299
query28	8008	2449	2450	2449
query29	1040	447	433	433
query30	322	177	165	165
query31	1016	782	815	782
query32	95	58	59	58
query33	802	270	274	270
query34	1046	478	493	478
query35	861	718	738	718
query36	1124	921	965	921
query37	268	79	72	72
query38	3993	3987	3887	3887
query39	1475	1416	1449	1416
query40	288	106	104	104
query41	49	50	50	50
query42	111	99	100	99
query43	537	496	505	496
query44	1186	782	782	782
query45	183	167	170	167
query46	1162	719	718	718
query47	1906	1833	1803	1803
query48	459	368	371	368
query49	1236	397	381	381
query50	816	403	405	403
query51	7230	7143	7015	7015
query52	109	91	96	91
query53	271	187	189	187
query54	1308	466	460	460
query55	79	80	76	76
query56	269	247	237	237
query57	1216	1133	1125	1125
query58	227	214	207	207
query59	3197	3099	3044	3044
query60	271	252	243	243
query61	110	111	109	109
query62	845	675	686	675
query63	220	190	180	180
query64	5109	652	617	617
query65	3236	3139	3164	3139
query66	1349	313	296	296
query67	16371	15542	15582	15542
query68	5359	556	532	532
query69	430	253	250	250
query70	1186	1109	1082	1082
query71	407	244	234	234
query72	6474	3890	3951	3890
query73	761	349	345	345
query74	10301	8935	8833	8833
query75	3453	2582	2629	2582
query76	3280	1150	1115	1115
query77	396	267	272	267
query78	10547	9608	9608	9608
query79	8417	587	590	587
query80	1870	423	410	410
query81	563	236	234	234
query82	1462	118	117	117
query83	259	145	139	139
query84	291	74	82	74
query85	2358	306	285	285
query86	495	302	302	302
query87	4546	4234	4279	4234
query88	5525	2366	2380	2366
query89	442	292	288	288
query90	2205	187	187	187
query91	178	145	142	142
query92	69	50	49	49
query93	6313	552	532	532
query94	1022	283	291	283
query95	337	257	253	253
query96	629	279	281	279
query97	3350	3190	3183	3183
query98	228	193	196	193
query99	1794	1290	1292	1290
Total cold run time: 321227 ms
Total hot run time: 190284 ms

@morningman morningman merged commit b50b745 into branch-3.0 Dec 6, 2024
@github-actions github-actions bot deleted the auto-pick-44906-branch-3.0 branch December 6, 2024 07:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants