Skip to content

[fix] (cloud) Fix local/remote tablet size semantics in schema views#60887

Open
deardeng wants to merge 2 commits intoapache:masterfrom
deardeng:fix-cloud-tablet-size-semantics
Open

[fix] (cloud) Fix local/remote tablet size semantics in schema views#60887
deardeng wants to merge 2 commits intoapache:masterfrom
deardeng:fix-cloud-tablet-size-semantics

Conversation

@deardeng
Copy link
Contributor

@deardeng deardeng commented Feb 27, 2026 •
edited
Loading

In storage-compute separation, data size should be represented consistently as remote size.

Previously, show tablets and information_schema.partitions could diverge from information_schema.backend_tablets, which made local/remote semantics confusing for users and operators.

This change aligns cloud-mode output mapping for local/remote size columns and adds a regression test to guard the behavior.

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Feb 27, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@deardeng deardeng force-pushed the fix-cloud-tablet-size-semantics branch from 46b258e to 9f29fed Compare February 27, 2026 09:56
@deardeng deardeng changed the title [cloud] Fix local/remote tablet size semantics in schema views [fix] (cloud) Fix local/remote tablet size semantics in schema views Feb 27, 2026
@deardeng
[fix](cloud) Fix local/remote tablet size semantics in schema views
abc754d 
In storage-compute separation, data size should be represented consistently as remote size.

Previously, show tablets and information_schema.partitions could diverge from information_schema.backend_tablets, which made local/remote semantics confusing for users and operators.

This change aligns cloud-mode output mapping for local/remote size columns and adds a regression test to guard the behavior.
@deardeng deardeng force-pushed the fix-cloud-tablet-size-semantics branch from 9f29fed to abc754d Compare February 27, 2026 10:02
@deardeng
Copy link
Contributor Author

deardeng commented Feb 27, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Feb 27, 2026

TPC-H: Total hot run time: 28683 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit abc754d5a4468ff05ee5de16a61a91b955186610, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17616	4541	4304	4304
q2	q3	10646	789	525	525
q4	4693	362	245	245
q5	7540	1189	1021	1021
q6	176	176	148	148
q7	781	853	661	661
q8	9296	1434	1336	1336
q9	4822	4698	4698	4698
q10	6745	1879	1626	1626
q11	458	263	250	250
q12	680	573	467	467
q13	17747	4202	3392	3392
q14	228	222	209	209
q15	941	796	784	784
q16	716	717	663	663
q17	687	862	447	447
q18	5892	5301	5318	5301
q19	1113	984	601	601
q20	497	501	382	382
q21	4361	1860	1381	1381
q22	334	278	242	242
Total cold run time: 95969 ms
Total hot run time: 28683 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4405	4344	4353	4344
q2	q3	1740	2177	1707	1707
q4	841	1177	767	767
q5	4002	4277	4318	4277
q6	176	176	144	144
q7	1739	1588	1487	1487
q8	2416	2625	2493	2493
q9	7081	7844	7458	7458
q10	2631	2807	2404	2404
q11	525	447	425	425
q12	493	577	444	444
q13	3888	4379	3623	3623
q14	287	290	265	265
q15	913	913	816	816
q16	709	767	697	697
q17	1192	1590	1332	1332
q18	7008	6947	6623	6623
q19	875	818	852	818
q20	2082	2322	1997	1997
q21	3916	3492	3378	3378
q22	455	457	383	383
Total cold run time: 47374 ms
Total hot run time: 45882 ms

@doris-robot
Copy link

doris-robot commented Feb 27, 2026

TPC-DS: Total hot run time: 184308 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit abc754d5a4468ff05ee5de16a61a91b955186610, data reload: false

query5	4979	623	526	526
query6	331	218	202	202
query7	4209	467	266	266
query8	342	237	232	232
query9	8730	2753	2741	2741
query10	531	387	327	327
query11	16796	17689	17068	17068
query12	196	133	126	126
query13	1307	471	352	352
query14	7045	3467	3095	3095
query14_1	2934	2872	3262	2872
query15	207	206	185	185
query16	988	485	499	485
query17	1259	785	702	702
query18	3080	476	366	366
query19	237	236	193	193
query20	150	156	139	139
query21	213	155	115	115
query22	5796	5628	5514	5514
query23	17698	17322	16792	16792
query23_1	17086	16652	16652	16652
query24	7169	1601	1216	1216
query24_1	1213	1211	1224	1211
query25	534	503	403	403
query26	1239	254	142	142
query27	2739	463	282	282
query28	4466	1849	1831	1831
query29	821	551	477	477
query30	309	247	208	208
query31	882	722	631	631
query32	78	72	69	69
query33	508	323	276	276
query34	927	907	566	566
query35	636	688	589	589
query36	1074	1141	993	993
query37	132	90	80	80
query38	2928	2905	2875	2875
query39	888	882	830	830
query39_1	809	822	839	822
query40	220	151	132	132
query41	62	61	58	58
query42	107	101	100	100
query43	375	379	346	346
query44	
query45	198	187	179	179
query46	877	958	602	602
query47	2112	2133	2060	2060
query48	304	311	225	225
query49	621	465	386	386
query50	683	294	208	208
query51	4135	4116	4099	4099
query52	112	110	96	96
query53	282	344	293	293
query54	289	276	270	270
query55	91	89	82	82
query56	313	311	299	299
query57	1374	1345	1284	1284
query58	291	283	275	275
query59	2542	2695	2554	2554
query60	347	337	333	333
query61	152	153	143	143
query62	607	584	539	539
query63	305	280	279	279
query64	4805	1256	968	968
query65	
query66	1388	453	359	359
query67	16342	16404	16366	16366
query68	
query69	400	318	293	293
query70	1002	960	935	935
query71	348	299	287	287
query72	2803	2702	2399	2399
query73	543	543	325	325
query74	9944	9953	9736	9736
query75	2872	2714	2462	2462
query76	2321	1036	674	674
query77	364	359	315	315
query78	11230	11594	10704	10704
query79	2312	794	614	614
query80	1704	605	542	542
query81	564	277	249	249
query82	965	152	114	114
query83	361	262	241	241
query84	251	115	103	103
query85	931	510	434	434
query86	410	316	296	296
query87	3162	3077	2991	2991
query88	3547	2701	2675	2675
query89	425	365	336	336
query90	1988	173	168	168
query91	165	156	129	129
query92	78	74	70	70
query93	1144	800	507	507
query94	646	313	285	285
query95	591	407	320	320
query96	636	509	229	229
query97	2471	2495	2432	2432
query98	236	225	218	218
query99	993	992	912	912
Total cold run time: 257139 ms
Total hot run time: 184308 ms

@hello-stephen
Copy link
Contributor

hello-stephen commented Feb 27, 2026

FE UT Coverage Report

Increment line coverage 28.57% (4/14) 🎉
Increment coverage report
Complete coverage report

@deardeng
fix
9a66966 
(cherry picked from commit ac8fbf8495162aa6f0c00d64d5acc5e4babfef06)
@deardeng
Copy link
Contributor Author

deardeng commented Feb 28, 2026

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Feb 28, 2026

FE UT Coverage Report

Increment line coverage 20.00% (4/20) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Feb 28, 2026

TPC-H: Total hot run time: 28722 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9a66966c0fe82c1a674a9f2a00235abb8b3e0f3c, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17636	4444	4286	4286
q2	q3	10644	793	509	509
q4	4678	361	253	253
q5	7561	1215	1006	1006
q6	179	177	152	152
q7	789	835	673	673
q8	10155	1450	1339	1339
q9	5386	4726	4785	4726
q10	6855	1887	1615	1615
q11	448	261	238	238
q12	752	575	477	477
q13	17780	4240	3418	3418
q14	226	223	210	210
q15	1001	810	792	792
q16	754	712	666	666
q17	701	874	423	423
q18	6008	5446	5279	5279
q19	1515	984	620	620
q20	524	510	393	393
q21	4534	1834	1400	1400
q22	338	290	247	247
Total cold run time: 98464 ms
Total hot run time: 28722 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4480	4327	4305	4305
q2	q3	1768	2171	1722	1722
q4	850	1155	744	744
q5	4026	4316	4299	4299
q6	176	170	139	139
q7	1741	1594	1502	1502
q8	2420	2647	2512	2512
q9	7540	7444	7461	7444
q10	2657	2805	2411	2411
q11	514	441	416	416
q12	486	600	443	443
q13	4016	4460	3666	3666
q14	288	300	273	273
q15	892	847	840	840
q16	719	761	702	702
q17	1215	1637	1343	1343
q18	7244	6776	6711	6711
q19	902	834	896	834
q20	2083	2192	2058	2058
q21	3999	3572	3312	3312
q22	433	431	381	381
Total cold run time: 48449 ms
Total hot run time: 46057 ms

@doris-robot
Copy link

doris-robot commented Feb 28, 2026

TPC-DS: Total hot run time: 184069 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9a66966c0fe82c1a674a9f2a00235abb8b3e0f3c, data reload: false

query5	4929	624	521	521
query6	333	221	202	202
query7	4210	462	266	266
query8	323	245	242	242
query9	8710	2765	2736	2736
query10	543	376	353	353
query11	17031	17598	17212	17212
query12	239	142	141	141
query13	1741	472	358	358
query14	7463	3259	3384	3259
query14_1	2903	2944	2947	2944
query15	209	195	173	173
query16	1069	477	460	460
query17	1175	754	628	628
query18	2854	457	365	365
query19	274	218	186	186
query20	143	133	134	133
query21	215	153	124	124
query22	5565	5484	4694	4694
query23	17293	16869	16734	16734
query23_1	16750	16662	16832	16662
query24	6927	1613	1231	1231
query24_1	1238	1236	1232	1232
query25	553	475	426	426
query26	1236	262	156	156
query27	2754	466	285	285
query28	4485	1873	1904	1873
query29	823	577	493	493
query30	318	248	213	213
query31	899	738	649	649
query32	84	71	75	71
query33	526	359	281	281
query34	908	914	556	556
query35	647	678	595	595
query36	1085	1092	966	966
query37	136	95	85	85
query38	2964	2876	2910	2876
query39	889	869	843	843
query39_1	843	838	813	813
query40	236	156	138	138
query41	71	64	62	62
query42	113	103	102	102
query43	372	376	353	353
query44	
query45	200	194	190	190
query46	875	977	600	600
query47	2116	2153	2057	2057
query48	321	317	261	261
query49	644	480	402	402
query50	678	278	217	217
query51	4080	4138	4061	4061
query52	103	106	98	98
query53	293	347	294	294
query54	313	284	311	284
query55	87	83	83	83
query56	304	292	311	292
query57	1358	1350	1277	1277
query58	289	283	267	267
query59	2517	2681	2624	2624
query60	338	343	322	322
query61	150	139	146	139
query62	634	593	541	541
query63	315	271	278	271
query64	4828	1282	1003	1003
query65	
query66	1394	446	354	354
query67	16416	16423	16333	16333
query68	
query69	419	314	287	287
query70	1014	988	951	951
query71	383	306	323	306
query72	2786	2659	2442	2442
query73	537	537	325	325
query74	10000	9950	9755	9755
query75	2883	2725	2466	2466
query76	2308	1018	675	675
query77	360	373	313	313
query78	11249	11369	10673	10673
query79	2622	792	599	599
query80	1759	619	568	568
query81	554	276	243	243
query82	1001	149	116	116
query83	343	264	242	242
query84	252	112	104	104
query85	894	479	436	436
query86	412	317	294	294
query87	3143	3102	3006	3006
query88	3547	2663	2643	2643
query89	420	365	342	342
query90	2011	177	173	173
query91	168	155	140	140
query92	73	73	73	73
query93	1139	819	487	487
query94	638	320	295	295
query95	593	339	317	317
query96	630	515	226	226
query97	2462	2488	2459	2459
query98	229	222	211	211
query99	1028	996	817	817
Total cold run time: 257985 ms
Total hot run time: 184069 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@deardeng @Thearas @doris-robot @hello-stephen