Skip to content

[feat](Variant) support variant sparse feature and schema template with multi indexes (part 1) #53062

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

eldenmoon
Copy link
Member

add protobuf and thrift

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

…th multi indexes (part 1)

add protobuf and thrift
@Thearas
Copy link
Contributor

Thearas commented Jul 10, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@eldenmoon
Copy link
Member Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.60% (1255/1557)
Line Coverage 67.78% (21415/31596)
Region Coverage 67.26% (10610/15774)
Branch Coverage 56.74% (5566/9810)

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

TPC-H: Total hot run time: 33317 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 25c7d3968ebd835a80b942681ab3ec3de74e95c6, data reload: false

------ Round 1 ----------------------------------
q1	17565	5211	4992	4992
q2	1920	281	186	186
q3	10419	1279	744	744
q4	10265	1008	516	516
q5	8140	2510	2330	2330
q6	183	157	129	129
q7	913	750	601	601
q8	9323	1248	1086	1086
q9	6991	5077	5106	5077
q10	6892	2377	1989	1989
q11	480	293	289	289
q12	349	350	214	214
q13	17757	3679	3118	3118
q14	240	224	210	210
q15	559	479	477	477
q16	426	428	384	384
q17	595	879	376	376
q18	7490	7119	7191	7119
q19	1214	937	548	548
q20	340	352	221	221
q21	3814	3174	2417	2417
q22	373	332	294	294
Total cold run time: 106248 ms
Total hot run time: 33317 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5087	5054	5055	5054
q2	237	323	227	227
q3	2172	2694	2283	2283
q4	1343	1801	1325	1325
q5	4275	4319	4546	4319
q6	221	172	127	127
q7	2110	1980	1816	1816
q8	2642	2528	2561	2528
q9	7268	7236	7342	7236
q10	3157	3280	2854	2854
q11	597	546	530	530
q12	688	775	604	604
q13	3560	3967	3441	3441
q14	280	303	265	265
q15	534	477	481	477
q16	455	488	446	446
q17	1228	1609	1410	1410
q18	8290	7582	7781	7582
q19	812	797	894	797
q20	1990	2080	1862	1862
q21	4774	4361	4329	4329
q22	633	569	552	552
Total cold run time: 52353 ms
Total hot run time: 50064 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188039 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 25c7d3968ebd835a80b942681ab3ec3de74e95c6, data reload: false

query1	1017	371	387	371
query2	6495	1737	1704	1704
query3	6740	214	216	214
query4	26305	23288	23668	23288
query5	4357	594	449	449
query6	296	206	202	202
query7	4642	484	292	292
query8	277	224	216	216
query9	8620	2654	2656	2654
query10	465	342	268	268
query11	15868	15025	14776	14776
query12	155	108	107	107
query13	1659	560	384	384
query14	8689	6041	6055	6041
query15	205	193	171	171
query16	7297	434	263	263
query17	1328	741	602	602
query18	1970	401	299	299
query19	203	194	167	167
query20	133	120	119	119
query21	212	129	112	112
query22	4142	4171	4015	4015
query23	33852	33022	33109	33022
query24	8395	2429	2381	2381
query25	514	465	392	392
query26	775	270	148	148
query27	2740	505	339	339
query28	4290	2145	2122	2122
query29	698	610	452	452
query30	287	226	197	197
query31	896	829	752	752
query32	71	66	62	62
query33	569	340	283	283
query34	822	856	533	533
query35	616	630	557	557
query36	936	975	895	895
query37	117	105	77	77
query38	4109	4101	4068	4068
query39	1563	1423	1438	1423
query40	212	116	108	108
query41	58	57	59	57
query42	133	116	106	106
query43	508	505	475	475
query44	1399	839	838	838
query45	180	170	166	166
query46	878	1034	639	639
query47	1748	1772	1737	1737
query48	391	415	313	313
query49	689	475	415	415
query50	661	701	420	420
query51	5519	5528	5467	5467
query52	113	107	98	98
query53	226	256	181	181
query54	585	566	495	495
query55	80	79	86	79
query56	295	300	294	294
query57	1173	1164	1118	1118
query58	264	257	259	257
query59	2733	2731	2652	2652
query60	340	323	295	295
query61	125	120	125	120
query62	784	725	678	678
query63	229	187	189	187
query64	3354	1160	822	822
query65	4292	4174	4192	4174
query66	1019	400	322	322
query67	15988	15453	15306	15306
query68	8164	892	529	529
query69	518	319	274	274
query70	1183	1123	1127	1123
query71	481	315	303	303
query72	5741	4740	4786	4740
query73	714	586	354	354
query74	9165	9174	9048	9048
query75	3834	3188	2709	2709
query76	3642	1145	743	743
query77	786	395	394	394
query78	11069	10986	10438	10438
query79	2317	879	613	613
query80	609	553	433	433
query81	492	254	219	219
query82	444	125	101	101
query83	289	251	237	237
query84	297	104	81	81
query85	785	359	313	313
query86	364	310	279	279
query87	4481	4401	4358	4358
query88	3536	2344	2332	2332
query89	386	319	284	284
query90	1908	235	217	217
query91	139	137	112	112
query92	75	59	57	57
query93	1658	967	581	581
query94	681	317	242	242
query95	376	299	290	290
query96	505	595	285	285
query97	2710	2806	2609	2609
query98	228	214	211	211
query99	1468	1368	1294	1294
Total cold run time: 275346 ms
Total hot run time: 188039 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 25c7d3968ebd835a80b942681ab3ec3de74e95c6, data reload: false

query1	0.04	0.03	0.04
query2	0.11	0.06	0.06
query3	0.28	0.06	0.07
query4	1.66	0.07	0.08
query5	0.43	0.42	0.43
query6	1.16	0.67	0.66
query7	0.02	0.02	0.01
query8	0.06	0.05	0.05
query9	0.64	0.54	0.52
query10	0.57	0.58	0.57
query11	0.26	0.13	0.13
query12	0.25	0.14	0.13
query13	0.65	0.64	0.63
query14	0.81	0.83	0.87
query15	0.96	0.89	0.89
query16	0.39	0.39	0.39
query17	1.05	1.08	1.06
query18	0.25	0.24	0.23
query19	1.99	1.83	1.89
query20	0.01	0.01	0.02
query21	15.37	0.98	0.67
query22	0.94	1.06	0.83
query23	14.67	1.57	0.79
query24	5.41	0.57	0.29
query25	0.16	0.10	0.09
query26	0.55	0.22	0.19
query27	0.09	0.09	0.08
query28	11.03	1.18	0.58
query29	12.56	4.12	3.44
query30	0.27	0.08	0.06
query31	2.85	0.64	0.44
query32	3.25	0.61	0.52
query33	3.17	3.14	3.20
query34	17.08	5.42	4.81
query35	4.73	4.74	4.81
query36	0.64	0.51	0.50
query37	0.19	0.18	0.18
query38	0.17	0.17	0.15
query39	0.05	0.04	0.05
query40	0.22	0.18	0.16
query41	0.11	0.05	0.05
query42	0.07	0.06	0.06
query43	0.06	0.04	0.04
Total cold run time: 105.23 s
Total hot run time: 30.43 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 57.05% (15507/27181)
Line Coverage 45.90% (138424/301572)
Region Coverage 35.32% (103546/293175)
Branch Coverage 37.78% (45580/120639)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants