[feat](dynamic table) support stream part 1: stream meta data & basic DDL by TsukiokaKogane · Pull Request #61382 · apache/doris

TsukiokaKogane · 2026-03-16T08:49:13Z

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #57921

Problem Summary:
stream as basic building blocks for dynamic computing

basic DDL:

create stream

CREATE STREAM `s1` ON TABLE tbl1
COMMENT 'test stream 1'
PROPERTIES(
'type' = 'min_delta',
'show_initial_rows' = 'true'
);

drop stream

drop stream if exists s1 force;

show streams
show create stream

stream information schema

MySQL [(none)]> select * from information_schema.streams;
+-------------+-------------------+--------------+----------------+----------------+-----------------+----------------+----------------+-----------------+---------+----------+--------------+
| STREAM_NAME | STREAM_TYPE       | CONSUME_TYPE | STREAM_COMMENT | DB_NAME        | BASE_TABLE_NAME | BASE_TABLE_DB  | BASE_TABLE_CTL | BASE_TABLE_TYPE | ENABLED | IS_STALE | STALE_REASON |
+-------------+-------------------+--------------+----------------+----------------+-----------------+----------------+----------------+-----------------+---------+----------+--------------+
| s1          | OLAP_TABLE_STREAM | MIN_DELTA    | test stream 1  | test_stream_db | tbl1            | test_stream_db | internal       | OLAP            |       1 |        0 | N/A          |
+-------------+-------------------+--------------+----------------+----------------+-----------------+----------------+----------------+-----------------+---------+----------+--------------+
1 row in set (0.03 sec)

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2026-03-16T08:49:19Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

TsukiokaKogane · 2026-03-16T09:34:42Z

run buildall

TsukiokaKogane · 2026-03-16T09:34:54Z

/review

TsukiokaKogane · 2026-03-16T09:45:25Z

run buildall

doris-robot · 2026-03-16T10:15:42Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.49% (32293/50072)
Region Coverage	65.39% (16168/24727)
Branch Coverage	55.88% (8624/15434)

hello-stephen · 2026-03-16T11:01:58Z

FE UT Coverage Report

Increment line coverage 46.57% (258/554) 🎉
Increment coverage report
Complete coverage report

TsukiokaKogane · 2026-03-16T12:09:56Z

run buildall

doris-robot · 2026-03-16T12:59:27Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.47% (32281/50072)
Region Coverage	65.39% (16169/24727)
Branch Coverage	55.84% (8619/15434)

hello-stephen · 2026-03-16T13:28:52Z

FE UT Coverage Report

Increment line coverage 46.57% (258/554) 🎉
Increment coverage report
Complete coverage report

doris-robot · 2026-03-16T14:19:35Z

TPC-H: Total hot run time: 27041 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 908e0938f08758c601db874a400a3402e0d2d0b9, data reload: false

------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	17614	4454	4364	4364
q2	q3	10741	791	532	532
q4	4726	365	253	253
q5	8194	1233	1021	1021
q6	240	174	144	144
q7	801	836	665	665
q8	10860	1500	1313	1313
q9	6873	4727	4696	4696
q10	6311	1945	1693	1693
q11	476	260	259	259
q12	754	572	477	477
q13	18088	2927	2188	2188
q14	231	237	219	219
q15	q16	733	739	666	666
q17	717	798	478	478
q18	6056	5351	5290	5290
q19	1116	980	623	623
q20	559	501	374	374
q21	4762	2091	1509	1509
q22	370	327	277	277
Total cold run time: 100222 ms
Total hot run time: 27041 ms

----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	4594	4687	4624	4624
q2	q3	3888	4362	3804	3804
q4	870	1212	790	790
q5	4152	4417	4312	4312
q6	181	188	139	139
q7	1773	1700	1595	1595
q8	2624	2739	2558	2558
q9	7594	7309	7301	7301
q10	3782	4008	3706	3706
q11	526	448	426	426
q12	545	678	486	486
q13	2631	3131	2355	2355
q14	275	326	296	296
q15	q16	759	818	725	725
q17	1203	1325	1347	1325
q18	7139	6765	6800	6765
q19	1045	907	897	897
q20	2084	2177	2006	2006
q21	3960	3481	3300	3300
q22	433	409	374	374
Total cold run time: 50058 ms
Total hot run time: 47784 ms

doris-robot · 2026-03-16T14:30:23Z

TPC-DS: Total hot run time: 168631 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 908e0938f08758c601db874a400a3402e0d2d0b9, data reload: false

query5	4318	633	487	487
query6	329	219	202	202
query7	4226	486	280	280
query8	336	247	224	224
query9	8712	2757	2769	2757
query10	522	400	349	349
query11	7014	5104	4881	4881
query12	177	131	121	121
query13	1276	467	347	347
query14	5780	3759	3500	3500
query14_1	2849	2847	2849	2847
query15	201	188	176	176
query16	985	455	435	435
query17	848	704	589	589
query18	2425	432	333	333
query19	206	206	179	179
query20	134	124	122	122
query21	207	131	114	114
query22	13328	13921	15145	13921
query23	16220	15828	15629	15629
query23_1	15663	15985	15811	15811
query24	7183	1611	1212	1212
query24_1	1231	1240	1254	1240
query25	586	503	425	425
query26	1244	261	152	152
query27	2782	492	303	303
query28	4482	1926	1894	1894
query29	811	561	472	472
query30	297	219	188	188
query31	1006	950	870	870
query32	82	69	67	67
query33	502	324	274	274
query34	890	886	517	517
query35	635	680	592	592
query36	1070	1098	980	980
query37	135	91	76	76
query38	3015	2906	2877	2877
query39	861	822	816	816
query39_1	789	785	788	785
query40	227	156	131	131
query41	61	57	58	57
query42	259	256	252	252
query43	236	245	221	221
query44	
query45	199	190	179	179
query46	876	980	604	604
query47	3364	2135	2057	2057
query48	310	325	225	225
query49	639	465	370	370
query50	679	272	219	219
query51	4133	4062	3967	3967
query52	261	262	289	262
query53	289	348	279	279
query54	297	276	265	265
query55	89	92	85	85
query56	328	319	311	311
query57	1909	1761	1743	1743
query58	285	268	269	268
query59	2767	2951	2757	2757
query60	339	335	321	321
query61	146	144	155	144
query62	636	592	533	533
query63	311	277	267	267
query64	4953	1276	1003	1003
query65	
query66	1468	448	368	368
query67	24213	24204	24276	24204
query68	
query69	398	305	292	292
query70	966	909	923	909
query71	338	311	303	303
query72	2797	2784	2603	2603
query73	555	552	323	323
query74	9616	9551	9415	9415
query75	2898	2784	2495	2495
query76	2312	1051	686	686
query77	363	386	314	314
query78	10941	11071	10473	10473
query79	2533	779	587	587
query80	1780	640	584	584
query81	547	261	227	227
query82	1035	155	116	116
query83	346	256	244	244
query84	297	117	91	91
query85	882	463	434	434
query86	411	301	288	288
query87	3149	3112	3007	3007
query88	3554	2657	2637	2637
query89	420	371	354	354
query90	2003	175	178	175
query91	163	158	131	131
query92	80	78	68	68
query93	1168	831	503	503
query94	644	307	289	289
query95	581	339	311	311
query96	635	516	228	228
query97	2493	2477	2412	2412
query98	244	223	223	223
query99	1034	988	927	927
Total cold run time: 251637 ms
Total hot run time: 168631 ms

doris-robot · 2026-03-16T16:17:36Z

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.64% (19707/37434)
Line Coverage	36.21% (184126/508531)
Region Coverage	32.39% (142122/438800)
Branch Coverage	33.57% (62147/185153)

hello-stephen · 2026-03-16T16:23:50Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	73.14% (26800/36640)
Line Coverage	56.56% (286681/506818)
Region Coverage	53.91% (238718/442849)
Branch Coverage	55.58% (103184/185635)

TsukiokaKogane requested review from CalvinKirs, dataroaring and morningman as code owners March 16, 2026 08:49

TsukiokaKogane added 8 commits March 16, 2026 09:00

[feat](dynamic table) support stream part 1: stream meta data & DDL

d81efc6

fix

cc8ef23

more fix

d1ef89a

fix priv

dd804e1

fix v3

1df3ce6

fix v4

a9cbd99

fix v5

a9eedb4

add test

02dbb12

TsukiokaKogane force-pushed the support_table_stream.part_ddl branch from 8800590 to 02dbb12 Compare March 16, 2026 09:00

TsukiokaKogane added 5 commits March 16, 2026 09:14

fix format

64998b9

fix format v2

0df50a2

fix format v3

ec04e6e

fix format v4

01e7ce9

fix format v5

f616c8d

TsukiokaKogane added 2 commits March 16, 2026 09:43

fix code

00831dc

fix code v2

3b0e452

fix regression

908e093

Conversation

TsukiokaKogane commented Mar 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Mar 16, 2026

Uh oh!

TsukiokaKogane commented Mar 16, 2026

Uh oh!

TsukiokaKogane commented Mar 16, 2026

Uh oh!

TsukiokaKogane commented Mar 16, 2026

Uh oh!

doris-robot commented Mar 16, 2026

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Mar 16, 2026

FE UT Coverage Report

Uh oh!

TsukiokaKogane commented Mar 16, 2026

Uh oh!

doris-robot commented Mar 16, 2026

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Mar 16, 2026

FE UT Coverage Report

Uh oh!

doris-robot commented Mar 16, 2026

Uh oh!

doris-robot commented Mar 16, 2026

Uh oh!

doris-robot commented Mar 16, 2026

BE UT Coverage Report

Uh oh!

hello-stephen commented Mar 16, 2026

BE Regression && UT Coverage Report

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

TsukiokaKogane commented Mar 16, 2026 •

edited

Loading