Skip to content

Conversation

@sollhui
Copy link
Contributor

@sollhui sollhui commented Oct 30, 2025

What problem does this PR solve?

enable stream load record to audit log system table:

mysql> select * from __internal_schema.audit_log where query_id = '41380067396d434d85c9e1ffbc73899d'\G
*************************** 1. row ***************************
                            query_id: 41380067396d434d85c9e1ffbc73899d
                                time: 2025-10-30 18:54:54.079
                           client_ip: 10.16.10.7
                                user: root
                         frontend_ip: NULL
                             catalog: NULL
                                  db: regression_test_load_p0_stream_load_test
                               state: Success
                          error_code: NULL
                       error_message: OK
                          query_time: 61
                         cpu_time_ms: NULL
                   peak_memory_bytes: NULL
                          scan_bytes: 28
                           scan_rows: 2
                         return_rows: 2
                   shuffle_send_rows: NULL
                  shuffle_send_bytes: NULL
spill_write_bytes_from_local_storage: NULL
 spill_read_bytes_from_local_storage: NULL
       scan_bytes_from_local_storage: NULL
      scan_bytes_from_remote_storage: NULL
                       parse_time_ms: NULL
                       plan_times_ms: NULL
                   get_meta_times_ms: NULL
                   schedule_times_ms: NULL
                       hit_sql_cache: NULL
                       handled_in_fe: NULL
            queried_tables_and_views: NULL
                      chosen_m_views: NULL
                   changed_variables: NULL
                            sql_mode: NULL
                           stmt_type: NULL
                             stmt_id: NULL
                            sql_hash: NULL
                          sql_digest: NULL
                            is_query: NULL
                          is_nereids: NULL
                         is_internal: NULL
                      workload_group: NULL
                       compute_group: NULL
                                stmt: STREAM LOAD: table=test_stream_load_record, label=41380067396d434d85c9e1ffbc73899d, status=Success, total_rows=2, loaded_rows=2, filtered_rows=0, unselected_rows=0, load_bytes=28, url=
1 row in set (0.01 sec)

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@sollhui
Copy link
Contributor Author

sollhui commented Oct 30, 2025

run buildall

@sollhui sollhui force-pushed the enhance_stream_load_audit_log branch from 4edeb6c to ded5f7e Compare October 30, 2025 11:12
@sollhui
Copy link
Contributor Author

sollhui commented Oct 30, 2025

run buildall

@doris-robot
Copy link

ClickBench: Total hot run time: 28.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ded5f7e0ecbf07d7379cf60d783685b850a7a208, data reload: false

query1	0.07	0.05	0.06
query2	0.10	0.06	0.05
query3	0.26	0.09	0.09
query4	1.62	0.13	0.12
query5	0.28	0.27	0.25
query6	1.16	0.67	0.67
query7	0.03	0.03	0.03
query8	0.06	0.05	0.05
query9	0.65	0.56	0.55
query10	0.62	0.62	0.61
query11	0.18	0.12	0.12
query12	0.16	0.13	0.14
query13	0.64	0.63	0.61
query14	1.05	1.03	1.04
query15	0.89	0.86	0.85
query16	0.44	0.41	0.42
query17	1.13	1.14	1.09
query18	0.24	0.21	0.21
query19	2.01	1.87	1.89
query20	0.02	0.02	0.02
query21	15.42	0.19	0.13
query22	5.12	0.07	0.06
query23	15.70	0.28	0.11
query24	2.66	0.81	0.83
query25	0.09	0.06	0.06
query26	0.15	0.15	0.15
query27	0.07	0.06	0.06
query28	5.30	1.17	0.96
query29	12.57	4.26	3.57
query30	0.28	0.14	0.14
query31	2.83	0.63	0.39
query32	3.24	0.57	0.48
query33	3.12	3.08	3.10
query34	15.98	5.30	4.57
query35	4.64	4.60	4.70
query36	0.69	0.55	0.52
query37	0.10	0.06	0.07
query38	0.08	0.05	0.05
query39	0.04	0.03	0.03
query40	0.18	0.15	0.15
query41	0.10	0.04	0.04
query42	0.05	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 100.07 s
Total hot run time: 28.91 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 0.73% (2/275) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.69% (18041/34243)
Line Coverage 37.94% (163718/431538)
Region Coverage 32.30% (124807/386425)
Branch Coverage 33.68% (54581/162057)

@sollhui sollhui force-pushed the enhance_stream_load_audit_log branch from ded5f7e to df8653e Compare October 30, 2025 15:09
@sollhui
Copy link
Contributor Author

sollhui commented Oct 30, 2025

run buildall

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

ClickBench: Total hot run time: 29.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit df8653e3989ec28d9d622dfbe691446a90220318, data reload: false

query1	0.07	0.06	0.06
query2	0.11	0.06	0.06
query3	0.26	0.09	0.09
query4	1.62	0.13	0.13
query5	0.30	0.28	0.28
query6	1.24	0.68	0.69
query7	0.04	0.04	0.03
query8	0.07	0.05	0.05
query9	0.66	0.56	0.56
query10	0.63	0.61	0.62
query11	0.19	0.13	0.13
query12	0.20	0.14	0.14
query13	0.63	0.63	0.61
query14	1.04	1.02	1.04
query15	0.89	0.90	0.90
query16	0.41	0.42	0.44
query17	1.16	1.19	1.18
query18	0.23	0.22	0.23
query19	2.05	1.87	1.89
query20	0.02	0.01	0.02
query21	15.37	0.22	0.14
query22	5.00	0.08	0.06
query23	15.63	0.31	0.11
query24	2.84	1.01	0.44
query25	0.08	0.07	0.06
query26	0.17	0.16	0.16
query27	0.07	0.06	0.07
query28	4.54	1.20	0.95
query29	12.71	4.67	3.87
query30	0.32	0.16	0.13
query31	2.86	0.64	0.42
query32	3.25	0.58	0.50
query33	3.10	3.14	3.12
query34	15.91	5.27	4.64
query35	4.63	4.61	4.63
query36	0.73	0.53	0.52
query37	0.11	0.07	0.07
query38	0.07	0.05	0.04
query39	0.04	0.04	0.04
query40	0.19	0.15	0.15
query41	0.09	0.04	0.03
query42	0.05	0.04	0.04
query43	0.04	0.04	0.04
Total cold run time: 99.62 s
Total hot run time: 29.25 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 0.73% (2/273) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.69% (18042/34243)
Line Coverage 37.94% (163733/431548)
Region Coverage 32.30% (124793/386402)
Branch Coverage 33.69% (54593/162049)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.75% (235/284) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.44% (24038/33650)
Line Coverage 57.88% (250121/432131)
Region Coverage 52.94% (207440/391844)
Branch Coverage 54.67% (89188/163128)

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 100.00% (2/2) 🎉
Increment coverage report
Complete coverage report

@sollhui sollhui force-pushed the enhance_stream_load_audit_log branch from df8653e to 8700520 Compare October 31, 2025 01:42
@sollhui
Copy link
Contributor Author

sollhui commented Oct 31, 2025

run buildall

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 0.73% (2/273) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.69% (18041/34243)
Line Coverage 37.93% (163699/431548)
Region Coverage 32.30% (124824/386402)
Branch Coverage 33.68% (54584/162049)

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉
Increment coverage report
Complete coverage report

@sollhui sollhui force-pushed the enhance_stream_load_audit_log branch from 8700520 to b48e2e1 Compare October 31, 2025 03:07
@sollhui
Copy link
Contributor Author

sollhui commented Oct 31, 2025

run buildall

@doris-robot
Copy link

TPC-DS: Total hot run time: 190947 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b48e2e188d60e4bc1ad2aff9333ae0ed9066082d, data reload: false

query1	1034	444	408	408
query2	6550	1712	1680	1680
query3	6772	230	229	229
query4	26252	24022	23546	23546
query5	5595	633	479	479
query6	332	233	255	233
query7	4660	519	298	298
query8	322	257	251	251
query9	8720	2603	2606	2603
query10	548	349	292	292
query11	15800	15202	14908	14908
query12	173	116	112	112
query13	1672	564	457	457
query14	11322	9325	9273	9273
query15	197	184	181	181
query16	7658	693	533	533
query17	1187	749	626	626
query18	2054	475	357	357
query19	255	204	186	186
query20	137	140	130	130
query21	216	134	123	123
query22	4666	4618	4599	4599
query23	34734	33838	33712	33712
query24	8608	2511	2544	2511
query25	707	588	497	497
query26	1540	285	178	178
query27	2785	540	372	372
query28	4531	2285	2279	2279
query29	865	690	612	612
query30	306	246	204	204
query31	955	835	768	768
query32	88	73	77	73
query33	593	407	350	350
query34	862	886	549	549
query35	902	994	758	758
query36	961	999	949	949
query37	131	116	92	92
query38	3658	3668	3480	3480
query39	1624	1428	1440	1428
query40	220	126	119	119
query41	58	56	58	56
query42	122	113	109	109
query43	480	489	469	469
query44	1245	775	748	748
query45	183	175	176	175
query46	889	989	660	660
query47	1781	1784	1711	1711
query48	398	426	324	324
query49	774	504	417	417
query50	653	690	410	410
query51	3879	4001	3918	3918
query52	109	110	103	103
query53	239	262	199	199
query54	610	599	530	530
query55	85	87	85	85
query56	322	326	298	298
query57	1141	1178	1100	1100
query58	288	279	281	279
query59	2561	2674	2474	2474
query60	358	337	326	326
query61	171	151	156	151
query62	788	712	654	654
query63	239	196	194	194
query64	4515	1164	852	852
query65	4049	3971	3942	3942
query66	1046	427	344	344
query67	15334	15085	15214	15085
query68	8002	897	627	627
query69	514	308	315	308
query70	1261	1328	1273	1273
query71	464	344	325	325
query72	5835	4991	5183	4991
query73	674	588	362	362
query74	8885	9218	8878	8878
query75	4031	3384	2868	2868
query76	3515	1169	755	755
query77	809	411	306	306
query78	9511	9776	8961	8961
query79	2271	854	611	611
query80	632	578	513	513
query81	515	275	227	227
query82	467	162	135	135
query83	277	279	247	247
query84	262	110	94	94
query85	910	474	447	447
query86	369	327	292	292
query87	3738	3740	3720	3720
query88	3796	2261	2253	2253
query89	383	326	300	300
query90	2019	221	222	221
query91	162	163	135	135
query92	81	75	67	67
query93	1885	1030	671	671
query94	710	437	348	348
query95	405	327	317	317
query96	494	581	281	281
query97	2935	2968	2886	2886
query98	253	223	209	209
query99	1381	1434	1271	1271
Total cold run time: 279955 ms
Total hot run time: 190947 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b48e2e188d60e4bc1ad2aff9333ae0ed9066082d, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.04	0.05
query3	0.25	0.08	0.08
query4	1.61	0.12	0.11
query5	0.27	0.26	0.25
query6	1.18	0.64	0.64
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.60	0.53	0.52
query10	0.58	0.58	0.56
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.61	0.61	0.60
query14	1.01	1.02	1.00
query15	0.86	0.83	0.84
query16	0.40	0.38	0.39
query17	1.01	1.01	1.09
query18	0.22	0.19	0.20
query19	1.86	1.80	1.81
query20	0.02	0.01	0.01
query21	15.43	0.20	0.13
query22	5.01	0.07	0.05
query23	15.65	0.26	0.10
query24	2.59	0.54	0.28
query25	0.08	0.06	0.06
query26	0.13	0.13	0.13
query27	0.06	0.05	0.05
query28	3.85	1.15	0.93
query29	12.62	3.92	3.30
query30	0.28	0.14	0.12
query31	2.82	0.60	0.38
query32	3.23	0.54	0.47
query33	3.04	3.03	3.12
query34	15.83	5.16	4.54
query35	4.58	4.60	4.60
query36	0.69	0.50	0.50
query37	0.10	0.07	0.07
query38	0.07	0.04	0.05
query39	0.04	0.03	0.03
query40	0.17	0.15	0.14
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 97.46 s
Total hot run time: 27.4 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 0.73% (2/273) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.66% (18044/34265)
Line Coverage 37.92% (163812/432014)
Region Coverage 32.26% (124879/387153)
Branch Coverage 33.66% (54608/162227)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.75% (235/284) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.41% (24048/33674)
Line Coverage 57.81% (250166/432726)
Region Coverage 52.83% (207479/392717)
Branch Coverage 54.59% (89166/163336)

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 100.00% (2/2) 🎉
Increment coverage report
Complete coverage report

@sollhui sollhui force-pushed the enhance_stream_load_audit_log branch 2 times, most recently from a881d4f to 125c361 Compare November 3, 2025 04:34
@doris-robot
Copy link

ClickBench: Total hot run time: 27.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 79bece94df5b845a69856c947cde5b3f1c205230, data reload: false

query1	0.06	0.04	0.05
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.60	0.11	0.10
query5	0.28	0.26	0.25
query6	1.20	0.66	0.66
query7	0.03	0.03	0.03
query8	0.06	0.04	0.05
query9	0.58	0.53	0.52
query10	0.58	0.58	0.58
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.64	0.61	0.59
query14	0.99	0.99	1.01
query15	0.87	0.83	0.84
query16	0.39	0.40	0.39
query17	1.03	1.06	0.98
query18	0.22	0.20	0.20
query19	1.90	1.84	1.79
query20	0.02	0.01	0.02
query21	15.44	0.22	0.13
query22	4.84	0.06	0.04
query23	15.66	0.27	0.10
query24	2.14	0.93	1.07
query25	0.08	0.06	0.08
query26	0.16	0.12	0.12
query27	0.10	0.05	0.06
query28	4.46	1.18	0.97
query29	12.55	3.85	3.18
query30	0.30	0.14	0.12
query31	2.82	0.59	0.38
query32	3.22	0.56	0.47
query33	3.10	3.01	3.06
query34	15.57	5.16	4.44
query35	4.50	4.54	4.57
query36	0.68	0.51	0.50
query37	0.11	0.07	0.07
query38	0.06	0.04	0.04
query39	0.03	0.03	0.03
query40	0.18	0.14	0.14
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 97.27 s
Total hot run time: 27.75 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 100.00% (2/2) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 1.39% (4/287) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.71% (18273/34669)
Line Coverage 38.08% (166032/436019)
Region Coverage 33.04% (129182/391032)
Branch Coverage 33.80% (55401/163911)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.89% (247/298) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.48% (24354/34070)
Line Coverage 57.95% (253079/436691)
Region Coverage 53.26% (211207/396588)
Branch Coverage 54.55% (90012/164998)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.89% (247/298) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.49% (24357/34070)
Line Coverage 57.96% (253098/436691)
Region Coverage 53.25% (211190/396588)
Branch Coverage 54.56% (90021/164998)

1 similar comment
@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.89% (247/298) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.49% (24357/34070)
Line Coverage 57.96% (253098/436691)
Region Coverage 53.25% (211190/396588)
Branch Coverage 54.56% (90021/164998)

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 100.00% (2/2) 🎉
Increment coverage report
Complete coverage report

1 similar comment
@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 100.00% (2/2) 🎉
Increment coverage report
Complete coverage report

@sollhui
Copy link
Contributor Author

sollhui commented Nov 19, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34587 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b80838766b10be1b9a52fa9b6812a32b7d26c832, data reload: false

------ Round 1 ----------------------------------
q1	17667	5156	4894	4894
q2	2020	322	202	202
q3	10269	1287	737	737
q4	10241	960	386	386
q5	7517	2320	2404	2320
q6	190	172	134	134
q7	920	780	646	646
q8	9346	1384	1154	1154
q9	7264	5617	5451	5451
q10	6905	2223	1871	1871
q11	504	303	298	298
q12	366	379	229	229
q13	17791	3729	3071	3071
q14	229	240	226	226
q15	583	511	503	503
q16	1069	993	948	948
q17	615	903	386	386
q18	7576	7136	7082	7082
q19	1088	956	570	570
q20	347	366	224	224
q21	3984	3299	2316	2316
q22	1076	1029	939	939
Total cold run time: 107567 ms
Total hot run time: 34587 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5075	5057	5011	5011
q2	336	413	323	323
q3	2221	2710	2297	2297
q4	1360	1756	1318	1318
q5	4280	4486	4531	4486
q6	219	180	151	151
q7	2059	1924	1822	1822
q8	2769	2585	2540	2540
q9	7635	7609	7619	7609
q10	3049	3449	2853	2853
q11	587	525	528	525
q12	712	762	608	608
q13	3600	4047	3311	3311
q14	306	297	273	273
q15	591	652	536	536
q16	1073	1115	1049	1049
q17	1240	1564	1348	1348
q18	8041	7537	7645	7537
q19	868	823	870	823
q20	2038	2100	1881	1881
q21	4825	4344	4255	4255
q22	1098	1065	1005	1005
Total cold run time: 53982 ms
Total hot run time: 51561 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189977 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b80838766b10be1b9a52fa9b6812a32b7d26c832, data reload: false

query1	1061	420	394	394
query2	6569	1708	1644	1644
query3	6757	230	221	221
query4	26228	23813	23118	23118
query5	4443	689	545	545
query6	340	255	225	225
query7	4660	508	306	306
query8	301	258	249	249
query9	8673	2899	2948	2899
query10	470	341	305	305
query11	16000	15266	15058	15058
query12	194	124	118	118
query13	1676	581	446	446
query14	10424	9508	9366	9366
query15	208	193	174	174
query16	7206	694	508	508
query17	1228	760	639	639
query18	1989	425	326	326
query19	212	212	184	184
query20	133	127	127	127
query21	217	141	125	125
query22	4024	3986	4008	3986
query23	34058	33072	32911	32911
query24	8270	2431	2404	2404
query25	642	591	504	504
query26	1254	286	174	174
query27	2731	531	366	366
query28	4397	2217	2199	2199
query29	904	663	525	525
query30	301	239	205	205
query31	908	835	765	765
query32	97	85	82	82
query33	613	418	374	374
query34	818	878	534	534
query35	826	879	794	794
query36	971	1003	908	908
query37	136	122	99	99
query38	3565	3642	3467	3467
query39	1460	1433	1590	1433
query40	248	145	137	137
query41	86	75	78	75
query42	138	121	119	119
query43	490	497	468	468
query44	1301	817	810	810
query45	194	183	182	182
query46	906	1022	656	656
query47	1804	1789	1796	1789
query48	411	458	347	347
query49	806	526	443	443
query50	688	714	417	417
query51	3922	3957	3945	3945
query52	120	121	112	112
query53	251	283	218	218
query54	349	329	323	323
query55	99	98	93	93
query56	371	384	377	377
query57	1171	1189	1121	1121
query58	315	308	296	296
query59	2562	2585	2497	2497
query60	393	391	427	391
query61	163	159	161	159
query62	800	694	666	666
query63	240	203	205	203
query64	4588	1163	875	875
query65	4062	3929	3971	3929
query66	1193	438	345	345
query67	15458	15200	15244	15200
query68	8292	960	636	636
query69	494	353	309	309
query70	1295	1345	1316	1316
query71	491	364	334	334
query72	5937	4992	4839	4839
query73	661	601	374	374
query74	8930	9118	8913	8913
query75	3902	3285	2852	2852
query76	3587	1154	762	762
query77	813	425	376	376
query78	9520	9742	8957	8957
query79	2391	816	626	626
query80	720	616	542	542
query81	508	263	237	237
query82	428	170	143	143
query83	265	272	260	260
query84	270	113	90	90
query85	931	493	443	443
query86	400	345	303	303
query87	3755	3750	3715	3715
query88	3749	2285	2272	2272
query89	402	329	297	297
query90	1925	248	236	236
query91	170	175	136	136
query92	99	80	79	79
query93	1922	1031	678	678
query94	665	404	332	332
query95	410	353	347	347
query96	496	600	290	290
query97	2974	2968	2860	2860
query98	257	224	230	224
query99	1346	1422	1299	1299
Total cold run time: 276098 ms
Total hot run time: 189977 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b80838766b10be1b9a52fa9b6812a32b7d26c832, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.05
query3	0.25	0.08	0.08
query4	1.61	0.11	0.10
query5	0.27	0.25	0.27
query6	1.17	0.67	0.64
query7	0.03	0.02	0.03
query8	0.05	0.04	0.04
query9	0.58	0.53	0.52
query10	0.58	0.56	0.58
query11	0.16	0.12	0.12
query12	0.14	0.12	0.11
query13	0.61	0.61	0.60
query14	1.02	1.00	1.00
query15	0.85	0.84	0.84
query16	0.39	0.40	0.39
query17	1.05	1.05	1.03
query18	0.21	0.19	0.20
query19	1.90	1.80	1.78
query20	0.01	0.02	0.01
query21	15.43	0.20	0.14
query22	5.05	0.07	0.04
query23	15.67	0.26	0.10
query24	2.39	1.64	0.29
query25	0.09	0.07	0.07
query26	0.15	0.13	0.14
query27	0.07	0.05	0.05
query28	4.86	1.15	0.95
query29	12.65	3.87	3.25
query30	0.31	0.15	0.11
query31	2.81	0.58	0.39
query32	3.23	0.56	0.47
query33	2.97	3.04	3.11
query34	15.82	5.17	4.49
query35	4.58	4.59	4.58
query36	0.66	0.50	0.49
query37	0.10	0.07	0.06
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.18	0.14	0.13
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.31 s
Total hot run time: 27.32 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 1.39% (4/287) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.71% (18277/34676)
Line Coverage 38.08% (166074/436131)
Region Coverage 33.01% (129130/391128)
Branch Coverage 33.80% (55410/163945)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.89% (247/298) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.56% (24387/34077)
Line Coverage 58.04% (253509/436806)
Region Coverage 53.18% (210957/396713)
Branch Coverage 54.66% (90207/165032)

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 100.00% (2/2) 🎉
Increment coverage report
Complete coverage report

Copy link
Contributor

@liaoxin01 liaoxin01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 20, 2025
@liaoxin01 liaoxin01 merged commit f8efb29 into apache:master Nov 20, 2025
26 of 27 checks passed
sollhui added a commit to sollhui/doris that referenced this pull request Dec 9, 2025
…che#57530)

enable stream load record to audit log system table:
```
mysql> select * from __internal_schema.audit_log where query_id = '41380067396d434d85c9e1ffbc73899d'\G
*************************** 1. row ***************************
                            query_id: 41380067396d434d85c9e1ffbc73899d
                                time: 2025-10-30 18:54:54.079
                           client_ip: 10.16.10.7
                                user: root
                         frontend_ip: NULL
                             catalog: NULL
                                  db: regression_test_load_p0_stream_load_test
                               state: Success
                          error_code: NULL
                       error_message: OK
                          query_time: 61
                         cpu_time_ms: NULL
                   peak_memory_bytes: NULL
                          scan_bytes: 28
                           scan_rows: 2
                         return_rows: 2
                   shuffle_send_rows: NULL
                  shuffle_send_bytes: NULL
spill_write_bytes_from_local_storage: NULL
 spill_read_bytes_from_local_storage: NULL
       scan_bytes_from_local_storage: NULL
      scan_bytes_from_remote_storage: NULL
                       parse_time_ms: NULL
                       plan_times_ms: NULL
                   get_meta_times_ms: NULL
                   schedule_times_ms: NULL
                       hit_sql_cache: NULL
                       handled_in_fe: NULL
            queried_tables_and_views: NULL
                      chosen_m_views: NULL
                   changed_variables: NULL
                            sql_mode: NULL
                           stmt_type: NULL
                             stmt_id: NULL
                            sql_hash: NULL
                          sql_digest: NULL
                            is_query: NULL
                          is_nereids: NULL
                         is_internal: NULL
                      workload_group: NULL
                       compute_group: NULL
                                stmt: STREAM LOAD: table=test_stream_load_record, label=41380067396d434d85c9e1ffbc73899d, status=Success, total_rows=2, loaded_rows=2, filtered_rows=0, unselected_rows=0, load_bytes=28, url=
1 row in set (0.01 sec)
```
nagisa-kunhah pushed a commit to nagisa-kunhah/doris that referenced this pull request Dec 14, 2025
…che#57530)

### What problem does this PR solve?

enable stream load record to audit log system table:
```
mysql> select * from __internal_schema.audit_log where query_id = '41380067396d434d85c9e1ffbc73899d'\G
*************************** 1. row ***************************
                            query_id: 41380067396d434d85c9e1ffbc73899d
                                time: 2025-10-30 18:54:54.079
                           client_ip: 10.16.10.7
                                user: root
                         frontend_ip: NULL
                             catalog: NULL
                                  db: regression_test_load_p0_stream_load_test
                               state: Success
                          error_code: NULL
                       error_message: OK
                          query_time: 61
                         cpu_time_ms: NULL
                   peak_memory_bytes: NULL
                          scan_bytes: 28
                           scan_rows: 2
                         return_rows: 2
                   shuffle_send_rows: NULL
                  shuffle_send_bytes: NULL
spill_write_bytes_from_local_storage: NULL
 spill_read_bytes_from_local_storage: NULL
       scan_bytes_from_local_storage: NULL
      scan_bytes_from_remote_storage: NULL
                       parse_time_ms: NULL
                       plan_times_ms: NULL
                   get_meta_times_ms: NULL
                   schedule_times_ms: NULL
                       hit_sql_cache: NULL
                       handled_in_fe: NULL
            queried_tables_and_views: NULL
                      chosen_m_views: NULL
                   changed_variables: NULL
                            sql_mode: NULL
                           stmt_type: NULL
                             stmt_id: NULL
                            sql_hash: NULL
                          sql_digest: NULL
                            is_query: NULL
                          is_nereids: NULL
                         is_internal: NULL
                      workload_group: NULL
                       compute_group: NULL
                                stmt: STREAM LOAD: table=test_stream_load_record, label=41380067396d434d85c9e1ffbc73899d, status=Success, total_rows=2, loaded_rows=2, filtered_rows=0, unselected_rows=0, load_bytes=28, url=
1 row in set (0.01 sec)
```
yiguolei pushed a commit that referenced this pull request Dec 18, 2025
…m table (#57530) (#58849)

pick #57530

enable stream load record to audit log system table:
```
mysql> select * from __internal_schema.audit_log where query_id = '41380067396d434d85c9e1ffbc73899d'\G
*************************** 1. row ***************************
                            query_id: 41380067396d434d85c9e1ffbc73899d
                                time: 2025-10-30 18:54:54.079
                           client_ip: 10.16.10.7
                                user: root
                         frontend_ip: NULL
                             catalog: NULL
                                  db: regression_test_load_p0_stream_load_test
                               state: Success
                          error_code: NULL
                       error_message: OK
                          query_time: 61
                         cpu_time_ms: NULL
                   peak_memory_bytes: NULL
                          scan_bytes: 28
                           scan_rows: 2
                         return_rows: 2
                   shuffle_send_rows: NULL
                  shuffle_send_bytes: NULL
spill_write_bytes_from_local_storage: NULL
 spill_read_bytes_from_local_storage: NULL
       scan_bytes_from_local_storage: NULL
      scan_bytes_from_remote_storage: NULL
                       parse_time_ms: NULL
                       plan_times_ms: NULL
                   get_meta_times_ms: NULL
                   schedule_times_ms: NULL
                       hit_sql_cache: NULL
                       handled_in_fe: NULL
            queried_tables_and_views: NULL
                      chosen_m_views: NULL
                   changed_variables: NULL
                            sql_mode: NULL
                           stmt_type: NULL
                             stmt_id: NULL
                            sql_hash: NULL
                          sql_digest: NULL
                            is_query: NULL
                          is_nereids: NULL
                         is_internal: NULL
                      workload_group: NULL
                       compute_group: NULL
                                stmt: STREAM LOAD: table=test_stream_load_record, label=41380067396d434d85c9e1ffbc73899d, status=Success, total_rows=2, loaded_rows=2, filtered_rows=0, unselected_rows=0, load_bytes=28, url=
1 row in set (0.01 sec)
```

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/4.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants