-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[feat](load) enable stream load record to audit log system table #57530
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[feat](load) enable stream load record to audit log system table #57530
Conversation
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
|
run buildall |
4edeb6c to
ded5f7e
Compare
|
run buildall |
ClickBench: Total hot run time: 28.91 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
ded5f7e to
df8653e
Compare
|
run buildall |
|
PR approved by anyone and no changes requested. |
FE UT Coverage ReportIncrement line coverage |
ClickBench: Total hot run time: 29.25 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
FE Regression Coverage ReportIncrement line coverage |
df8653e to
8700520
Compare
|
run buildall |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
FE UT Coverage ReportIncrement line coverage |
8700520 to
b48e2e1
Compare
|
run buildall |
TPC-DS: Total hot run time: 190947 ms |
ClickBench: Total hot run time: 27.4 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
FE Regression Coverage ReportIncrement line coverage |
a881d4f to
125c361
Compare
ClickBench: Total hot run time: 27.75 s |
FE UT Coverage ReportIncrement line coverage |
FE Regression Coverage ReportIncrement line coverage |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
1 similar comment
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
FE Regression Coverage ReportIncrement line coverage |
1 similar comment
FE Regression Coverage ReportIncrement line coverage |
|
run buildall |
TPC-H: Total hot run time: 34587 ms |
TPC-DS: Total hot run time: 189977 ms |
ClickBench: Total hot run time: 27.32 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
FE Regression Coverage ReportIncrement line coverage |
liaoxin01
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
|
PR approved by at least one committer and no changes requested. |
…che#57530) enable stream load record to audit log system table: ``` mysql> select * from __internal_schema.audit_log where query_id = '41380067396d434d85c9e1ffbc73899d'\G *************************** 1. row *************************** query_id: 41380067396d434d85c9e1ffbc73899d time: 2025-10-30 18:54:54.079 client_ip: 10.16.10.7 user: root frontend_ip: NULL catalog: NULL db: regression_test_load_p0_stream_load_test state: Success error_code: NULL error_message: OK query_time: 61 cpu_time_ms: NULL peak_memory_bytes: NULL scan_bytes: 28 scan_rows: 2 return_rows: 2 shuffle_send_rows: NULL shuffle_send_bytes: NULL spill_write_bytes_from_local_storage: NULL spill_read_bytes_from_local_storage: NULL scan_bytes_from_local_storage: NULL scan_bytes_from_remote_storage: NULL parse_time_ms: NULL plan_times_ms: NULL get_meta_times_ms: NULL schedule_times_ms: NULL hit_sql_cache: NULL handled_in_fe: NULL queried_tables_and_views: NULL chosen_m_views: NULL changed_variables: NULL sql_mode: NULL stmt_type: NULL stmt_id: NULL sql_hash: NULL sql_digest: NULL is_query: NULL is_nereids: NULL is_internal: NULL workload_group: NULL compute_group: NULL stmt: STREAM LOAD: table=test_stream_load_record, label=41380067396d434d85c9e1ffbc73899d, status=Success, total_rows=2, loaded_rows=2, filtered_rows=0, unselected_rows=0, load_bytes=28, url= 1 row in set (0.01 sec) ```
…che#57530) ### What problem does this PR solve? enable stream load record to audit log system table: ``` mysql> select * from __internal_schema.audit_log where query_id = '41380067396d434d85c9e1ffbc73899d'\G *************************** 1. row *************************** query_id: 41380067396d434d85c9e1ffbc73899d time: 2025-10-30 18:54:54.079 client_ip: 10.16.10.7 user: root frontend_ip: NULL catalog: NULL db: regression_test_load_p0_stream_load_test state: Success error_code: NULL error_message: OK query_time: 61 cpu_time_ms: NULL peak_memory_bytes: NULL scan_bytes: 28 scan_rows: 2 return_rows: 2 shuffle_send_rows: NULL shuffle_send_bytes: NULL spill_write_bytes_from_local_storage: NULL spill_read_bytes_from_local_storage: NULL scan_bytes_from_local_storage: NULL scan_bytes_from_remote_storage: NULL parse_time_ms: NULL plan_times_ms: NULL get_meta_times_ms: NULL schedule_times_ms: NULL hit_sql_cache: NULL handled_in_fe: NULL queried_tables_and_views: NULL chosen_m_views: NULL changed_variables: NULL sql_mode: NULL stmt_type: NULL stmt_id: NULL sql_hash: NULL sql_digest: NULL is_query: NULL is_nereids: NULL is_internal: NULL workload_group: NULL compute_group: NULL stmt: STREAM LOAD: table=test_stream_load_record, label=41380067396d434d85c9e1ffbc73899d, status=Success, total_rows=2, loaded_rows=2, filtered_rows=0, unselected_rows=0, load_bytes=28, url= 1 row in set (0.01 sec) ```
…m table (#57530) (#58849) pick #57530 enable stream load record to audit log system table: ``` mysql> select * from __internal_schema.audit_log where query_id = '41380067396d434d85c9e1ffbc73899d'\G *************************** 1. row *************************** query_id: 41380067396d434d85c9e1ffbc73899d time: 2025-10-30 18:54:54.079 client_ip: 10.16.10.7 user: root frontend_ip: NULL catalog: NULL db: regression_test_load_p0_stream_load_test state: Success error_code: NULL error_message: OK query_time: 61 cpu_time_ms: NULL peak_memory_bytes: NULL scan_bytes: 28 scan_rows: 2 return_rows: 2 shuffle_send_rows: NULL shuffle_send_bytes: NULL spill_write_bytes_from_local_storage: NULL spill_read_bytes_from_local_storage: NULL scan_bytes_from_local_storage: NULL scan_bytes_from_remote_storage: NULL parse_time_ms: NULL plan_times_ms: NULL get_meta_times_ms: NULL schedule_times_ms: NULL hit_sql_cache: NULL handled_in_fe: NULL queried_tables_and_views: NULL chosen_m_views: NULL changed_variables: NULL sql_mode: NULL stmt_type: NULL stmt_id: NULL sql_hash: NULL sql_digest: NULL is_query: NULL is_nereids: NULL is_internal: NULL workload_group: NULL compute_group: NULL stmt: STREAM LOAD: table=test_stream_load_record, label=41380067396d434d85c9e1ffbc73899d, status=Success, total_rows=2, loaded_rows=2, filtered_rows=0, unselected_rows=0, load_bytes=28, url= 1 row in set (0.01 sec) ``` ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test <!-- At least one of them must be included. --> - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason <!-- Add your reason? --> - Behavior changed: - [ ] No. - [ ] Yes. <!-- Explain the behavior change --> - Does this need documentation? - [ ] No. - [ ] Yes. <!-- Add document PR link here. eg: apache/doris-website#1214 --> ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
What problem does this PR solve?
enable stream load record to audit log system table:
Release note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)