Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #46175

### What problem does this PR solve?

The following conditions exist: 

A query is placed in the audit log queue, and the AuditLoader does not
reach the refresh time, and the query does not arrive for a long time,
then the previous audit data will remain in the queue until the next
audit data arrives
Co-authored-by: garenshi <garenshi@tencent.com>
@Thearas
Copy link
Contributor

Thearas commented Dec 31, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 31, 2024
@Thearas
Copy link
Contributor

Thearas commented Dec 31, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41041 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 43592d59ee22e71d148ee1096ddc3a97fb023474, data reload: false

------ Round 1 ----------------------------------
q1	17597	7438	7298	7298
q2	2054	163	150	150
q3	10573	1129	1146	1129
q4	10382	730	741	730
q5	7769	2848	2825	2825
q6	238	148	148	148
q7	985	623	597	597
q8	9355	1938	1987	1938
q9	6576	6413	6417	6413
q10	7021	2335	2301	2301
q11	468	259	278	259
q12	401	216	218	216
q13	17761	2984	3058	2984
q14	240	217	222	217
q15	567	526	530	526
q16	676	635	609	609
q17	981	529	575	529
q18	7243	6683	6619	6619
q19	1396	1020	1043	1020
q20	487	209	209	209
q21	4295	3319	3364	3319
q22	1124	1005	1008	1005
Total cold run time: 108189 ms
Total hot run time: 41041 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7283	7231	7265	7231
q2	336	236	229	229
q3	2906	2933	2980	2933
q4	2142	1814	1790	1790
q5	5705	5695	5668	5668
q6	218	136	137	136
q7	2181	1863	1901	1863
q8	3323	3544	3494	3494
q9	8843	8851	8830	8830
q10	3642	3567	3571	3567
q11	603	494	504	494
q12	815	646	625	625
q13	9019	3148	3115	3115
q14	283	276	280	276
q15	564	513	519	513
q16	716	655	652	652
q17	1821	1556	1556	1556
q18	7855	7351	7512	7351
q19	1647	1607	1467	1467
q20	2007	1827	1809	1809
q21	5433	5264	5176	5176
q22	1136	1011	980	980
Total cold run time: 68478 ms
Total hot run time: 59755 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191063 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 43592d59ee22e71d148ee1096ddc3a97fb023474, data reload: false

query1	981	373	364	364
query2	6516	2063	2057	2057
query3	6706	216	222	216
query4	33939	23378	23327	23327
query5	4345	470	461	461
query6	262	185	184	184
query7	4628	323	311	311
query8	294	237	242	237
query9	9739	2691	2687	2687
query10	482	274	275	274
query11	18066	15281	15164	15164
query12	153	99	99	99
query13	1648	436	413	413
query14	9060	7235	6679	6679
query15	243	172	173	172
query16	8103	444	456	444
query17	1617	577	563	563
query18	2131	316	314	314
query19	262	154	152	152
query20	116	108	107	107
query21	62	48	47	47
query22	4468	4222	4186	4186
query23	34502	33901	35790	33901
query24	11837	2900	2891	2891
query25	570	422	415	415
query26	1189	171	172	171
query27	2819	300	299	299
query28	8001	2492	2455	2455
query29	657	443	445	443
query30	332	167	164	164
query31	1120	793	820	793
query32	99	60	62	60
query33	802	304	286	286
query34	941	502	516	502
query35	872	752	732	732
query36	1075	928	944	928
query37	203	82	75	75
query38	3964	4017	3939	3939
query39	1476	1408	1447	1408
query40	230	89	88	88
query41	55	52	50	50
query42	117	106	101	101
query43	522	495	493	493
query44	1304	831	821	821
query45	187	166	172	166
query46	1155	718	729	718
query47	1930	1795	1822	1795
query48	464	384	393	384
query49	1291	402	392	392
query50	804	418	418	418
query51	7295	7053	7098	7053
query52	99	89	90	89
query53	263	191	187	187
query54	1047	478	480	478
query55	84	77	81	77
query56	278	240	259	240
query57	1243	1098	1066	1066
query58	239	216	217	216
query59	3235	3123	2909	2909
query60	281	263	257	257
query61	113	114	114	114
query62	867	703	668	668
query63	217	184	187	184
query64	5230	663	630	630
query65	3290	3213	3200	3200
query66	1288	319	317	317
query67	16065	15575	15408	15408
query68	5039	576	608	576
query69	422	263	262	262
query70	1163	1130	1130	1130
query71	341	257	260	257
query72	6074	4018	4068	4018
query73	769	359	364	359
query74	10327	9052	8881	8881
query75	3375	2649	2623	2623
query76	2951	970	1050	970
query77	437	273	287	273
query78	10474	9627	9598	9598
query79	2556	615	619	615
query80	1168	433	432	432
query81	544	246	243	243
query82	689	118	115	115
query83	218	148	141	141
query84	235	83	75	75
query85	1752	335	307	307
query86	487	303	295	295
query87	4384	4303	4317	4303
query88	4082	2391	2388	2388
query89	403	294	299	294
query90	2182	191	188	188
query91	187	149	161	149
query92	68	53	51	51
query93	1489	576	552	552
query94	1046	310	309	309
query95	375	257	262	257
query96	599	286	287	286
query97	3329	3203	3179	3179
query98	221	203	199	199
query99	1529	1345	1299	1299
Total cold run time: 302388 ms
Total hot run time: 191063 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.55 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 43592d59ee22e71d148ee1096ddc3a97fb023474, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.07	0.07
query4	1.64	0.11	0.10
query5	0.54	0.51	0.53
query6	1.13	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.50	0.49
query10	0.54	0.54	0.55
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.94	3.00	2.94
query15	0.91	0.83	0.81
query16	0.38	0.39	0.39
query17	1.05	1.06	1.08
query18	0.25	0.22	0.22
query19	1.88	1.85	2.03
query20	0.01	0.01	0.02
query21	15.36	0.60	0.60
query22	2.33	2.77	1.68
query23	17.09	0.91	0.84
query24	3.34	0.46	1.52
query25	0.18	0.19	0.10
query26	0.47	0.14	0.13
query27	0.05	0.05	0.05
query28	10.61	1.11	1.07
query29	12.58	3.25	3.26
query30	0.24	0.06	0.06
query31	2.87	0.39	0.38
query32	3.27	0.47	0.47
query33	3.03	3.07	3.02
query34	16.89	4.57	4.52
query35	4.50	4.49	4.56
query36	0.67	0.53	0.51
query37	0.09	0.06	0.05
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.11
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.11 s
Total hot run time: 32.55 s

@yiguolei yiguolei merged commit 987385e into branch-3.0 Dec 31, 2024
21 checks passed
@github-actions github-actions bot deleted the auto-pick-46175-branch-3.0 branch December 31, 2024 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants