Skip to content

branch-3.0 [Fix](Catalog)Standardize the use of authentication attributes in the Catalog to avoid creating a large number of Authenticator objects. (#46107

Merged
morningman merged 1 commit intoapache:branch-3.0from
CalvinKirs:branch-3.0-46052
Dec 27, 2024
Merged

Conversation

@CalvinKirs
Copy link
Copy Markdown
Member

cherry picked from commit cddd290) #46052

…utes in the Catalog to avoid creating a large number of Authenticator objects.

(cherry picked from commit cddd290) apache#46052
@Thearas
Copy link
Copy Markdown
Contributor

Thearas commented Dec 27, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@CalvinKirs
Copy link
Copy Markdown
Member Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 41037 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 220fc68fffebaed2f9546626ba5614c876578420, data reload: false

------ Round 1 ----------------------------------
q1	17591	7444	7271	7271
q2	2051	181	169	169
q3	10565	1093	1156	1093
q4	10531	776	777	776
q5	7751	2942	2772	2772
q6	244	149	146	146
q7	1003	631	600	600
q8	9357	1980	2045	1980
q9	6553	6411	6393	6393
q10	7085	2326	2304	2304
q11	470	268	261	261
q12	417	224	216	216
q13	17803	2995	3001	2995
q14	245	212	223	212
q15	577	536	520	520
q16	684	622	611	611
q17	997	592	626	592
q18	7398	6692	6692	6692
q19	1373	1083	1064	1064
q20	452	206	211	206
q21	4028	3356	3205	3205
q22	1088	959	975	959
Total cold run time: 108263 ms
Total hot run time: 41037 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7189	7238	7262	7238
q2	327	238	239	238
q3	2972	2934	2981	2934
q4	2044	1829	1865	1829
q5	5750	5823	5774	5774
q6	231	142	149	142
q7	2269	1836	1849	1836
q8	3354	3602	3485	3485
q9	8924	8933	8937	8933
q10	3591	3602	3558	3558
q11	592	509	501	501
q12	838	616	638	616
q13	9703	3168	3142	3142
q14	317	292	288	288
q15	583	537	530	530
q16	703	685	668	668
q17	1858	1654	1605	1605
q18	8269	7798	7507	7507
q19	1681	1507	1566	1507
q20	2146	1909	1900	1900
q21	5672	5457	5430	5430
q22	1126	1031	1028	1028
Total cold run time: 70139 ms
Total hot run time: 60689 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 198640 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 220fc68fffebaed2f9546626ba5614c876578420, data reload: false

query1	1256	949	915	915
query2	6277	2173	2148	2148
query3	10827	4257	4241	4241
query4	67062	28911	23680	23680
query5	4958	467	453	453
query6	412	191	167	167
query7	5678	323	311	311
query8	301	218	220	218
query9	9354	2671	2678	2671
query10	470	259	251	251
query11	17682	15423	15870	15423
query12	160	101	96	96
query13	1582	437	444	437
query14	10207	7478	7544	7478
query15	202	183	177	177
query16	7251	488	486	486
query17	1242	566	580	566
query18	1909	324	329	324
query19	251	155	156	155
query20	122	111	116	111
query21	59	47	44	44
query22	4793	4459	4577	4459
query23	35400	34162	35117	34162
query24	6126	2876	2916	2876
query25	500	394	431	394
query26	653	168	167	167
query27	1992	301	293	293
query28	4572	2517	2473	2473
query29	659	462	436	436
query30	248	162	167	162
query31	1005	817	880	817
query32	68	52	53	52
query33	418	277	286	277
query34	935	531	513	513
query35	875	749	718	718
query36	1090	965	974	965
query37	121	72	73	72
query38	4101	4039	4129	4039
query39	1531	1455	1464	1455
query40	155	84	79	79
query41	51	46	48	46
query42	115	96	100	96
query43	564	504	516	504
query44	1202	845	827	827
query45	181	166	168	166
query46	1165	720	720	720
query47	2032	1891	1933	1891
query48	504	390	371	371
query49	718	394	378	378
query50	841	419	426	419
query51	7387	7399	7232	7232
query52	98	90	83	83
query53	263	180	178	178
query54	565	439	450	439
query55	73	76	74	74
query56	256	234	245	234
query57	1269	1089	1092	1089
query58	209	201	197	197
query59	3309	3154	3174	3154
query60	278	250	252	250
query61	105	113	109	109
query62	775	649	673	649
query63	220	193	196	193
query64	1429	722	731	722
query65	3266	3209	3223	3209
query66	635	309	313	309
query67	16118	15653	15763	15653
query68	3317	589	587	587
query69	427	285	265	265
query70	1195	1129	1093	1093
query71	336	252	262	252
query72	6139	4161	4238	4161
query73	756	351	355	351
query74	9966	9069	8955	8955
query75	3361	2608	2697	2608
query76	1840	1077	1040	1040
query77	493	286	309	286
query78	10556	9707	9541	9541
query79	2183	606	605	605
query80	1393	426	415	415
query81	549	244	234	234
query82	1201	121	114	114
query83	260	142	146	142
query84	283	81	77	77
query85	1021	300	293	293
query86	418	308	304	304
query87	4602	4240	4346	4240
query88	3880	2373	2338	2338
query89	420	288	287	287
query90	1814	188	182	182
query91	180	151	147	147
query92	68	50	49	49
query93	2749	545	547	545
query94	758	301	297	297
query95	357	253	249	249
query96	633	278	283	278
query97	3354	3243	3281	3243
query98	214	202	198	198
query99	1623	1313	1311	1311
Total cold run time: 322478 ms
Total hot run time: 198640 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 33.63 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 220fc68fffebaed2f9546626ba5614c876578420, data reload: false

query1	0.03	0.04	0.03
query2	0.08	0.03	0.02
query3	0.22	0.07	0.06
query4	1.62	0.10	0.10
query5	0.53	0.53	0.52
query6	1.13	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.51	0.48
query10	0.56	0.55	0.56
query11	0.14	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.59	0.60
query14	2.93	2.89	2.94
query15	0.90	0.83	0.83
query16	0.39	0.37	0.38
query17	1.07	1.09	1.00
query18	0.23	0.23	0.22
query19	1.98	1.93	1.96
query20	0.01	0.01	0.02
query21	15.37	0.60	0.58
query22	2.79	2.50	2.03
query23	16.80	1.23	0.87
query24	3.50	1.49	2.41
query25	0.26	0.06	0.17
query26	0.58	0.15	0.14
query27	0.05	0.05	0.04
query28	8.86	1.12	1.07
query29	12.58	3.20	3.18
query30	0.24	0.06	0.05
query31	2.87	0.41	0.40
query32	3.23	0.47	0.47
query33	3.01	3.06	3.01
query34	16.83	4.44	4.40
query35	4.58	4.46	4.45
query36	0.68	0.49	0.49
query37	0.10	0.06	0.07
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.15	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.93 s
Total hot run time: 33.63 s

@morningman morningman merged commit 65da965 into apache:branch-3.0 Dec 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants