Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[enhance](auth)node priv can show proc #32751

Merged
merged 2 commits into from
Mar 26, 2024
Merged

[enhance](auth)node priv can show proc #32751

merged 2 commits into from
Mar 26, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Mar 25, 2024

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Mar 25, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37884 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c76bf4d0388191e6eb4342feb5a1c23014da9c4b, data reload: false

------ Round 1 ----------------------------------
q1	17701	4299	4117	4117
q2	2106	157	148	148
q3	10670	1100	1177	1100
q4	10263	764	723	723
q5	7457	3005	3003	3003
q6	198	125	122	122
q7	1013	579	574	574
q8	9330	1959	1984	1959
q9	7099	6561	6561	6561
q10	8368	3465	3562	3465
q11	428	225	210	210
q12	379	196	194	194
q13	17841	2885	2846	2846
q14	234	207	200	200
q15	504	465	455	455
q16	497	368	363	363
q17	945	558	552	552
q18	7146	6411	6391	6391
q19	2727	1493	1404	1404
q20	559	248	260	248
q21	3494	2956	2960	2956
q22	346	293	302	293
Total cold run time: 109305 ms
Total hot run time: 37884 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4116	4053	4084	4053
q2	328	232	229	229
q3	2953	2860	2802	2802
q4	1831	1525	1552	1525
q5	5267	5319	5340	5319
q6	194	116	120	116
q7	2209	1840	1817	1817
q8	3163	3328	3248	3248
q9	8706	8686	8693	8686
q10	3758	3772	3714	3714
q11	546	463	439	439
q12	708	534	557	534
q13	16905	2848	2843	2843
q14	281	245	253	245
q15	491	452	459	452
q16	473	410	410	410
q17	1731	1476	1468	1468
q18	7526	7141	6999	6999
q19	1623	1500	1544	1500
q20	1891	1717	1669	1669
q21	4860	4675	4650	4650
q22	505	424	433	424
Total cold run time: 70065 ms
Total hot run time: 53142 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185639 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c76bf4d0388191e6eb4342feb5a1c23014da9c4b, data reload: false

query1	926	365	358	358
query2	7367	1970	2059	1970
query3	6717	213	209	209
query4	31672	20981	21030	20981
query5	4328	412	396	396
query6	269	178	164	164
query7	4616	286	281	281
query8	227	172	168	168
query9	9352	2257	2222	2222
query10	551	228	246	228
query11	17416	14128	14159	14128
query12	130	89	85	85
query13	1623	414	426	414
query14	12141	11427	11262	11262
query15	261	203	184	184
query16	8238	262	258	258
query17	1996	581	544	544
query18	2102	288	277	277
query19	344	157	157	157
query20	94	88	88	88
query21	211	125	128	125
query22	5080	4855	4751	4751
query23	33229	32823	32640	32640
query24	10798	2808	2787	2787
query25	609	348	370	348
query26	1393	147	146	146
query27	2947	334	341	334
query28	7381	1821	1841	1821
query29	885	646	594	594
query30	303	143	141	141
query31	947	727	718	718
query32	93	55	55	55
query33	762	327	244	244
query34	951	482	473	473
query35	807	631	609	609
query36	1040	858	884	858
query37	122	76	73	73
query38	3544	3444	3381	3381
query39	1440	1425	1419	1419
query40	216	110	109	109
query41	51	46	45	45
query42	106	90	93	90
query43	486	436	443	436
query44	1231	706	697	697
query45	275	267	264	264
query46	1111	676	684	676
query47	1879	1830	1817	1817
query48	424	353	342	342
query49	1085	330	316	316
query50	753	368	362	362
query51	6750	6639	6659	6639
query52	105	88	94	88
query53	342	274	271	271
query54	297	233	247	233
query55	80	84	81	81
query56	240	225	240	225
query57	1194	1125	1134	1125
query58	240	209	210	209
query59	2744	2801	2624	2624
query60	282	257	257	257
query61	116	113	115	113
query62	649	459	475	459
query63	309	280	279	279
query64	5871	4178	4118	4118
query65	3208	3039	3037	3037
query66	1469	372	380	372
query67	15460	14703	14947	14703
query68	5677	508	514	508
query69	593	377	371	371
query70	1199	1198	1153	1153
query71	453	276	283	276
query72	7173	2881	2601	2601
query73	705	313	318	313
query74	8160	6639	6634	6634
query75	3684	2821	2858	2821
query76	4236	913	877	877
query77	609	255	273	255
query78	10877	10068	10302	10068
query79	10314	518	524	518
query80	2048	402	387	387
query81	552	210	215	210
query82	1607	199	202	199
query83	293	144	141	141
query84	290	82	80	80
query85	1640	316	315	315
query86	480	287	302	287
query87	3718	3503	3527	3503
query88	5084	2283	2284	2283
query89	530	367	381	367
query90	2016	179	176	176
query91	174	134	139	134
query92	59	46	48	46
query93	7347	500	481	481
query94	1281	179	178	178
query95	426	322	324	322
query96	606	266	269	266
query97	3119	2881	2856	2856
query98	234	226	207	207
query99	1262	929	928	928
Total cold run time: 316331 ms
Total hot run time: 185639 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c76bf4d0388191e6eb4342feb5a1c23014da9c4b with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       20.8 seconds inserted 10000000 Rows, about 480K ops/s

@zddr
Copy link
Contributor Author

zddr commented Mar 25, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38341 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 831734ea43da415e0b1f087acd5d28641779630c, data reload: false

------ Round 1 ----------------------------------
q1	18759	4300	4142	4142
q2	2108	150	147	147
q3	10600	1109	1234	1109
q4	10229	778	789	778
q5	7486	3062	2991	2991
q6	208	127	126	126
q7	1037	612	579	579
q8	9344	2057	2021	2021
q9	7093	6664	6661	6661
q10	8383	3469	3552	3469
q11	427	234	224	224
q12	382	203	197	197
q13	18031	3029	2850	2850
q14	231	199	206	199
q15	505	465	463	463
q16	499	385	369	369
q17	969	644	590	590
q18	7287	6566	6572	6566
q19	7230	1455	1522	1455
q20	546	279	256	256
q21	3657	2927	2858	2858
q22	337	293	291	291
Total cold run time: 115348 ms
Total hot run time: 38341 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4166	4110	4108	4108
q2	332	236	236	236
q3	3016	2816	2852	2816
q4	1826	1551	1583	1551
q5	5270	5338	5373	5338
q6	195	121	120	120
q7	2236	1880	1848	1848
q8	3200	3315	3331	3315
q9	8775	8727	8766	8727
q10	3780	3767	3795	3767
q11	559	453	447	447
q12	719	546	588	546
q13	16899	2851	2873	2851
q14	278	274	243	243
q15	500	460	459	459
q16	477	418	418	418
q17	1761	1499	1489	1489
q18	7453	7357	7215	7215
q19	1666	1560	1492	1492
q20	1899	1715	1700	1700
q21	4896	4630	4691	4630
q22	523	440	449	440
Total cold run time: 70426 ms
Total hot run time: 53756 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186481 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 831734ea43da415e0b1f087acd5d28641779630c, data reload: false

query1	944	383	374	374
query2	7386	2004	1956	1956
query3	6730	209	208	208
query4	32101	21277	21223	21223
query5	4411	406	388	388
query6	271	174	169	169
query7	4634	300	294	294
query8	238	176	184	176
query9	9004	2296	2282	2282
query10	566	251	255	251
query11	17250	14593	14414	14414
query12	132	92	84	84
query13	1627	424	421	421
query14	11951	10922	10978	10922
query15	285	214	188	188
query16	8242	266	253	253
query17	1978	613	551	551
query18	2107	295	285	285
query19	360	153	152	152
query20	94	89	90	89
query21	201	131	128	128
query22	4982	4842	4777	4777
query23	33154	32929	33064	32929
query24	10743	2849	2901	2849
query25	633	387	387	387
query26	1407	156	156	156
query27	2978	348	355	348
query28	7475	1820	1852	1820
query29	906	677	626	626
query30	304	149	147	147
query31	980	738	739	738
query32	104	60	57	57
query33	767	260	247	247
query34	1052	500	472	472
query35	818	621	608	608
query36	1027	879	884	879
query37	117	77	77	77
query38	3556	3475	3446	3446
query39	1480	1461	1425	1425
query40	209	115	120	115
query41	52	48	52	48
query42	105	98	100	98
query43	471	438	452	438
query44	1192	742	721	721
query45	292	254	273	254
query46	1130	695	685	685
query47	1920	1850	1857	1850
query48	460	358	375	358
query49	1112	332	348	332
query50	773	373	369	369
query51	6679	6642	6643	6642
query52	104	91	93	91
query53	346	279	277	277
query54	309	256	263	256
query55	90	80	81	80
query56	263	235	234	234
query57	1203	1126	1131	1126
query58	251	216	220	216
query59	2884	2628	2526	2526
query60	292	262	277	262
query61	126	125	124	124
query62	668	453	460	453
query63	310	282	284	282
query64	6324	4035	4052	4035
query65	3083	3018	3050	3018
query66	1418	374	363	363
query67	15688	14721	14664	14664
query68	9070	523	524	523
query69	621	370	375	370
query70	1381	1171	1078	1078
query71	540	289	275	275
query72	6644	2728	2554	2554
query73	1680	311	311	311
query74	7486	6621	6710	6621
query75	4513	2836	2816	2816
query76	5363	921	911	911
query77	658	272	253	253
query78	11006	10160	10147	10147
query79	12942	533	521	521
query80	2180	394	397	394
query81	517	215	213	213
query82	806	209	204	204
query83	227	140	141	140
query84	291	78	82	78
query85	1561	350	311	311
query86	413	293	285	285
query87	3698	3526	3550	3526
query88	4992	2292	2294	2292
query89	515	369	374	369
query90	1992	180	178	178
query91	172	137	158	137
query92	59	47	50	47
query93	7089	500	482	482
query94	1250	175	175	175
query95	425	330	317	317
query96	616	274	268	268
query97	3067	2894	2858	2858
query98	247	215	205	205
query99	1270	937	909	909
Total cold run time: 324040 ms
Total hot run time: 186481 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 831734ea43da415e0b1f087acd5d28641779630c with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s

morningman
morningman approved these changes Mar 25, 2024
View reviewed changes
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Mar 25, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@CalvinKirs CalvinKirs merged commit fbd8346 into apache:master Mar 26, 2024
27 of 30 checks passed
zddr added a commit to zddr/incubator-doris that referenced this pull request Mar 26, 2024
@zddr
[enhance](auth)node priv can show proc (apache#32751)
a176d08
@zddr zddr mentioned this pull request Mar 26, 2024
Merged
yiguolei pushed a commit that referenced this pull request Mar 26, 2024
@zddr @Doris-Extras
[enhance](auth)node priv can show proc (#32751)
3658dfd
morningman pushed a commit that referenced this pull request Mar 27, 2024
@zddr
[branch-2.0](cherry-pick)node priv can show proc #32751 (#32826)
4d80df1 
pick #32751
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@zddr
[branch-2.0](cherry-pick)node priv can show proc apache#32751 (apache…
9dbe0d3 
…#32826)

pick apache#32751
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@CalvinKirs CalvinKirs CalvinKirs approved these changes

@morningman morningman morningman approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.8-merged dev/2.1.1-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@zddr @doris-robot @morningman @CalvinKirs