Skip to content

Comments

[fix](compatibility) remove cluster prefix in user property info#30078

Merged
yiguolei merged 1 commit intoapache:masterfrom
morningman:user_prop_cluister
Jan 18, 2024
Merged

[fix](compatibility) remove cluster prefix in user property info#30078
yiguolei merged 1 commit intoapache:masterfrom
morningman:user_prop_cluister

Conversation

@morningman
Copy link
Contributor

@morningman morningman commented Jan 17, 2024

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@morningman
Copy link
Contributor Author

morningman commented Jan 17, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jan 17, 2024

TPC-H: Total hot run time: 39136 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e5335879e5376a9858699fd47430667c97c9c344, data reload: false

------ Round 1 ----------------------------------
q1	19162	5441	5395	5395
q2	2549	144	140	140
q3	11263	1214	1181	1181
q4	10581	800	843	800
q5	7743	3118	3164	3118
q6	201	123	124	123
q7	859	499	487	487
q8	9237	1954	1970	1954
q9	7302	6386	6381	6381
q10	8276	3031	3043	3031
q11	417	215	211	211
q12	362	191	192	191
q13	18017	3322	3342	3322
q14	240	221	219	219
q15	548	525	502	502
q16	432	376	370	370
q17	959	483	516	483
q18	7471	6882	6845	6845
q19	1583	1366	1407	1366
q20	601	314	282	282
q21	2786	2475	2425	2425
q22	347	321	310	310
Total cold run time: 110936 ms
Total hot run time: 39136 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5507	5318	5243	5243
q2	328	223	208	208
q3	3335	3251	3248	3248
q4	2124	2065	2075	2065
q5	6102	5896	5902	5896
q6	203	120	119	119
q7	2314	1930	1912	1912
q8	3214	3394	3422	3394
q9	8974	8922	8726	8726
q10	3945	3839	3809	3809
q11	564	485	459	459
q12	795	601	648	601
q13	16927	3150	3121	3121
q14	289	258	266	258
q15	568	507	507	507
q16	515	469	477	469
q17	2322	1878	1848	1848
q18	9381	11117	9515	9515
q19	22951	1542	1519	1519
q20	4602	1950	1952	1950
q21	15678	5531	5449	5449
q22	2760	525	531	525
Total cold run time: 113398 ms
Total hot run time: 60841 ms

@doris-robot
Copy link

doris-robot commented Jan 17, 2024

TPC-DS: Total hot run time: 176844 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e5335879e5376a9858699fd47430667c97c9c344, data reload: false

query1	927	338	338	338
query2	6541	1906	1914	1906
query3	6707	205	199	199
query4	32142	22348	22267	22267
query5	6879	609	610	609
query6	261	171	169	169
query7	4611	271	266	266
query8	222	206	182	182
query9	8375	2604	2601	2601
query10	407	217	215	215
query11	16908	15572	15657	15572
query12	121	70	70	70
query13	1692	379	372	372
query14	10523	7048	6948	6948
query15	204	182	182	182
query16	4605	238	241	238
query17	981	467	479	467
query18	1781	264	250	250
query19	176	139	132	132
query20	71	70	71	70
query21	185	133	132	132
query22	4818	4730	4665	4665
query23	31675	30873	31050	30873
query24	12483	2785	2831	2785
query25	555	331	310	310
query26	1803	142	139	139
query27	3229	270	273	270
query28	7205	1844	1827	1827
query29	2001	636	627	627
query30	292	140	140	140
query31	937	751	742	742
query32	85	50	54	50
query33	711	219	212	212
query34	1151	462	469	462
query35	901	771	763	763
query36	1281	1204	1219	1204
query37	92	59	62	59
query38	3329	3231	3215	3215
query39	1300	1275	1254	1254
query40	336	86	84	84
query41	38	35	35	35
query42	86	84	85	84
query43	517	476	459	459
query44	1063	695	709	695
query45	193	173	177	173
query46	1063	679	647	647
query47	1688	1601	1556	1556
query48	402	328	314	314
query49	1193	283	284	283
query50	689	305	324	305
query51	5310	5199	5209	5199
query52	89	82	84	82
query53	326	255	260	255
query54	910	444	448	444
query55	86	75	77	75
query56	168	171	164	164
query57	1026	955	923	923
query58	187	167	166	166
query59	2949	2718	2565	2565
query60	220	187	186	186
query61	82	83	82	82
query62	633	362	374	362
query63	298	257	276	257
query64	6153	1747	1749	1747
query65	3340	3263	3301	3263
query66	1377	313	314	313
query67	15714	14732	14527	14527
query68	12420	523	549	523
query69	632	311	299	299
query70	1801	1605	1573	1573
query71	553	210	200	200
query72	4851	2834	2815	2815
query73	2963	315	315	315
query74	7059	6329	6448	6329
query75	5129	2360	2294	2294
query76	6139	1044	1050	1044
query77	668	238	234	234
query78	9089	8662	8636	8636
query79	1158	508	513	508
query80	526	326	338	326
query81	452	205	208	205
query82	199	89	82	82
query83	183	117	124	117
query84	276	69	68	68
query85	1073	317	313	313
query86	382	386	428	386
query87	3527	3374	3328	3328
query88	3016	2164	2160	2160
query89	436	349	370	349
query90	1983	190	183	183
query91	163	139	137	137
query92	53	43	46	43
query93	1411	479	432	432
query94	1165	164	162	162
query95	508	457	461	457
query96	625	323	315	315
query97	4250	4125	4181	4125
query98	203	190	178	178
query99	1052	681	704	681
Total cold run time: 298248 ms
Total hot run time: 176844 ms

@doris-robot
Copy link

doris-robot commented Jan 17, 2024

ClickBench: Total hot run time: 30.37 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e5335879e5376a9858699fd47430667c97c9c344, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.02	0.02
query3	0.22	0.06	0.06
query4	1.67	0.07	0.06
query5	0.54	0.53	0.53
query6	1.29	0.63	0.64
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.56	0.48	0.49
query10	0.56	0.56	0.55
query11	0.11	0.10	0.09
query12	0.11	0.10	0.08
query13	0.60	0.60	0.60
query14	0.77	0.80	0.78
query15	0.79	0.77	0.78
query16	0.39	0.37	0.37
query17	1.04	1.01	1.05
query18	0.25	0.24	0.25
query19	1.87	1.79	1.83
query20	0.02	0.01	0.01
query21	15.41	0.58	0.56
query22	2.82	2.50	2.02
query23	17.27	0.80	0.85
query24	2.47	0.50	1.04
query25	0.44	0.16	0.25
query26	0.45	0.15	0.13
query27	0.05	0.05	0.05
query28	11.96	0.77	0.76
query29	12.69	3.11	3.08
query30	0.58	0.49	0.47
query31	2.78	0.34	0.35
query32	3.38	0.49	0.50
query33	3.20	3.23	3.25
query34	15.91	4.22	4.19
query35	4.27	4.17	4.23
query36	1.12	1.07	1.05
query37	0.07	0.05	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.13	0.13
query41	0.08	0.01	0.02
query42	0.02	0.01	0.02
query43	0.03	0.01	0.02
Total cold run time: 106.17 s
Total hot run time: 30.37 s

@doris-robot
Copy link

doris-robot commented Jan 17, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e5335879e5376a9858699fd47430667c97c9c344 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       14.8 seconds inserted 10000000 Rows, about 675K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 17, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Jan 17, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 17, 2024

PR approved by anyone and no changes requested.

@yiguolei yiguolei merged commit 183ca1f into apache:master Jan 18, 2024
yiguolei pushed a commit that referenced this pull request Jan 18, 2024
@morningman @Doris-Extras
[fix](compatibility) remove cluster prefix in user property info (#30078
d20103c 
)
hello-stephen pushed a commit to hello-stephen/doris that referenced this pull request Jan 19, 2024
@morningman
[fix](compatibility) remove cluster prefix in user property info (apa…
09319d1 
…che#30078)
seawinde pushed a commit to seawinde/doris that referenced this pull request Jan 22, 2024
@morningman @seawinde
[fix](compatibility) remove cluster prefix in user property info (apa…
58fe023 
…che#30078)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yiguolei yiguolei yiguolei approved these changes

@Gabriel39 Gabriel39 Gabriel39 approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.0-merged dev/3.0.0-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@morningman @doris-robot @yiguolei @Gabriel39 @dataroaring