Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[profile](name) add table rollup name in profile #33137

Merged
merged 2 commits into from Apr 2, 2024

Conversation

zhangstar333
Copy link
Contributor

Proposed changes

add select rollup name in profile, eg:

  VNewOlapScanNode(baseall(test_rollup_name))  (id=0):(Active:  179.574us,  %  non-child:  0.00%)
        -  RuntimeFilters:  :  
        -  PushDownPredicates:  []

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zhangstar333
Copy link
Contributor Author

run buildall

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39206 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 27db5b490adb0735a748b94ef2fd2da55a11b83d, data reload: false

------ Round 1 ----------------------------------
q1	18876	4121	4044	4044
q2	2018	189	180	180
q3	10477	1266	1410	1266
q4	10211	917	1015	917
q5	7451	2933	2919	2919
q6	217	136	134	134
q7	1106	611	623	611
q8	9431	1970	2028	1970
q9	7376	6726	6729	6726
q10	8421	3498	3509	3498
q11	418	243	235	235
q12	385	219	209	209
q13	17763	2894	2928	2894
q14	284	250	236	236
q15	519	492	469	469
q16	501	380	374	374
q17	966	929	912	912
q18	7279	6560	6414	6414
q19	1607	1528	1527	1527
q20	620	327	320	320
q21	3525	3039	3060	3039
q22	368	312	313	312
Total cold run time: 109819 ms
Total hot run time: 39206 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4058	4044	4044	4044
q2	338	219	219	219
q3	2935	2938	2960	2938
q4	1862	1835	1814	1814
q5	5243	5204	5219	5204
q6	207	125	122	122
q7	2238	1824	1804	1804
q8	3198	3292	3250	3250
q9	9085	9105	9069	9069
q10	3742	3815	3799	3799
q11	563	461	447	447
q12	731	550	547	547
q13	16741	2895	2886	2886
q14	287	266	277	266
q15	509	476	474	474
q16	450	400	399	399
q17	1707	1704	1672	1672
q18	7652	7160	7188	7160
q19	1633	1631	1634	1631
q20	1960	1722	1699	1699
q21	5012	4755	4757	4755
q22	489	422	450	422
Total cold run time: 70640 ms
Total hot run time: 54621 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 180463 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 27db5b490adb0735a748b94ef2fd2da55a11b83d, data reload: false

query1	883	1124	1110	1110
query2	6495	1822	1706	1706
query3	6664	216	215	215
query4	24911	21240	21478	21240
query5	4245	413	408	408
query6	270	190	174	174
query7	4615	300	297	297
query8	233	180	176	176
query9	8479	2224	2258	2224
query10	598	258	260	258
query11	15018	14449	14325	14325
query12	160	105	93	93
query13	1645	384	383	383
query14	8520	6762	6709	6709
query15	217	174	183	174
query16	7114	272	277	272
query17	1000	593	577	577
query18	1894	291	277	277
query19	208	165	160	160
query20	97	95	100	95
query21	202	130	127	127
query22	5035	4896	4909	4896
query23	33809	32618	32621	32618
query24	12710	3183	3138	3138
query25	705	400	405	400
query26	1908	175	163	163
query27	3046	327	320	320
query28	6836	1826	1820	1820
query29	1306	599	589	589
query30	302	150	147	147
query31	999	730	749	730
query32	99	65	62	62
query33	719	254	251	251
query34	1054	488	485	485
query35	841	697	711	697
query36	1005	879	877	877
query37	275	78	77	77
query38	3523	3395	3331	3331
query39	1573	1547	1527	1527
query40	298	138	137	137
query41	47	46	47	46
query42	112	103	102	102
query43	440	409	398	398
query44	1080	703	698	698
query45	276	265	242	242
query46	1085	807	781	781
query47	1924	1853	1854	1853
query48	370	310	299	299
query49	1164	365	367	365
query50	792	388	393	388
query51	6806	6711	6739	6711
query52	107	99	96	96
query53	361	291	288	288
query54	328	239	248	239
query55	102	83	78	78
query56	247	235	230	230
query57	1257	1141	1130	1130
query58	265	223	221	221
query59	2464	2472	2254	2254
query60	264	247	249	247
query61	111	109	109	109
query62	687	459	452	452
query63	311	286	291	286
query64	6600	3200	3338	3200
query65	3082	3004	2994	2994
query66	1439	330	325	325
query67	15604	14903	14822	14822
query68	8888	564	581	564
query69	538	333	328	328
query70	1258	1127	1101	1101
query71	500	279	267	267
query72	6356	2570	2403	2403
query73	948	322	317	317
query74	6758	6318	6405	6318
query75	3648	2292	2267	2267
query76	5130	1109	1171	1109
query77	607	248	265	248
query78	11043	10052	10044	10044
query79	9933	534	536	534
query80	1515	434	444	434
query81	499	228	227	227
query82	722	102	106	102
query83	218	161	163	161
query84	272	91	92	91
query85	1447	300	290	290
query86	424	271	279	271
query87	3653	3469	3446	3446
query88	3797	2282	2282	2282
query89	558	375	368	368
query90	2001	175	189	175
query91	140	110	108	108
query92	65	53	53	53
query93	6925	554	531	531
query94	1227	197	202	197
query95	440	334	347	334
query96	607	272	268	268
query97	2676	2527	2461	2461
query98	246	222	213	213
query99	1330	863	832	832
Total cold run time: 301205 ms
Total hot run time: 180463 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 27db5b490adb0735a748b94ef2fd2da55a11b83d, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.07
query5	0.48	0.48	0.50
query6	1.13	0.66	0.66
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.57	0.51	0.52
query10	0.56	0.57	0.57
query11	0.15	0.11	0.12
query12	0.13	0.11	0.12
query13	0.63	0.60	0.60
query14	0.77	0.78	0.80
query15	0.86	0.85	0.85
query16	0.35	0.36	0.36
query17	0.97	0.97	0.99
query18	0.24	0.25	0.25
query19	1.82	1.77	1.76
query20	0.01	0.02	0.01
query21	15.41	0.79	0.72
query22	3.05	6.43	1.54
query23	17.61	1.30	1.13
query24	1.49	0.22	0.23
query25	0.12	0.10	0.09
query26	0.27	0.16	0.19
query27	0.09	0.09	0.08
query28	13.82	0.99	0.92
query29	12.60	3.39	3.34
query30	0.26	0.06	0.06
query31	2.85	0.39	0.38
query32	3.27	0.49	0.47
query33	2.89	2.87	2.92
query34	15.54	4.35	4.32
query35	4.38	4.36	4.36
query36	0.67	0.47	0.48
query37	0.19	0.18	0.16
query38	0.18	0.16	0.17
query39	0.05	0.04	0.04
query40	0.18	0.15	0.15
query41	0.10	0.05	0.05
query42	0.06	0.05	0.06
query43	0.05	0.05	0.05
Total cold run time: 105.89 s
Total hot run time: 30.05 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 27db5b490adb0735a748b94ef2fd2da55a11b83d with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       16.8 seconds inserted 10000000 Rows, about 595K ops/s

Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 2, 2024
Copy link
Contributor

github-actions bot commented Apr 2, 2024

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Apr 2, 2024

PR approved by anyone and no changes requested.

Copy link
Contributor

@yiguolei yiguolei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@xinyiZzz xinyiZzz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@HappenLee HappenLee merged commit 108f4fd into apache:master Apr 2, 2024
30 of 32 checks passed
@yiguolei yiguolei mentioned this pull request Apr 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.x reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants