Skip to content

[enhance](hive)hive event code optimization#42637

Merged
morningman merged 1 commit intoapache:masterfrom
zddr:event_enhance
Oct 28, 2024
Merged

[enhance](hive)hive event code optimization#42637
morningman merged 1 commit intoapache:masterfrom
zddr:event_enhance

Conversation

@zddr
Copy link
Contributor

@zddr zddr commented Oct 28, 2024

hive event code optimization

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Oct 28, 2024

run buildall

Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 28, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 41320 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 859c01b7cd47211154cbb02b8dfea5aa9ebdcc56, data reload: false

------ Round 1 ----------------------------------
q1	17602	7654	7337	7337
q2	2073	159	153	153
q3	10667	1084	1171	1084
q4	10574	878	814	814
q5	7783	3080	3064	3064
q6	233	150	145	145
q7	1034	613	618	613
q8	9593	1955	2035	1955
q9	7317	6445	6471	6445
q10	7019	2444	2451	2444
q11	450	238	238	238
q12	406	220	215	215
q13	17800	3017	3035	3017
q14	252	209	210	209
q15	566	511	521	511
q16	640	577	584	577
q17	971	520	579	520
q18	7290	6789	6708	6708
q19	1337	1030	873	873
q20	496	183	184	183
q21	4068	3339	3193	3193
q22	1115	1023	1022	1022
Total cold run time: 109286 ms
Total hot run time: 41320 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7283	7301	7285	7285
q2	332	227	238	227
q3	3070	2990	2926	2926
q4	2241	1840	1844	1840
q5	5771	5788	5799	5788
q6	223	138	137	137
q7	2297	1818	1831	1818
q8	3393	3443	3506	3443
q9	8965	9020	8859	8859
q10	3601	3600	3561	3561
q11	593	492	494	492
q12	835	616	617	616
q13	8361	3200	3188	3188
q14	322	297	297	297
q15	568	529	528	528
q16	697	639	626	626
q17	1875	1624	1601	1601
q18	8234	7847	7748	7748
q19	1700	1672	1490	1490
q20	2109	1839	1889	1839
q21	5592	5561	5504	5504
q22	1151	1069	1089	1069
Total cold run time: 69213 ms
Total hot run time: 60882 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197839 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 859c01b7cd47211154cbb02b8dfea5aa9ebdcc56, data reload: false

query1	1223	1038	1031	1031
query2	6228	2126	2065	2065
query3	11575	4899	4951	4899
query4	33660	23626	23756	23626
query5	4915	464	447	447
query6	301	181	175	175
query7	3998	298	298	298
query8	298	242	236	236
query9	9456	2768	2733	2733
query10	484	278	246	246
query11	18073	15440	15058	15058
query12	153	104	101	101
query13	1603	453	420	420
query14	9817	7864	7300	7300
query15	259	180	195	180
query16	7920	485	522	485
query17	1599	611	578	578
query18	1555	309	314	309
query19	360	163	169	163
query20	125	115	121	115
query21	206	109	110	109
query22	4762	4790	4213	4213
query23	34843	34380	34173	34173
query24	11347	2871	2821	2821
query25	626	407	420	407
query26	1324	158	163	158
query27	2290	281	291	281
query28	7383	2451	2439	2439
query29	910	416	427	416
query30	255	168	168	168
query31	1001	790	813	790
query32	90	56	57	56
query33	758	279	281	279
query34	940	517	515	515
query35	1032	913	884	884
query36	1130	942	946	942
query37	141	75	78	75
query38	4423	4248	4265	4248
query39	1467	1426	1420	1420
query40	255	102	103	102
query41	48	49	45	45
query42	113	100	99	99
query43	544	485	486	485
query44	1247	816	813	813
query45	183	168	167	167
query46	1144	718	696	696
query47	1956	1862	1891	1862
query48	434	330	325	325
query49	977	409	418	409
query50	823	400	416	400
query51	7127	7068	7082	7068
query52	101	86	92	86
query53	252	179	174	174
query54	1123	388	400	388
query55	79	76	78	76
query56	263	235	235	235
query57	1307	1170	1200	1170
query58	226	203	206	203
query59	3058	2890	2916	2890
query60	272	248	249	248
query61	117	106	100	100
query62	868	677	671	671
query63	212	192	189	189
query64	4857	622	619	619
query65	3298	3221	3254	3221
query66	997	291	295	291
query67	15938	15833	15913	15833
query68	4782	555	555	555
query69	442	259	259	259
query70	1234	1109	1154	1109
query71	310	266	252	252
query72	6108	3986	3956	3956
query73	761	353	363	353
query74	10507	8936	8964	8936
query75	3426	2724	2679	2679
query76	2664	996	1120	996
query77	394	271	274	271
query78	10498	9579	9604	9579
query79	1573	590	608	590
query80	1066	431	416	416
query81	558	242	242	242
query82	996	114	116	114
query83	248	136	141	136
query84	241	66	71	66
query85	1338	302	276	276
query86	372	317	283	283
query87	4804	4621	4692	4621
query88	3197	2259	2201	2201
query89	417	295	293	293
query90	1969	189	188	188
query91	134	100	101	100
query92	58	46	48	46
query93	1806	546	544	544
query94	850	311	294	294
query95	357	251	250	250
query96	625	284	291	284
query97	2944	2713	2715	2713
query98	211	208	193	193
query99	1629	1331	1320	1320
Total cold run time: 302868 ms
Total hot run time: 197839 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 859c01b7cd47211154cbb02b8dfea5aa9ebdcc56, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.02
query3	0.23	0.06	0.06
query4	1.63	0.10	0.10
query5	0.43	0.40	0.40
query6	1.15	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.05	0.03
query9	0.57	0.51	0.49
query10	0.57	0.56	0.55
query11	0.15	0.10	0.11
query12	0.13	0.11	0.10
query13	0.61	0.59	0.60
query14	2.82	2.86	2.75
query15	0.90	0.83	0.83
query16	0.39	0.36	0.38
query17	1.05	1.08	1.05
query18	0.20	0.20	0.20
query19	1.94	1.83	2.01
query20	0.01	0.01	0.01
query21	15.36	0.59	0.58
query22	2.76	1.91	2.34
query23	16.97	1.23	0.76
query24	2.52	1.16	1.36
query25	0.15	0.06	0.25
query26	0.60	0.14	0.14
query27	0.04	0.04	0.04
query28	10.89	1.10	1.07
query29	12.54	3.34	3.36
query30	0.25	0.06	0.05
query31	2.87	0.38	0.38
query32	3.27	0.46	0.46
query33	3.07	2.99	3.05
query34	17.13	4.51	4.54
query35	4.51	4.59	4.56
query36	0.65	0.49	0.51
query37	0.09	0.06	0.06
query38	0.06	0.03	0.03
query39	0.03	0.03	0.02
query40	0.16	0.12	0.13
query41	0.07	0.02	0.03
query42	0.03	0.02	0.02
query43	0.03	0.03	0.04
Total cold run time: 107 s
Total hot run time: 32.96 s

Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morningman morningman merged commit bb124e2 into apache:master Oct 28, 2024
morningman pushed a commit to morningman/doris that referenced this pull request Oct 29, 2024
morningman pushed a commit to morningman/doris that referenced this pull request Oct 29, 2024
morningman added a commit that referenced this pull request Oct 30, 2024
cherry pick from #42637

Co-authored-by: zhangdong <493738387@qq.com>
morningman added a commit that referenced this pull request Oct 30, 2024
cherry pick from #42637

Co-authored-by: zhangdong <493738387@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.x dev/2.1.7-merged dev/3.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants