Skip to content

[fix](hudi) move wrong members in HMSExternalTable #36187#36282

Merged
morningman merged 2 commits intoapache:masterfrom
morningman:hudi_fix
Jun 17, 2024
Merged

[fix](hudi) move wrong members in HMSExternalTable #36187#36282
morningman merged 2 commits intoapache:masterfrom
morningman:hudi_fix

Conversation

@morningman
Copy link
Contributor

pick from branch-2.1 #36187

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morningman
Copy link
Contributor Author

run buildall

1 similar comment
@morningman
Copy link
Contributor Author

run buildall

@morningman
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40194 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c050d2cc1171f2e78c873cdf6340c285c0c3a85a, data reload: false

------ Round 1 ----------------------------------
q1	17896	4569	4587	4569
q2	2536	201	187	187
q3	11765	1074	1163	1074
q4	10597	860	864	860
q5	7510	2722	2667	2667
q6	227	139	135	135
q7	967	622	609	609
q8	9452	2057	2076	2057
q9	9003	6433	6482	6433
q10	8953	3690	3670	3670
q11	438	237	234	234
q12	406	234	224	224
q13	17760	3022	3012	3012
q14	262	222	219	219
q15	514	470	470	470
q16	524	377	368	368
q17	957	681	788	681
q18	8067	7681	7523	7523
q19	6252	1506	1410	1410
q20	650	317	333	317
q21	4790	3144	3232	3144
q22	385	331	336	331
Total cold run time: 119911 ms
Total hot run time: 40194 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4337	4291	4216	4216
q2	370	256	268	256
q3	2925	2666	2715	2666
q4	1865	1653	1680	1653
q5	5236	5260	5228	5228
q6	209	125	130	125
q7	2087	1751	1750	1750
q8	3178	3311	3277	3277
q9	8333	8290	8317	8290
q10	3838	3622	3631	3622
q11	564	486	490	486
q12	787	594	622	594
q13	16573	2995	3009	2995
q14	287	267	256	256
q15	515	479	468	468
q16	490	434	425	425
q17	1780	1487	1463	1463
q18	7618	7459	7258	7258
q19	3497	1649	1569	1569
q20	1949	1776	1763	1763
q21	4896	4680	4825	4680
q22	603	539	539	539
Total cold run time: 71937 ms
Total hot run time: 53579 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173994 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c050d2cc1171f2e78c873cdf6340c285c0c3a85a, data reload: false

query1	937	388	365	365
query2	6446	2387	2340	2340
query3	6652	204	207	204
query4	19017	17484	17401	17401
query5	4168	488	472	472
query6	266	159	158	158
query7	4618	299	299	299
query8	346	280	282	280
query9	8482	2469	2446	2446
query10	628	309	293	293
query11	10521	10076	9990	9990
query12	137	88	87	87
query13	1654	387	374	374
query14	10163	7457	7449	7449
query15	233	188	191	188
query16	7662	263	269	263
query17	1872	541	541	541
query18	1661	280	273	273
query19	205	152	158	152
query20	95	84	85	84
query21	215	125	131	125
query22	4492	4115	4056	4056
query23	33676	33030	33079	33030
query24	11947	2851	2787	2787
query25	665	359	356	356
query26	1716	153	156	153
query27	2921	315	318	315
query28	7506	2058	2053	2053
query29	1041	623	622	622
query30	293	146	148	146
query31	944	736	748	736
query32	96	56	57	56
query33	760	335	283	283
query34	880	494	471	471
query35	763	614	612	612
query36	1099	985	927	927
query37	162	73	72	72
query38	2876	2762	2730	2730
query39	849	785	803	785
query40	277	129	121	121
query41	54	52	51	51
query42	125	97	106	97
query43	607	554	572	554
query44	1246	724	736	724
query45	201	168	167	167
query46	1090	719	709	709
query47	1848	1785	1769	1769
query48	378	296	306	296
query49	1166	418	416	416
query50	781	386	393	386
query51	6839	6726	6688	6688
query52	108	89	98	89
query53	355	326	297	297
query54	893	442	448	442
query55	78	74	74	74
query56	284	264	271	264
query57	1132	1039	1035	1035
query58	257	251	260	251
query59	3395	3313	3291	3291
query60	301	282	282	282
query61	95	92	91	91
query62	668	441	445	441
query63	316	299	293	293
query64	9892	2248	1749	1749
query65	3163	3103	3092	3092
query66	1321	336	346	336
query67	15427	14973	15234	14973
query68	4594	535	547	535
query69	459	343	309	309
query70	1113	1140	1124	1124
query71	400	284	276	276
query72	7038	5597	5542	5542
query73	741	327	326	326
query74	6000	5506	5588	5506
query75	3567	2699	2670	2670
query76	2689	1007	919	919
query77	452	311	313	311
query78	10423	10008	9648	9648
query79	2644	514	512	512
query80	1397	493	481	481
query81	598	221	222	221
query82	743	101	112	101
query83	281	178	181	178
query84	260	88	93	88
query85	1735	343	325	325
query86	490	312	322	312
query87	3254	3071	3071	3071
query88	3978	2459	2450	2450
query89	475	406	394	394
query90	1794	197	206	197
query91	146	110	114	110
query92	64	52	52	52
query93	1719	512	508	508
query94	1268	205	200	200
query95	426	329	329	329
query96	600	272	273	272
query97	3253	3014	3027	3014
query98	224	216	201	201
query99	1221	860	860	860
Total cold run time: 275007 ms
Total hot run time: 173994 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c050d2cc1171f2e78c873cdf6340c285c0c3a85a, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.04
query4	1.70	0.09	0.10
query5	0.50	0.51	0.51
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.53	0.50	0.49
query10	0.56	0.54	0.54
query11	0.16	0.10	0.12
query12	0.15	0.12	0.11
query13	0.59	0.58	0.60
query14	0.78	0.79	0.78
query15	0.84	0.80	0.80
query16	0.37	0.37	0.37
query17	1.05	0.99	1.05
query18	0.20	0.25	0.25
query19	1.82	1.82	1.81
query20	0.01	0.00	0.01
query21	15.42	0.67	0.67
query22	4.40	7.22	1.62
query23	18.28	1.38	1.26
query24	2.26	0.21	0.22
query25	0.15	0.09	0.08
query26	0.26	0.18	0.17
query27	0.07	0.09	0.08
query28	13.17	1.03	1.01
query29	12.61	3.31	3.30
query30	0.25	0.06	0.06
query31	2.87	0.39	0.37
query32	3.30	0.46	0.47
query33	2.94	2.90	2.94
query34	17.13	4.41	4.42
query35	4.51	4.46	4.48
query36	0.65	0.46	0.47
query37	0.18	0.16	0.16
query38	0.15	0.14	0.14
query39	0.04	0.04	0.03
query40	0.16	0.14	0.14
query41	0.10	0.04	0.04
query42	0.05	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.8 s
Total hot run time: 30.42 s

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jun 15, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman morningman merged commit 50eaf23 into apache:master Jun 17, 2024
dataroaring pushed a commit that referenced this pull request Jun 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.4-merged dev/3.0.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants