Skip to content

[fix](script) Fix start_fe.sh missing METADATA_FAILURE_RECOVERY with foreground (#31258)#33367

Merged
dataroaring merged 1 commit intoapache:branch-2.0from
swjtu-zhanglei:branch-2.0-pick1
Apr 10, 2024
Merged

[fix](script) Fix start_fe.sh missing METADATA_FAILURE_RECOVERY with foreground (#31258)#33367
dataroaring merged 1 commit intoapache:branch-2.0from
swjtu-zhanglei:branch-2.0-pick1

Conversation

@swjtu-zhanglei
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@swjtu-zhanglei
Copy link
Contributor Author

#31258

@swjtu-zhanglei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49925 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 81ac38f4bedadd98c0223546a5a5d6c2b8161dbe, data reload: false

------ Round 1 ----------------------------------
q1	17589	4376	4337	4337
q2	2047	154	148	148
q3	10295	1877	1892	1877
q4	10105	1227	1300	1227
q5	8443	3996	3976	3976
q6	227	121	124	121
q7	2043	1610	1588	1588
q8	9327	2711	2715	2711
q9	10826	10370	10534	10370
q10	8648	3544	3534	3534
q11	429	231	242	231
q12	463	305	300	300
q13	18345	3995	4034	3995
q14	347	328	335	328
q15	523	462	449	449
q16	708	591	591	591
q17	1129	933	956	933
q18	7405	6946	6846	6846
q19	1690	1572	1546	1546
q20	553	304	316	304
q21	4415	4116	4151	4116
q22	505	401	397	397
Total cold run time: 116062 ms
Total hot run time: 49925 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4296	4278	4330	4278
q2	320	224	221	221
q3	4124	4135	4113	4113
q4	2761	2774	2739	2739
q5	7268	7137	7196	7137
q6	232	123	117	117
q7	3237	2891	2889	2889
q8	4336	4455	4457	4455
q9	17024	16803	17016	16803
q10	4250	4251	4281	4251
q11	766	702	695	695
q12	1030	854	870	854
q13	6776	3772	3766	3766
q14	444	438	430	430
q15	506	456	460	456
q16	762	698	698	698
q17	3914	3870	3810	3810
q18	8750	8831	8800	8800
q19	1701	1715	1668	1668
q20	2368	2147	2128	2128
q21	8578	8434	8511	8434
q22	1011	984	902	902
Total cold run time: 84454 ms
Total hot run time: 79644 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 200815 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 81ac38f4bedadd98c0223546a5a5d6c2b8161dbe, data reload: false

query1	913	387	384	384
query2	6544	2236	2018	2018
query3	6924	200	197	197
query4	20093	17979	18156	17979
query5	19727	6530	6455	6455
query6	302	214	232	214
query7	4211	300	305	300
query8	267	237	230	230
query9	3111	2726	2631	2631
query10	422	275	314	275
query11	11328	10680	10670	10670
query12	125	80	68	68
query13	5589	668	648	648
query14	18081	13287	13070	13070
query15	384	235	227	227
query16	6466	270	254	254
query17	1750	1483	865	865
query18	2322	416	407	407
query19	204	150	153	150
query20	74	76	75	75
query21	185	90	90	90
query22	5290	5044	4984	4984
query23	32449	32146	31808	31808
query24	7029	6561	6540	6540
query25	538	422	425	422
query26	617	161	159	159
query27	2027	301	293	293
query28	6145	2284	2261	2261
query29	2853	2830	2786	2786
query30	242	163	162	162
query31	901	722	721	721
query32	69	61	55	55
query33	388	265	251	251
query34	866	459	490	459
query35	1110	867	917	867
query36	1187	1216	1434	1216
query37	90	60	61	60
query38	3056	2969	2921	2921
query39	1355	1312	1316	1312
query40	195	95	94	94
query41	34	32	32	32
query42	84	86	81	81
query43	671	566	554	554
query44	1127	718	717	717
query45	241	225	224	224
query46	1228	1003	964	964
query47	1805	1806	1931	1806
query48	976	679	674	674
query49	618	363	373	363
query50	855	588	599	588
query51	4805	4652	4600	4600
query52	96	72	73	72
query53	439	313	321	313
query54	2636	2469	2470	2469
query55	82	82	86	82
query56	216	199	202	199
query57	1172	1113	1059	1059
query58	204	176	200	176
query59	3540	3145	3065	3065
query60	226	186	193	186
query61	85	84	88	84
query62	848	492	479	479
query63	473	337	336	336
query64	2444	1503	1343	1343
query65	3625	3568	3525	3525
query66	790	363	364	363
query67	17344	15554	17245	15554
query68	8322	660	691	660
query69	551	329	356	329
query70	1654	1410	1432	1410
query71	387	303	300	300
query72	6540	3430	3441	3430
query73	742	327	322	322
query74	6327	5890	5778	5778
query75	4874	3563	3611	3563
query76	4914	1170	1201	1170
query77	710	253	243	243
query78	12474	11484	11422	11422
query79	7213	642	640	640
query80	1024	404	412	404
query81	497	232	228	228
query82	1493	110	98	98
query83	168	143	128	128
query84	258	69	67	67
query85	852	294	282	282
query86	335	302	338	302
query87	3231	3020	3019	3019
query88	4810	2376	2376	2376
query89	357	274	268	268
query90	1902	208	205	205
query91	150	123	116	116
query92	60	56	54	54
query93	5064	590	595	590
query94	730	206	204	204
query95	1106	1051	1066	1051
query96	640	337	331	331
query97	6509	6279	6428	6279
query98	187	169	172	169
query99	2895	891	978	891
Total cold run time: 309069 ms
Total hot run time: 200815 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.97 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 81ac38f4bedadd98c0223546a5a5d6c2b8161dbe, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.05
query4	1.80	0.07	0.07
query5	0.53	0.53	0.52
query6	1.23	0.60	0.60
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.53	0.49	0.47
query10	0.52	0.53	0.53
query11	0.12	0.08	0.09
query12	0.12	0.09	0.10
query13	0.63	0.61	0.61
query14	0.79	0.78	0.80
query15	0.78	0.75	0.75
query16	0.37	0.36	0.36
query17	1.00	1.02	1.02
query18	0.23	0.27	0.25
query19	1.94	1.87	1.82
query20	0.01	0.01	0.01
query21	15.49	0.56	0.56
query22	2.23	1.76	1.98
query23	17.08	0.93	0.96
query24	6.92	1.25	1.12
query25	0.41	0.08	0.06
query26	0.75	0.15	0.16
query27	0.05	0.04	0.04
query28	5.94	0.73	0.76
query29	12.67	2.27	2.32
query30	0.57	0.49	0.52
query31	2.80	0.39	0.38
query32	3.45	0.50	0.49
query33	3.08	3.05	3.05
query34	15.25	4.78	4.78
query35	4.89	4.83	4.83
query36	1.05	1.00	1.01
query37	0.05	0.05	0.04
query38	0.02	0.02	0.02
query39	0.01	0.02	0.01
query40	0.17	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.99 s
Total hot run time: 30.97 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 81ac38f4bedadd98c0223546a5a5d6c2b8161dbe with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.7 seconds inserted 10000000 Rows, about 483K ops/s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Apr 9, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 9, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Apr 9, 2024

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit b7ebbd8 into apache:branch-2.0 Apr 10, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants