Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[opt](Nereids) add job, analyze, load and cancel statements syntax #40203

Merged
merged 1 commit into from
Sep 2, 2024
Merged

[opt](Nereids) add job, analyze, load and cancel statements syntax #40203

merged 1 commit into from
Sep 2, 2024

Conversation

morrySnow
Copy link
Contributor

No description provided.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37890 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e54a7f3a9f93149fb52cefd38ca7b38280217037, data reload: false

------ Round 1 ----------------------------------
q1	17608	4364	4290	4290
q2	2020	182	174	174
q3	11876	927	1153	927
q4	10515	742	730	730
q5	7761	2817	2804	2804
q6	226	137	141	137
q7	964	609	603	603
q8	9326	2061	2062	2061
q9	7222	6513	6510	6510
q10	6995	2236	2158	2158
q11	448	240	245	240
q12	390	227	228	227
q13	17756	3072	3027	3027
q14	277	235	241	235
q15	518	499	486	486
q16	592	510	501	501
q17	967	687	644	644
q18	7339	6823	6866	6823
q19	1391	1006	1135	1006
q20	714	326	338	326
q21	3881	2958	3108	2958
q22	1116	1023	1032	1023
Total cold run time: 109902 ms
Total hot run time: 37890 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4982	4361	4257	4257
q2	387	279	283	279
q3	2860	2630	2645	2630
q4	1912	1637	1633	1633
q5	5610	5654	5670	5654
q6	223	139	148	139
q7	2216	1797	1839	1797
q8	3330	3465	3437	3437
q9	8880	8857	8775	8775
q10	3542	3370	3393	3370
q11	612	518	519	518
q12	820	653	685	653
q13	15093	3229	3253	3229
q14	328	301	289	289
q15	556	492	487	487
q16	637	580	574	574
q17	1844	1585	1533	1533
q18	8148	7761	7902	7761
q19	1736	1618	1498	1498
q20	2163	1926	1909	1909
q21	5759	5513	5595	5513
q22	1167	1082	1045	1045
Total cold run time: 72805 ms
Total hot run time: 56980 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193306 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e54a7f3a9f93149fb52cefd38ca7b38280217037, data reload: false

query1	1264	885	877	877
query2	6336	2028	1944	1944
query3	10740	4012	4247	4012
query4	59539	26859	23259	23259
query5	5446	511	512	511
query6	403	170	168	168
query7	5745	313	305	305
query8	299	211	219	211
query9	8747	2486	2467	2467
query10	515	283	270	270
query11	18198	15100	15430	15100
query12	157	109	108	108
query13	1548	431	396	396
query14	11301	7777	7395	7395
query15	225	189	180	180
query16	7367	474	512	474
query17	1092	566	584	566
query18	1275	298	295	295
query19	281	147	148	147
query20	117	109	108	108
query21	207	111	105	105
query22	4656	4291	4492	4291
query23	34422	33729	33293	33293
query24	5953	2894	2802	2802
query25	554	403	421	403
query26	667	156	157	156
query27	1755	277	278	277
query28	3909	2114	2085	2085
query29	643	399	408	399
query30	242	158	155	155
query31	926	706	750	706
query32	73	57	58	57
query33	476	285	282	282
query34	875	478	482	478
query35	830	720	709	709
query36	1079	931	936	931
query37	155	100	100	100
query38	3970	3940	4014	3940
query39	1458	1403	1410	1403
query40	205	119	119	119
query41	48	47	45	45
query42	122	106	95	95
query43	518	489	480	480
query44	1080	745	761	745
query45	196	169	165	165
query46	1084	736	736	736
query47	1905	1814	1805	1805
query48	377	293	297	293
query49	762	465	452	452
query50	827	426	416	416
query51	7226	7054	7001	7001
query52	100	88	90	88
query53	247	182	186	182
query54	571	449	472	449
query55	79	75	79	75
query56	276	261	268	261
query57	1180	1078	1074	1074
query58	223	242	232	232
query59	3062	3047	2785	2785
query60	298	283	270	270
query61	106	103	101	101
query62	727	656	652	652
query63	218	194	193	193
query64	2447	705	691	691
query65	3253	3171	3149	3149
query66	692	349	342	342
query67	15489	15159	15168	15159
query68	2924	584	586	584
query69	415	282	274	274
query70	1157	1129	1119	1119
query71	348	298	283	283
query72	5296	4089	3947	3947
query73	738	337	331	331
query74	9178	8892	8777	8777
query75	3357	2689	2691	2689
query76	1474	1008	979	979
query77	573	326	334	326
query78	10474	9153	9278	9153
query79	1062	546	533	533
query80	780	528	541	528
query81	477	238	237	237
query82	377	155	150	150
query83	234	151	153	151
query84	262	74	80	74
query85	789	297	290	290
query86	304	265	272	265
query87	4336	4315	4303	4303
query88	3193	2318	2314	2314
query89	373	283	291	283
query90	1581	199	198	198
query91	129	103	115	103
query92	63	53	52	52
query93	1043	544	536	536
query94	599	303	298	298
query95	352	270	269	269
query96	587	271	268	268
query97	3200	3138	3087	3087
query98	217	200	199	199
query99	1562	1286	1300	1286
Total cold run time: 304217 ms
Total hot run time: 193306 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.74 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e54a7f3a9f93149fb52cefd38ca7b38280217037, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.03	0.04
query3	0.22	0.04	0.05
query4	1.66	0.09	0.09
query5	0.50	0.51	0.50
query6	1.12	0.73	0.74
query7	0.02	0.01	0.01
query8	0.06	0.05	0.05
query9	0.55	0.48	0.48
query10	0.54	0.54	0.53
query11	0.15	0.12	0.11
query12	0.16	0.12	0.12
query13	0.62	0.59	0.59
query14	2.08	2.11	2.11
query15	0.89	0.83	0.84
query16	0.37	0.36	0.39
query17	1.06	1.05	0.99
query18	0.22	0.20	0.19
query19	1.87	1.87	1.78
query20	0.01	0.01	0.01
query21	15.44	0.66	0.66
query22	3.72	6.73	2.47
query23	18.25	1.39	1.30
query24	2.14	0.23	0.22
query25	0.16	0.08	0.08
query26	0.26	0.18	0.17
query27	0.08	0.08	0.08
query28	13.23	1.02	1.01
query29	12.65	3.34	3.33
query30	0.24	0.06	0.05
query31	2.88	0.40	0.40
query32	3.24	0.48	0.48
query33	3.03	2.98	3.01
query34	17.13	4.41	4.49
query35	4.49	4.55	4.48
query36	0.66	0.48	0.47
query37	0.18	0.16	0.15
query38	0.15	0.15	0.14
query39	0.06	0.03	0.03
query40	0.15	0.12	0.12
query41	0.11	0.04	0.04
query42	0.05	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 110.57 s
Total hot run time: 32.74 s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38016 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 389f0595b068486481abec583edfbb3c695f4958, data reload: false

------ Round 1 ----------------------------------
q1	17752	4422	4289	4289
q2	2023	181	188	181
q3	11832	950	1145	950
q4	10515	707	716	707
q5	7771	2837	2785	2785
q6	234	142	142	142
q7	956	608	618	608
q8	9307	2057	2056	2056
q9	7100	6513	6495	6495
q10	6979	2200	2199	2199
q11	444	243	243	243
q12	415	230	227	227
q13	18867	3089	3100	3089
q14	273	245	236	236
q15	521	491	486	486
q16	580	510	505	505
q17	971	768	759	759
q18	7416	6893	6836	6836
q19	1397	955	1085	955
q20	666	339	324	324
q21	3999	3033	2910	2910
q22	1132	1046	1034	1034
Total cold run time: 111150 ms
Total hot run time: 38016 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4336	4339	4281	4281
q2	375	264	267	264
q3	2842	2661	2638	2638
q4	1901	1621	1645	1621
q5	5651	5607	5720	5607
q6	228	139	137	137
q7	2252	1852	1814	1814
q8	3253	3386	3445	3386
q9	8748	8807	8728	8728
q10	3565	3378	3371	3371
q11	617	516	526	516
q12	861	671	657	657
q13	13883	3188	3303	3188
q14	331	291	290	290
q15	527	492	478	478
q16	650	604	583	583
q17	1830	1563	1531	1531
q18	8103	7881	7914	7881
q19	1713	1565	1616	1565
q20	2195	1929	1932	1929
q21	5593	5413	5253	5253
q22	1125	1076	1061	1061
Total cold run time: 70579 ms
Total hot run time: 56779 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193348 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 389f0595b068486481abec583edfbb3c695f4958, data reload: false

query1	1221	885	856	856
query2	6274	1924	1841	1841
query3	10614	4002	3877	3877
query4	59292	26802	23257	23257
query5	5374	518	513	513
query6	397	164	172	164
query7	5797	296	300	296
query8	280	198	199	198
query9	9160	2530	2518	2518
query10	490	278	265	265
query11	17332	14897	15190	14897
query12	155	101	110	101
query13	1567	411	403	403
query14	11203	7053	7870	7053
query15	237	186	181	181
query16	7546	466	444	444
query17	1150	580	559	559
query18	1860	309	313	309
query19	296	198	148	148
query20	120	110	111	110
query21	210	106	119	106
query22	4725	4493	4581	4493
query23	34212	33830	33442	33442
query24	6021	2993	2925	2925
query25	555	406	400	400
query26	693	161	160	160
query27	1781	293	286	286
query28	3873	2091	2070	2070
query29	711	438	439	438
query30	239	160	161	160
query31	926	743	787	743
query32	89	57	58	57
query33	478	302	291	291
query34	871	495	494	494
query35	835	753	728	728
query36	1050	968	939	939
query37	155	101	96	96
query38	4005	3990	3899	3899
query39	1531	1396	1404	1396
query40	204	121	122	121
query41	49	51	45	45
query42	121	102	97	97
query43	510	479	496	479
query44	1117	761	771	761
query45	204	168	169	168
query46	1095	737	743	737
query47	1918	1780	1771	1771
query48	383	299	298	298
query49	773	456	456	456
query50	835	435	433	433
query51	7218	7052	7104	7052
query52	102	91	95	91
query53	264	188	189	188
query54	578	472	467	467
query55	79	81	78	78
query56	306	278	277	277
query57	1162	1077	1095	1077
query58	234	250	250	250
query59	3012	2706	2742	2706
query60	307	288	295	288
query61	121	123	120	120
query62	773	658	662	658
query63	229	189	195	189
query64	2936	773	769	769
query65	3220	3185	3197	3185
query66	650	351	482	351
query67	15524	15392	15197	15197
query68	4482	561	559	559
query69	424	277	277	277
query70	1203	1146	1146	1146
query71	365	275	276	275
query72	6600	4145	4129	4129
query73	757	338	340	338
query74	9321	8777	8929	8777
query75	3367	2692	2724	2692
query76	1926	1058	977	977
query77	544	367	321	321
query78	9717	9026	10026	9026
query79	1557	544	545	544
query80	1049	528	512	512
query81	568	231	231	231
query82	634	149	157	149
query83	259	147	151	147
query84	261	75	75	75
query85	931	326	285	285
query86	419	305	303	303
query87	4437	4290	4375	4290
query88	2996	2358	2363	2358
query89	386	280	288	280
query90	1861	195	192	192
query91	127	100	103	100
query92	67	54	55	54
query93	1279	538	545	538
query94	815	286	300	286
query95	360	261	269	261
query96	591	264	269	264
query97	3207	3069	3055	3055
query98	221	208	199	199
query99	1587	1294	1286	1286
Total cold run time: 309567 ms
Total hot run time: 193348 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.36 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 389f0595b068486481abec583edfbb3c695f4958, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.69	0.08	0.07
query5	0.51	0.51	0.49
query6	1.13	0.72	0.72
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.55	0.48	0.48
query10	0.55	0.54	0.55
query11	0.15	0.11	0.12
query12	0.14	0.12	0.12
query13	0.61	0.59	0.59
query14	2.06	2.06	2.09
query15	0.89	0.81	0.82
query16	0.36	0.38	0.37
query17	1.05	1.05	1.03
query18	0.21	0.21	0.20
query19	1.94	1.86	1.85
query20	0.01	0.01	0.01
query21	15.39	0.68	0.67
query22	4.15	8.38	1.18
query23	18.30	1.29	1.22
query24	2.13	0.24	0.22
query25	0.16	0.08	0.08
query26	0.26	0.18	0.18
query27	0.08	0.08	0.08
query28	13.24	1.02	1.01
query29	12.56	3.31	3.32
query30	0.24	0.05	0.05
query31	2.87	0.41	0.41
query32	3.23	0.48	0.48
query33	2.99	2.95	3.04
query34	16.98	4.36	4.45
query35	4.39	4.46	4.46
query36	0.65	0.47	0.48
query37	0.19	0.15	0.15
query38	0.15	0.14	0.15
query39	0.05	0.04	0.04
query40	0.15	0.12	0.12
query41	0.10	0.05	0.05
query42	0.06	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.62 s
Total hot run time: 31.36 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 2, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Sep 2, 2024

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Sep 2, 2024

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit 4c16768 into apache:master Sep 2, 2024
25 of 28 checks passed
@morrySnow morrySnow deleted the add_more_syntax branch September 2, 2024 06:39
dataroaring pushed a commit that referenced this pull request Sep 19, 2024
@morrySnow @dataroaring
[opt](Nereids) add job, analyze, load and cancel statements syntax (#…
0368813 
…40203)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@feiniaofeiafei feiniaofeiafei feiniaofeiafei approved these changes

@starocean999 starocean999 starocean999 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/3.0.2-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@morrySnow @doris-robot @starocean999 @feiniaofeiafei @dataroaring