Skip to content

[fix](forward) set error code for query state to handle exception of …#36105

Merged
dataroaring merged 1 commit intoapache:branch-2.0from
dataroaring:forward_delete_2.0
Jun 11, 2024
Merged

[fix](forward) set error code for query state to handle exception of …#36105
dataroaring merged 1 commit intoapache:branch-2.0from
dataroaring:forward_delete_2.0

Conversation

@dataroaring
Copy link
Contributor

…(#31975)

Proposed changes

Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@dataroaring
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49927 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a4a65e92dc1857057f1d8f1f92dcbf1e1c498259, data reload: false

------ Round 1 ----------------------------------
q1	18065	4397	4353	4353
q2	2067	153	146	146
q3	10452	1851	1925	1851
q4	10314	1255	1324	1255
q5	8846	3876	3905	3876
q6	233	125	151	125
q7	2023	1585	1599	1585
q8	9277	2732	2694	2694
q9	11081	10655	10524	10524
q10	8662	3499	3507	3499
q11	417	243	255	243
q12	471	304	306	304
q13	18334	3995	4048	3995
q14	364	340	335	335
q15	511	460	468	460
q16	675	579	567	567
q17	1126	976	960	960
q18	7273	6927	7025	6927
q19	1702	1513	1456	1456
q20	544	300	313	300
q21	4429	4085	4105	4085
q22	505	387	404	387
Total cold run time: 117371 ms
Total hot run time: 49927 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4351	4308	4296	4296
q2	319	225	230	225
q3	4162	4176	4118	4118
q4	2752	2760	2776	2760
q5	7215	7174	7108	7108
q6	239	120	120	120
q7	3256	2853	2866	2853
q8	4353	4507	4472	4472
q9	17430	17098	17121	17098
q10	4260	4248	4243	4243
q11	759	690	687	687
q12	1021	869	877	869
q13	6902	3736	3758	3736
q14	466	430	427	427
q15	503	471	450	450
q16	740	670	684	670
q17	3829	3877	3800	3800
q18	8715	8829	8734	8734
q19	1703	1692	1635	1635
q20	2378	2136	2101	2101
q21	8547	8481	8594	8481
q22	1042	955	950	950
Total cold run time: 84942 ms
Total hot run time: 79833 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204770 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a4a65e92dc1857057f1d8f1f92dcbf1e1c498259, data reload: false

query1	938	436	380	380
query2	6528	2719	2746	2719
query3	6923	214	210	210
query4	19919	17973	17923	17923
query5	19723	6525	6590	6525
query6	289	218	237	218
query7	4185	297	310	297
query8	270	273	236	236
query9	3167	2713	2647	2647
query10	427	311	292	292
query11	11292	10773	10883	10773
query12	127	81	79	79
query13	5604	695	681	681
query14	18111	13719	13268	13268
query15	382	221	227	221
query16	6453	288	263	263
query17	1538	1471	886	886
query18	2258	411	401	401
query19	206	154	160	154
query20	71	77	82	77
query21	194	98	94	94
query22	5292	5125	5075	5075
query23	32410	31773	32126	31773
query24	7058	6509	6526	6509
query25	523	432	420	420
query26	516	166	162	162
query27	1838	292	291	291
query28	6203	2371	2317	2317
query29	2916	2647	2789	2647
query30	242	169	171	169
query31	886	752	758	752
query32	71	68	63	63
query33	411	249	260	249
query34	867	487	477	477
query35	1145	915	976	915
query36	1244	1261	1196	1196
query37	89	59	56	56
query38	3076	2922	3017	2922
query39	1370	1353	1317	1317
query40	212	99	93	93
query41	41	39	38	38
query42	88	84	88	84
query43	778	623	771	623
query44	1295	718	715	715
query45	246	235	229	229
query46	1242	970	981	970
query47	1882	1747	1867	1747
query48	1005	726	707	707
query49	606	383	383	383
query50	865	644	593	593
query51	4839	4654	4656	4654
query52	90	85	82	82
query53	449	324	312	312
query54	2641	2459	2502	2459
query55	88	93	91	91
query56	222	238	219	219
query57	1210	1098	1052	1052
query58	221	201	191	191
query59	3958	4168	3955	3955
query60	212	215	202	202
query61	98	98	101	98
query62	809	461	454	454
query63	494	339	343	339
query64	2557	1551	1514	1514
query65	3661	3540	3545	3540
query66	779	373	395	373
query67	17256	16996	15991	15991
query68	8165	670	678	670
query69	575	374	349	349
query70	1743	1449	1530	1449
query71	392	305	322	305
query72	6740	3502	3550	3502
query73	731	328	330	328
query74	6259	5895	5925	5895
query75	4540	3808	3655	3655
query76	4611	1158	1189	1158
query77	561	260	270	260
query78	12539	12444	11898	11898
query79	10752	668	645	645
query80	1640	407	411	407
query81	509	237	235	235
query82	1285	97	101	97
query83	174	134	145	134
query84	257	73	73	73
query85	1287	342	321	321
query86	353	296	314	296
query87	3274	3011	3046	3011
query88	5212	2354	2345	2345
query89	441	305	296	296
query90	1785	215	207	207
query91	182	141	143	141
query92	61	57	57	57
query93	6155	579	577	577
query94	874	214	222	214
query95	1150	1071	1070	1070
query96	658	332	333	332
query97	6530	6388	6416	6388
query98	184	179	182	179
query99	2907	915	914	914
Total cold run time: 315132 ms
Total hot run time: 204770 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.83 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a4a65e92dc1857057f1d8f1f92dcbf1e1c498259, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.04
query4	1.79	0.05	0.06
query5	0.54	0.52	0.53
query6	1.23	0.61	0.63
query7	0.01	0.02	0.01
query8	0.04	0.02	0.03
query9	0.52	0.50	0.48
query10	0.55	0.55	0.53
query11	0.12	0.08	0.08
query12	0.11	0.09	0.09
query13	0.62	0.61	0.60
query14	0.80	0.78	0.77
query15	0.77	0.77	0.76
query16	0.36	0.38	0.35
query17	0.99	1.02	1.02
query18	0.24	0.22	0.27
query19	1.94	1.87	1.84
query20	0.01	0.01	0.00
query21	15.47	0.57	0.57
query22	2.00	2.59	1.30
query23	16.89	0.97	0.93
query24	7.14	1.47	1.33
query25	0.39	0.12	0.05
query26	0.80	0.16	0.15
query27	0.03	0.05	0.04
query28	5.25	0.78	0.75
query29	12.60	2.37	2.29
query30	0.58	0.54	0.52
query31	2.81	0.38	0.37
query32	3.40	0.49	0.50
query33	3.11	3.09	3.08
query34	15.25	4.83	4.83
query35	4.91	4.86	4.88
query36	1.06	0.99	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.03	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.06 s
Total hot run time: 30.83 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a4a65e92dc1857057f1d8f1f92dcbf1e1c498259 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

@dataroaring dataroaring merged commit 69d5935 into apache:branch-2.0 Jun 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants