Skip to content

[pipelineX](fix) Fix coredump if prepare failed#30250

Merged
Gabriel39 merged 1 commit into
apache:masterfrom
Gabriel39:fix_0123
Jan 23, 2024
Merged

[pipelineX](fix) Fix coredump if prepare failed#30250
Gabriel39 merged 1 commit into
apache:masterfrom
Gabriel39:fix_0123

Conversation

@Gabriel39

Copy link
Copy Markdown
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@Gabriel39

Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions


virtual Status close(RuntimeState* state, Status exec_status) {
return state->get_sink_local_state(operator_id())->close(state, exec_status);
Status close(RuntimeState* state, Status exec_status) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: method 'close' can be made const [readability-make-member-function-const]

Suggested change
Status close(RuntimeState* state, Status exec_status) {
Status close(RuntimeState* state, Status exec_status) const {

@doris-robot

Copy link
Copy Markdown
TPC-H: Total hot run time: 38862 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e5c3eaa84f27c97e35a6408fe7fd20ed608dcb96, data reload: false

------ Round 1 ----------------------------------
q1	17631	5328	5147	5147
q2	2036	146	135	135
q3	10627	1148	1162	1148
q4	10218	788	807	788
q5	7771	3119	3178	3119
q6	198	123	118	118
q7	867	514	496	496
q8	9243	1895	1950	1895
q9	7265	6422	6369	6369
q10	8210	3080	3057	3057
q11	409	223	212	212
q12	353	190	195	190
q13	18013	3357	3388	3357
q14	246	224	211	211
q15	549	509	511	509
q16	456	372	387	372
q17	942	580	543	543
q18	7581	6949	6806	6806
q19	1552	1394	1422	1394
q20	596	280	277	277
q21	2760	2405	2415	2405
q22	373	314	317	314
Total cold run time: 107896 ms
Total hot run time: 38862 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5443	5361	5214	5214
q2	339	219	214	214
q3	3369	3272	3273	3272
q4	2100	2090	2050	2050
q5	6037	5898	5882	5882
q6	201	119	117	117
q7	2335	1920	1893	1893
q8	3239	3378	3390	3378
q9	9086	9019	8831	8831
q10	3901	3834	3859	3834
q11	574	450	477	450
q12	827	635	645	635
q13	16917	3170	3143	3143
q14	289	252	277	252
q15	546	502	518	502
q16	518	470	473	470
q17	1874	1844	1847	1844
q18	9702	18158	9721	9721
q19	26069	1583	1504	1504
q20	4563	1931	1930	1930
q21	14461	5242	5394	5242
q22	981	546	540	540
Total cold run time: 113371 ms
Total hot run time: 60918 ms

@doris-robot

Copy link
Copy Markdown

TeamCity be ut coverage result:
Function Coverage: 36.68% (8665/23621)
Line Coverage: 28.72% (70736/246274)
Region Coverage: 27.60% (36451/132080)
Branch Coverage: 24.34% (18660/76670)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e5c3eaa84f27c97e35a6408fe7fd20ed608dcb96_e5c3eaa84f27c97e35a6408fe7fd20ed608dcb96/report/index.html

@doris-robot

Copy link
Copy Markdown
TPC-DS: Total hot run time: 176834 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e5c3eaa84f27c97e35a6408fe7fd20ed608dcb96, data reload: false

query1	939	332	330	330
query2	6556	1926	2032	1926
query3	6710	203	199	199
query4	31447	22347	22223	22223
query5	4456	374	420	374
query6	242	163	158	158
query7	4615	268	263	263
query8	224	177	173	173
query9	8425	2543	2525	2525
query10	434	225	256	225
query11	16711	15522	15564	15522
query12	130	69	66	66
query13	1700	378	394	378
query14	10495	6953	7068	6953
query15	210	179	172	172
query16	5799	256	248	248
query17	949	482	461	461
query18	1785	260	256	256
query19	172	127	132	127
query20	75	71	71	71
query21	180	127	122	122
query22	4932	4849	4790	4790
query23	31628	30939	30777	30777
query24	11616	2807	2778	2778
query25	564	313	306	306
query26	1372	147	140	140
query27	3224	281	284	281
query28	7158	1834	1813	1813
query29	1230	649	620	620
query30	277	138	140	138
query31	934	746	742	742
query32	83	50	48	48
query33	689	221	204	204
query34	1129	456	468	456
query35	921	793	778	778
query36	1361	1272	1293	1272
query37	93	66	57	57
query38	3368	3203	3198	3198
query39	1316	1262	1257	1257
query40	198	85	84	84
query41	38	35	34	34
query42	89	80	82	80
query43	528	500	471	471
query44	1090	683	677	677
query45	192	185	184	184
query46	1065	647	644	644
query47	1644	1529	1536	1529
query48	392	311	316	311
query49	1130	295	298	295
query50	690	305	301	301
query51	5381	5170	5237	5170
query52	89	79	80	79
query53	312	261	271	261
query54	234	179	190	179
query55	81	74	74	74
query56	180	170	168	168
query57	1004	956	925	925
query58	184	159	159	159
query59	2851	2786	2744	2744
query60	205	182	183	182
query61	84	86	84	84
query62	622	366	366	366
query63	285	257	260	257
query64	4965	1792	1735	1735
query65	3358	3257	3254	3254
query66	1183	318	340	318
query67	15584	15552	14985	14985
query68	12173	534	518	518
query69	591	301	297	297
query70	1715	1539	1521	1521
query71	483	217	206	206
query72	5037	2812	2844	2812
query73	2517	321	316	316
query74	6983	6465	6398	6398
query75	4634	2258	2354	2258
query76	6306	1015	1034	1015
query77	659	228	227	227
query78	9085	8890	8770	8770
query79	991	494	493	493
query80	558	331	313	313
query81	467	203	200	200
query82	210	84	76	76
query83	166	119	116	116
query84	274	70	69	69
query85	1081	347	318	318
query86	412	400	391	391
query87	3500	3410	3345	3345
query88	2666	2189	2185	2185
query89	439	359	337	337
query90	1961	187	184	184
query91	169	131	137	131
query92	55	42	42	42
query93	1323	453	424	424
query94	1258	164	161	161
query95	491	456	440	440
query96	616	319	313	313
query97	4297	4129	4160	4129
query98	212	195	183	183
query99	1022	688	669	669
Total cold run time: 290158 ms
Total hot run time: 176834 ms

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e5c3eaa84f27c97e35a6408fe7fd20ed608dcb96, data reload: false

query1	0.03	0.03	0.02
query2	0.06	0.03	0.03
query3	0.22	0.06	0.06
query4	1.68	0.08	0.08
query5	0.53	0.52	0.52
query6	1.27	0.63	0.65
query7	0.02	0.02	0.01
query8	0.04	0.02	0.02
query9	0.54	0.48	0.50
query10	0.56	0.56	0.56
query11	0.11	0.09	0.08
query12	0.10	0.10	0.09
query13	0.62	0.61	0.61
query14	0.79	0.81	0.79
query15	0.80	0.77	0.77
query16	0.36	0.38	0.39
query17	1.03	1.00	1.01
query18	0.24	0.26	0.25
query19	1.88	1.81	1.80
query20	0.01	0.01	0.01
query21	15.40	0.56	0.56
query22	3.02	2.47	1.79
query23	17.31	1.00	0.79
query24	2.35	1.81	0.51
query25	0.42	0.29	0.08
query26	0.47	0.15	0.14
query27	0.06	0.05	0.04
query28	11.07	0.81	0.76
query29	12.50	3.14	3.11
query30	0.51	0.49	0.49
query31	2.78	0.35	0.36
query32	3.36	0.48	0.49
query33	3.25	3.21	3.23
query34	16.56	4.37	4.27
query35	4.29	4.30	4.33
query36	1.10	1.06	1.06
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.02
query40	0.15	0.13	0.13
query41	0.07	0.02	0.02
query42	0.02	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 105.72 s
Total hot run time: 30.4 s

@doris-robot

Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e5c3eaa84f27c97e35a6408fe7fd20ed608dcb96 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@Gabriel39 Gabriel39 merged commit bbc9911 into apache:master Jan 23, 2024
@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Jan 23, 2024
@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.0 dev/3.0.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants