[opt](Nereids) add switch to control whether use pipeline in DML

[morrySnow]

pick from master #28037
commit id 1aa1b2f

to turn on pipeline for DML in Nerieds, please:
set enable_nereids_dml_with_pipeline = true;

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[morrySnow]

run buildall

[morrySnow]

run buildall

[morrySnow]

run p0

[doris-robot]

TPC-H: Total hot run time: 49474 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2621f02c51c45096b9d43f60fb7a30a2f3d68552, data reload: false

------ Round 1 ----------------------------------
q1	17749	4380	4376	4376
q2	2029	184	146	146
q3	10404	1961	1910	1910
q4	10316	1234	1333	1234
q5	8928	3806	3891	3806
q6	231	124	125	124
q7	2017	1611	1628	1611
q8	9322	2717	2686	2686
q9	10722	10250	10228	10228
q10	8662	3490	3477	3477
q11	413	247	240	240
q12	475	297	299	297
q13	18365	3954	3996	3954
q14	351	325	337	325
q15	500	462	456	456
q16	677	565	575	565
q17	1117	950	963	950
q18	7249	6818	7064	6818
q19	1747	1550	1541	1541
q20	529	325	301	301
q21	4500	4113	4034	4034
q22	485	408	395	395
Total cold run time: 116788 ms
Total hot run time: 49474 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4298	4268	4255	4255
q2	324	226	223	223
q3	4183	4129	4170	4129
q4	2731	2728	2739	2728
q5	7134	7069	7113	7069
q6	234	122	119	119
q7	3214	2797	2801	2797
q8	4377	4434	4430	4430
q9	16895	16717	16762	16717
q10	4220	4251	4274	4251
q11	756	688	701	688
q12	1015	839	859	839
q13	6932	3710	3703	3703
q14	456	427	428	427
q15	490	460	454	454
q16	737	674	699	674
q17	3877	3867	3775	3775
q18	8775	8679	8723	8679
q19	1696	1699	1668	1668
q20	2393	2131	2103	2103
q21	8513	8455	8545	8455
q22	1057	962	976	962
Total cold run time: 84307 ms
Total hot run time: 79145 ms

[doris-robot]

TPC-DS: Total hot run time: 203316 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2621f02c51c45096b9d43f60fb7a30a2f3d68552, data reload: false

query1	930	389	379	379
query2	6567	2824	2737	2737
query3	6947	208	205	205
query4	20069	18051	18023	18023
query5	19723	6510	6525	6510
query6	291	224	231	224
query7	4151	306	306	306
query8	246	263	244	244
query9	3214	2749	2658	2658
query10	437	303	322	303
query11	11399	10613	10737	10613
query12	126	85	79	79
query13	5590	701	704	701
query14	17799	13316	13246	13246
query15	373	221	229	221
query16	6472	303	262	262
query17	1500	1499	879	879
query18	2270	420	414	414
query19	204	157	156	156
query20	81	81	80	80
query21	194	93	99	93
query22	5171	5027	5045	5027
query23	32610	32062	32223	32062
query24	6954	6454	6461	6454
query25	522	441	436	436
query26	529	166	165	165
query27	1878	306	296	296
query28	6161	2388	2341	2341
query29	2872	2796	2946	2796
query30	245	169	173	169
query31	921	728	747	728
query32	74	65	62	62
query33	388	283	266	266
query34	853	475	513	475
query35	1096	952	892	892
query36	1242	1269	1293	1269
query37	92	58	62	58
query38	3051	2909	2929	2909
query39	1373	1346	1313	1313
query40	212	101	98	98
query41	41	38	37	37
query42	84	81	88	81
query43	711	645	626	626
query44	1124	721	726	721
query45	247	233	230	230
query46	1257	953	969	953
query47	1694	1792	1624	1624
query48	1023	711	730	711
query49	632	376	372	372
query50	864	640	608	608
query51	4759	4632	4690	4632
query52	93	86	95	86
query53	444	322	322	322
query54	2675	2488	2469	2469
query55	90	92	80	80
query56	220	199	210	199
query57	1166	1095	1116	1095
query58	220	199	195	195
query59	3994	3726	4000	3726
query60	229	196	194	194
query61	101	101	100	100
query62	878	488	482	482
query63	487	341	344	341
query64	2595	1554	1532	1532
query65	3607	3580	3558	3558
query66	764	377	382	377
query67	16278	15325	15011	15011
query68	10286	684	689	684
query69	580	341	331	331
query70	1751	1446	1546	1446
query71	421	325	334	325
query72	6561	3506	3514	3506
query73	742	331	323	323
query74	6301	5817	5860	5817
query75	5371	3720	3844	3720
query76	6617	1148	1210	1148
query77	1177	257	271	257
query78	12649	11537	19991	11537
query79	5066	631	641	631
query80	803	422	415	415
query81	484	234	240	234
query82	428	102	96	96
query83	177	139	132	132
query84	259	73	78	73
query85	867	320	323	320
query86	350	299	336	299
query87	3188	2965	3063	2965
query88	3678	2339	2336	2336
query89	352	305	282	282
query90	1976	217	207	207
query91	185	139	138	138
query92	68	54	52	52
query93	1211	572	568	568
query94	710	211	214	211
query95	1149	1057	1060	1057
query96	640	342	331	331
query97	6508	6311	6444	6311
query98	193	175	182	175
query99	2721	878	934	878
Total cold run time: 304573 ms
Total hot run time: 203316 ms

[doris-robot]

ClickBench: Total hot run time: 30.96 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2621f02c51c45096b9d43f60fb7a30a2f3d68552, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.05	0.04
query4	1.80	0.06	0.08
query5	0.53	0.52	0.52
query6	1.23	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.49	0.48
query10	0.54	0.54	0.54
query11	0.12	0.09	0.08
query12	0.12	0.10	0.09
query13	0.62	0.62	0.61
query14	0.78	0.80	0.80
query15	0.77	0.76	0.76
query16	0.37	0.39	0.40
query17	1.02	0.96	0.99
query18	0.21	0.26	0.25
query19	1.93	1.82	1.88
query20	0.02	0.01	0.01
query21	15.49	0.57	0.56
query22	2.01	1.88	1.85
query23	17.35	1.07	0.85
query24	4.67	1.09	1.93
query25	0.37	0.12	0.04
query26	0.63	0.15	0.15
query27	0.05	0.03	0.03
query28	7.47	0.73	0.75
query29	12.67	2.27	2.39
query30	0.60	0.53	0.53
query31	2.83	0.38	0.37
query32	3.38	0.50	0.49
query33	3.11	3.07	3.07
query34	15.24	4.81	4.76
query35	4.85	4.82	4.84
query36	1.04	1.04	1.00
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.01	0.02	0.02
query40	0.16	0.15	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.03	0.02	0.02
Total cold run time: 103.09 s
Total hot run time: 30.96 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 2621f02c51c45096b9d43f60fb7a30a2f3d68552 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s