Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cherry-pick](branch-2.0) Fix enable_mow_light_delete default value #40284

Merged
merged 2 commits into from
Sep 3, 2024

Conversation

Yukang-Lian
Copy link
Collaborator

Proposed changes

Pick #40104 #40197

…lt value of `enable_mow_light_delete` is true (apache#40197)

## Proposed changes

Fix the issue where an error occurs when creating a non-MOW table while
the default value of `enable_mow_light_delete` is set to true.

<!--Describe your changes.-->
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Yukang-Lian
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49116 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 16d120c78d16cd5b2b76c985af24a046fe43d566, data reload: false

------ Round 1 ----------------------------------
q1	17816	4444	4322	4322
q2	2113	162	147	147
q3	10477	1903	1948	1903
q4	10328	1222	1317	1222
q5	8406	3840	3911	3840
q6	235	127	126	126
q7	2041	1630	1607	1607
q8	9520	2724	2699	2699
q9	13185	9933	9769	9769
q10	8616	3497	3529	3497
q11	411	247	247	247
q12	463	295	298	295
q13	18371	3952	3974	3952
q14	364	333	323	323
q15	511	461	463	461
q16	542	459	452	452
q17	1132	969	953	953
q18	7300	6918	7022	6918
q19	1688	1612	1587	1587
q20	558	334	320	320
q21	4429	4091	4094	4091
q22	488	385	402	385
Total cold run time: 118994 ms
Total hot run time: 49116 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4331	4324	4344	4324
q2	325	226	226	226
q3	4149	4125	4177	4125
q4	2747	2741	2744	2741
q5	7140	7095	7071	7071
q6	235	121	121	121
q7	3192	2854	2810	2810
q8	4351	4448	4474	4448
q9	13629	13678	13531	13531
q10	4212	4250	4235	4235
q11	771	679	701	679
q12	1013	864	845	845
q13	7498	3748	3723	3723
q14	459	438	427	427
q15	501	459	467	459
q16	617	583	586	583
q17	3862	3833	3873	3833
q18	8668	8831	8762	8762
q19	1723	1616	1669	1616
q20	2370	2141	2088	2088
q21	8419	8445	8515	8445
q22	1043	953	934	934
Total cold run time: 81255 ms
Total hot run time: 76026 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212042 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 16d120c78d16cd5b2b76c985af24a046fe43d566, data reload: false

query1	944	393	416	393
query2	6556	2209	2235	2209
query3	6947	209	206	206
query4	23275	21592	21510	21510
query5	19774	6563	6590	6563
query6	297	223	220	220
query7	4329	307	321	307
query8	277	273	239	239
query9	3115	2648	2585	2585
query10	475	313	298	298
query11	15785	14955	15427	14955
query12	123	81	73	73
query13	1024	442	429	429
query14	17055	13385	13431	13385
query15	358	217	222	217
query16	6488	281	260	260
query17	1764	930	928	928
query18	902	318	322	318
query19	208	154	155	154
query20	79	77	79	77
query21	193	95	96	95
query22	5151	5006	5061	5006
query23	34322	33415	33613	33415
query24	7899	6347	6325	6325
query25	536	442	429	429
query26	1270	164	170	164
query27	2418	297	298	297
query28	6078	2251	2227	2227
query29	2922	2695	2870	2695
query30	253	174	173	173
query31	987	712	742	712
query32	72	64	59	59
query33	452	276	268	268
query34	876	496	484	484
query35	1120	915	993	915
query36	1205	1093	1271	1093
query37	176	64	62	62
query38	3044	2999	2908	2908
query39	1401	1341	1350	1341
query40	306	93	98	93
query41	40	37	36	36
query42	79	84	83	83
query43	616	557	672	557
query44	1188	715	724	715
query45	242	233	232	232
query46	1227	977	952	952
query47	1790	1629	1689	1629
query48	499	409	416	409
query49	653	382	384	382
query50	860	589	629	589
query51	4769	4632	4706	4632
query52	98	72	74	72
query53	231	190	193	190
query54	2654	2456	2499	2456
query55	87	87	76	76
query56	229	205	203	203
query57	1315	1146	1057	1057
query58	216	198	213	198
query59	3662	3169	3375	3169
query60	215	212	209	209
query61	98	95	99	95
query62	789	461	457	457
query63	207	176	187	176
query64	3534	1567	1500	1500
query65	3620	3570	3551	3551
query66	778	402	408	402
query67	17521	16023	14891	14891
query68	10017	658	656	656
query69	496	274	266	266
query70	1556	1437	1629	1437
query71	413	307	306	306
query72	6832	4913	4829	4829
query73	753	315	325	315
query74	6260	5911	5848	5848
query75	5442	3720	3620	3620
query76	5884	1143	1178	1143
query77	972	267	257	257
query78	12565	11621	13328	11621
query79	12523	662	632	632
query80	1402	382	388	382
query81	492	235	233	233
query82	1021	98	98	98
query83	187	133	135	133
query84	268	71	68	68
query85	944	318	324	318
query86	343	315	310	310
query87	3242	3018	3044	3018
query88	5116	2323	2308	2308
query89	436	311	283	283
query90	2691	215	213	213
query91	169	129	131	129
query92	63	55	53	53
query93	5712	549	560	549
query94	1323	215	214	214
query95	1974	2086	2126	2086
query96	656	325	321	321
query97	6496	6453	6342	6342
query98	229	237	200	200
query99	2896	849	983	849
Total cold run time: 327046 ms
Total hot run time: 212042 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.55 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 16d120c78d16cd5b2b76c985af24a046fe43d566, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.26	0.05	0.04
query4	1.78	0.07	0.06
query5	0.55	0.52	0.52
query6	1.23	0.63	0.60
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.54	0.48	0.47
query10	0.54	0.55	0.54
query11	0.12	0.08	0.08
query12	0.11	0.10	0.09
query13	0.62	0.61	0.60
query14	0.79	0.79	0.79
query15	0.80	0.76	0.77
query16	0.36	0.39	0.38
query17	1.01	1.03	1.00
query18	0.23	0.24	0.26
query19	1.90	1.76	1.79
query20	0.02	0.01	0.01
query21	15.45	0.54	0.56
query22	2.11	2.08	1.61
query23	17.05	1.06	0.89
query24	7.10	1.23	0.90
query25	0.37	0.07	0.08
query26	0.74	0.18	0.17
query27	0.04	0.04	0.03
query28	6.19	0.78	0.73
query29	12.70	2.36	2.24
query30	0.59	0.55	0.53
query31	2.82	0.39	0.39
query32	3.36	0.49	0.50
query33	3.10	3.07	3.04
query34	15.24	4.78	4.79
query35	4.82	4.88	4.85
query36	1.05	1.02	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.15
query41	0.06	0.01	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.1 s
Total hot run time: 30.55 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 16d120c78d16cd5b2b76c985af24a046fe43d566 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@dataroaring dataroaring merged commit 209a564 into apache:branch-2.0 Sep 3, 2024
21 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants