Skip to content

[fix](Nereids) date >= simplify to > by mistake#30768

Merged
morrySnow merged 1 commit into
apache:branch-2.0from
morrySnow:2.0_30765
Feb 2, 2024
Merged

[fix](Nereids) date >= simplify to > by mistake#30768
morrySnow merged 1 commit into
apache:branch-2.0from
morrySnow:2.0_30765

Conversation

@morrySnow
Copy link
Copy Markdown
Contributor

pick from master #30765

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@morrySnow
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 49944 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eb2cf118a25efdc5ba42999a1053d578ee95e680, data reload: false

------ Round 1 ----------------------------------
q1	17902	4405	4333	4333
q2	2101	146	140	140
q3	10281	1882	1916	1882
q4	10099	1269	1296	1269
q5	8641	3956	4012	3956
q6	235	126	122	122
q7	2040	1602	1604	1602
q8	9295	2721	2720	2720
q9	10824	10485	10452	10452
q10	8613	3530	3568	3530
q11	422	241	242	241
q12	464	296	310	296
q13	18371	3972	4010	3972
q14	342	317	322	317
q15	498	451	457	451
q16	693	595	591	591
q17	1119	983	989	983
q18	7336	6866	6787	6787
q19	1677	1577	1493	1493
q20	517	320	307	307
q21	4451	4102	4106	4102
q22	500	398	402	398
Total cold run time: 116421 ms
Total hot run time: 49944 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4351	4285	4307	4285
q2	322	222	220	220
q3	4166	4139	4162	4139
q4	2739	2766	2737	2737
q5	7209	7187	7174	7174
q6	236	118	119	118
q7	3229	2856	2858	2856
q8	4408	4466	4507	4466
q9	17128	16946	17057	16946
q10	4287	4280	4257	4257
q11	749	703	655	655
q12	1037	841	845	841
q13	6848	3757	3760	3757
q14	454	417	428	417
q15	496	463	456	456
q16	762	722	699	699
q17	3832	3802	3871	3802
q18	8918	8744	8901	8744
q19	1713	1709	1651	1651
q20	2399	2181	2134	2134
q21	8492	8496	8571	8496
q22	1021	951	939	939
Total cold run time: 84796 ms
Total hot run time: 79789 ms

@starocean999 starocean999 marked this pull request as draft February 2, 2024 11:10
@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 238430 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eb2cf118a25efdc5ba42999a1053d578ee95e680, data reload: false

query1	937	402	377	377
query2	6519	2029	2094	2029
query3	6913	206	206	206
query4	20634	17968	18041	17968
query5	19722	6230	6200	6200
query6	280	212	223	212
query7	4158	293	300	293
query8	264	237	240	237
query9	3100	2673	2609	2609
query10	418	286	300	286
query11	11358	10758	10824	10758
query12	119	81	70	70
query13	5660	641	639	639
query14	17747	13353	13207	13207
query15	385	232	239	232
query16	6464	264	278	264
query17	3204	874	854	854
query18	2263	406	407	406
query19	202	146	146	146
query20	70	76	78	76
query21	188	90	90	90
query22	5272	5089	5031	5031
query23	32499	32071	31892	31892
query24	6993	6559	6477	6477
query25	547	417	420	417
query26	525	168	155	155
query27	1887	293	293	293
query28	6062	2229	2212	2212
query29	2921	2723	2802	2723
query30	240	164	161	161
query31	911	730	746	730
query32	60	57	60	57
query33	384	250	254	250
query34	836	460	478	460
query35	1105	909	934	909
query36	1750	1745	1575	1575
query37	88	63	61	61
query38	3103	2915	2920	2915
query39	1380	1310	1318	1310
query40	194	95	94	94
query41	34	34	34	34
query42	86	79	83	79
query43	766	631	530	530
query44	1104	720	711	711
query45	244	228	224	224
query46	1246	956	983	956
query47	1717	1804	1745	1745
query48	992	667	668	667
query49	607	366	366	366
query50	848	622	609	609
query51	5603	5533	5524	5524
query52	81	80	86	80
query53	440	319	307	307
query54	2446	2277	2246	2246
query55	80	86	82	82
query56	211	192	206	192
query57	1164	1023	1160	1023
query58	211	201	211	201
query59	3377	3211	3235	3211
query60	206	182	190	182
query61	86	86	81	81
query62	893	467	528	467
query63	466	331	334	331
query64	2028	1271	1303	1271
query65	3698	3618	3619	3618
query66	826	365	369	365
query67	17840	16067	17100	16067
query68	8409	678	664	664
query69	559	342	362	342
query70	2209	1845	1804	1804
query71	380	311	301	301
query72	4466	3316	3346	3316
query73	724	321	317	317
query74	6352	5873	5848	5848
query75	4519	3573	3544	3544
query76	4999	1160	1183	1160
query77	802	254	253	253
query78	31869	53340	47106	47106
query79	16161	654	667	654
query80	5197	387	379	379
query81	558	230	231	230
query82	1116	100	98	98
query83	410	128	127	127
query84	252	67	68	67
query85	2628	276	279	276
query86	480	380	418	380
query87	3269	3002	2963	2963
query88	6725	2336	2330	2330
query89	444	286	298	286
query90	2504	199	205	199
query91	151	116	119	116
query92	65	51	51	51
query93	6039	634	553	553
query94	1849	205	207	205
query95	1119	1059	1077	1059
query96	641	330	332	330
query97	6558	6397	6357	6357
query98	194	187	173	173
query99	3949	975	892	892
Total cold run time: 350259 ms
Total hot run time: 238430 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 31.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eb2cf118a25efdc5ba42999a1053d578ee95e680, data reload: false

query1	0.02	0.02	0.03
query2	0.06	0.02	0.02
query3	0.24	0.06	0.06
query4	1.80	0.08	0.08
query5	0.53	0.53	0.52
query6	1.22	0.62	0.60
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.51	0.49
query10	0.54	0.54	0.54
query11	0.11	0.08	0.08
query12	0.11	0.09	0.09
query13	0.62	0.61	0.59
query14	0.79	0.79	0.78
query15	0.78	0.76	0.76
query16	0.37	0.38	0.36
query17	1.02	1.02	1.01
query18	0.23	0.26	0.26
query19	1.89	1.87	1.86
query20	0.01	0.01	0.01
query21	15.46	0.54	0.54
query22	1.95	1.91	1.45
query23	17.18	1.06	0.94
query24	5.32	1.65	1.54
query25	1.61	0.12	0.11
query26	0.26	0.13	0.14
query27	0.10	0.11	0.10
query28	6.55	0.73	0.78
query29	12.72	2.29	2.38
query30	0.59	0.53	0.51
query31	2.81	0.37	0.38
query32	3.41	0.49	0.50
query33	3.11	3.03	3.09
query34	15.28	4.81	4.79
query35	4.84	4.83	4.85
query36	1.04	1.02	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.17	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.52 s
Total hot run time: 31.28 s

@doris-robot
Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit eb2cf118a25efdc5ba42999a1053d578ee95e680 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@morrySnow
Copy link
Copy Markdown
Contributor Author

run buildall

@morrySnow morrySnow marked this pull request as ready for review February 2, 2024 12:36
@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 49502 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 88094e1cf71ddb7aefe46a993f659fde6d3a3897, data reload: false

------ Round 1 ----------------------------------
q1	17663	4352	4345	4345
q2	2040	143	144	143
q3	10326	1892	1929	1892
q4	10348	1204	1303	1204
q5	8388	3902	3920	3902
q6	229	122	119	119
q7	2054	1633	1634	1633
q8	9475	2680	2701	2680
q9	11605	10447	10273	10273
q10	8629	3505	3525	3505
q11	413	243	234	234
q12	467	289	289	289
q13	18349	3907	3981	3907
q14	355	327	314	314
q15	507	460	444	444
q16	665	593	592	592
q17	1109	967	945	945
q18	7264	6771	6994	6771
q19	1678	1497	1471	1471
q20	551	299	303	299
q21	4460	4144	4133	4133
q22	516	407	407	407
Total cold run time: 117091 ms
Total hot run time: 49502 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4329	4342	4316	4316
q2	322	230	234	230
q3	4203	4128	4154	4128
q4	2764	2752	2742	2742
q5	7377	7328	7236	7236
q6	232	114	115	114
q7	3188	2832	2829	2829
q8	4420	4603	4696	4603
q9	17345	17282	17204	17204
q10	4280	4306	4268	4268
q11	782	660	691	660
q12	1006	812	842	812
q13	7818	3692	3749	3692
q14	454	425	417	417
q15	489	459	444	444
q16	757	704	696	696
q17	3841	3844	3900	3844
q18	8750	8820	8691	8691
q19	1667	1676	1635	1635
q20	2388	2127	2075	2075
q21	8561	8542	8528	8528
q22	1033	974	922	922
Total cold run time: 86006 ms
Total hot run time: 80086 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 238294 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 88094e1cf71ddb7aefe46a993f659fde6d3a3897, data reload: false

query1	921	387	373	373
query2	6539	2072	2083	2072
query3	6919	203	205	203
query4	20073	17868	18000	17868
query5	19716	6202	6205	6202
query6	275	221	230	221
query7	4151	290	289	289
query8	260	239	236	236
query9	3052	2611	2545	2545
query10	410	279	279	279
query11	11348	10609	10753	10609
query12	123	72	70	70
query13	5648	642	621	621
query14	17429	13064	13416	13064
query15	351	228	234	228
query16	6455	257	256	256
query17	3052	850	844	844
query18	2236	411	405	405
query19	220	145	149	145
query20	75	79	72	72
query21	193	101	98	98
query22	5230	5204	5147	5147
query23	32533	32122	31730	31730
query24	6939	6468	6506	6468
query25	506	438	410	410
query26	462	152	157	152
query27	1560	287	292	287
query28	6084	2224	2187	2187
query29	2978	2692	2806	2692
query30	237	160	160	160
query31	862	714	727	714
query32	62	56	58	56
query33	347	238	245	238
query34	823	453	499	453
query35	1116	949	946	946
query36	1769	1477	1441	1441
query37	88	58	61	58
query38	3093	2895	2935	2895
query39	1384	1327	1302	1302
query40	206	94	95	94
query41	34	31	31	31
query42	87	88	78	78
query43	627	693	567	567
query44	1070	707	697	697
query45	241	223	226	223
query46	1245	978	960	960
query47	1836	1730	1770	1730
query48	964	683	661	661
query49	609	359	367	359
query50	851	601	606	601
query51	5564	5417	5449	5417
query52	89	73	76	73
query53	436	314	299	299
query54	2436	2251	2228	2228
query55	82	78	77	77
query56	220	190	201	190
query57	1240	1173	1052	1052
query58	215	202	204	202
query59	3493	3077	3472	3077
query60	192	182	199	182
query61	86	87	84	84
query62	849	518	483	483
query63	462	325	328	325
query64	1977	1275	1287	1275
query65	3666	3618	3574	3574
query66	819	361	357	357
query67	17451	16019	15291	15291
query68	5687	649	684	649
query69	540	332	353	332
query70	1870	1884	1759	1759
query71	364	294	301	294
query72	4480	3332	3382	3332
query73	721	315	317	315
query74	6257	5866	5839	5839
query75	4390	3573	3481	3481
query76	3581	1144	1172	1144
query77	561	251	237	237
query78	32956	50542	49172	49172
query79	15639	636	624	624
query80	5195	372	386	372
query81	559	235	233	233
query82	1275	92	91	91
query83	331	133	130	130
query84	263	67	69	67
query85	2433	281	278	278
query86	474	387	375	375
query87	3265	2954	3049	2954
query88	7070	2326	2296	2296
query89	447	339	279	279
query90	2493	209	203	203
query91	155	114	118	114
query92	59	50	52	50
query93	6588	570	573	570
query94	1835	200	206	200
query95	1093	1084	1049	1049
query96	636	330	323	323
query97	6336	6241	6412	6241
query98	191	169	170	169
query99	3815	986	899	899
Total cold run time: 344125 ms
Total hot run time: 238294 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 88094e1cf71ddb7aefe46a993f659fde6d3a3897, data reload: false

query1	0.02	0.01	0.01
query2	0.06	0.02	0.02
query3	0.24	0.04	0.04
query4	1.83	0.06	0.06
query5	0.53	0.53	0.53
query6	1.24	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.51	0.48	0.48
query10	0.53	0.53	0.52
query11	0.11	0.08	0.09
query12	0.11	0.09	0.10
query13	0.61	0.62	0.60
query14	0.76	0.80	0.79
query15	0.78	0.76	0.77
query16	0.38	0.37	0.37
query17	0.98	1.03	1.01
query18	0.23	0.24	0.25
query19	1.90	1.85	1.82
query20	0.02	0.02	0.01
query21	15.47	0.55	0.54
query22	1.60	2.25	1.49
query23	17.65	0.99	0.95
query24	5.08	1.01	1.34
query25	1.56	0.12	0.11
query26	0.24	0.14	0.13
query27	0.12	0.11	0.11
query28	7.58	0.75	0.70
query29	12.73	2.34	2.31
query30	0.55	0.50	0.51
query31	2.83	0.36	0.38
query32	3.43	0.49	0.49
query33	3.07	3.08	3.07
query34	15.24	4.79	4.80
query35	4.84	4.85	4.87
query36	1.04	1.01	1.02
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.15	0.15	0.13
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 104.29 s
Total hot run time: 30.72 s

@doris-robot
Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 88094e1cf71ddb7aefe46a993f659fde6d3a3897 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@morrySnow morrySnow merged commit a829c63 into apache:branch-2.0 Feb 2, 2024
@morrySnow morrySnow deleted the 2.0_30765 branch February 4, 2024 01:45
eldenmoon pushed a commit to eldenmoon/incubator-doris that referenced this pull request Apr 9, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants