Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](short circurt) fix return default value issue #34186

Merged
merged 4 commits into from
May 29, 2024

Conversation

felixwluo
Copy link
Contributor

@felixwluo felixwluo commented Apr 26, 2024

Proposed changes

Issue Number: close #34056

  1. problem
    When using short circurt for point-checking, if a field in the table constructor clause has a default value and a NULL value is written later, the query returns the default value instead of the NULL value

  2. recurrence

CREATE TABLE IF NOT EXISTS test.test_001 (
    id int NOT NULL COMMENT "id",
    test_time DATETIMEV2(3) DEFAULT "1970-01-01 00:00:00.111" COMMENT "access time"
) UNIQUE KEY(id) DISTRIBUTED BY HASH(id) BUCKETS 1 PROPERTIES (
    "replication_num" = "1",
    "enable_unique_key_merge_on_write" = "true",
    "light_schema_change" = "true",
    "store_row_column" = "true"
);

insert into test.test_001 values (1, NULL);

set experimental_enable_nereids_planner = false;

select test_time from test.test_001 where id= 1;

The query result is 1970-01-01 00:00:00.111

3、after restoration
Query returns NULL after repair

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

@cjj2010 cjj2010 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add a test column to verify this feature

@felixwluo
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.52% (8926/25130)
Line Coverage: 27.14% (73463/270638)
Region Coverage: 26.33% (37950/144126)
Branch Coverage: 23.12% (19334/83610)
Coverage Report: http://coverage.selectdb-in.cc/coverage/53af774126ff4658e86f0ad44291e357804e5129_53af774126ff4658e86f0ad44291e357804e5129/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 41108 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 53af774126ff4658e86f0ad44291e357804e5129, data reload: false

------ Round 1 ----------------------------------
q1	17693	4345	4219	4219
q2	2023	187	190	187
q3	10539	1257	1174	1174
q4	10207	753	715	715
q5	7522	2772	2746	2746
q6	217	127	128	127
q7	1040	627	606	606
q8	9210	2138	2086	2086
q9	9557	6942	6833	6833
q10	9039	3966	3903	3903
q11	453	240	234	234
q12	538	214	226	214
q13	17262	3141	3204	3141
q14	297	230	231	230
q15	504	462	464	462
q16	477	394	405	394
q17	973	659	712	659
q18	8370	7718	7865	7718
q19	6117	1554	1504	1504
q20	644	336	312	312
q21	5260	4198	3370	3370
q22	342	274	289	274
Total cold run time: 118284 ms
Total hot run time: 41108 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4524	4383	4408	4383
q2	361	277	278	277
q3	3220	2930	3003	2930
q4	1922	1604	1603	1603
q5	5458	5558	5569	5558
q6	208	122	125	122
q7	2341	1983	1997	1983
q8	3309	3451	3389	3389
q9	8870	9009	8971	8971
q10	4047	3718	3860	3718
q11	592	503	499	499
q12	827	620	668	620
q13	16899	3209	3189	3189
q14	302	313	307	307
q15	533	502	489	489
q16	498	452	449	449
q17	1807	1481	1482	1481
q18	7996	7709	7495	7495
q19	7136	1619	1497	1497
q20	2048	1766	1735	1735
q21	13940	5060	4943	4943
q22	620	512	553	512
Total cold run time: 87458 ms
Total hot run time: 56150 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186957 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 53af774126ff4658e86f0ad44291e357804e5129, data reload: false

query1	2624	382	356	356
query2	8473	2355	2328	2328
query3	7849	229	215	215
query4	25857	21172	21223	21172
query5	4107	414	425	414
query6	259	187	194	187
query7	4587	279	274	274
query8	240	179	181	179
query9	8712	2314	2290	2290
query10	441	265	247	247
query11	14774	14150	14269	14150
query12	136	91	85	85
query13	1637	368	368	368
query14	10557	8201	8223	8201
query15	276	169	167	167
query16	8255	272	262	262
query17	2034	565	561	561
query18	2144	287	281	281
query19	344	151	152	151
query20	95	86	87	86
query21	197	130	130	130
query22	5022	4815	4851	4815
query23	33929	33043	33102	33043
query24	9270	2906	2941	2906
query25	590	416	389	389
query26	697	154	149	149
query27	2082	315	317	315
query28	5735	2000	2007	2000
query29	909	611	594	594
query30	293	152	155	152
query31	1006	755	729	729
query32	92	54	55	54
query33	612	241	241	241
query34	877	464	486	464
query35	760	686	659	659
query36	1045	874	886	874
query37	107	62	68	62
query38	3147	3033	2989	2989
query39	1644	1517	1532	1517
query40	200	127	124	124
query41	41	38	37	37
query42	105	93	98	93
query43	541	543	551	543
query44	1103	719	730	719
query45	287	270	267	267
query46	1068	719	699	699
query47	1939	1833	1861	1833
query48	364	305	288	288
query49	956	407	392	392
query50	771	364	379	364
query51	6900	6714	6753	6714
query52	95	89	91	89
query53	347	274	277	274
query54	272	229	230	229
query55	77	71	71	71
query56	244	222	212	212
query57	1201	1154	1105	1105
query58	220	192	207	192
query59	3380	3244	3032	3032
query60	253	230	235	230
query61	116	91	89	89
query62	621	452	446	446
query63	299	273	276	273
query64	8243	7133	7105	7105
query65	3092	3014	3056	3014
query66	819	336	350	336
query67	15698	14964	15322	14964
query68	5797	538	533	533
query69	520	302	306	302
query70	1158	1155	1151	1151
query71	476	265	265	265
query72	8222	2596	2453	2453
query73	724	313	324	313
query74	6505	6145	6024	6024
query75	3756	2656	2697	2656
query76	4150	1002	942	942
query77	655	258	263	258
query78	11191	10103	10081	10081
query79	8724	530	513	513
query80	1621	439	434	434
query81	546	223	216	216
query82	1654	91	88	88
query83	200	162	164	162
query84	266	83	82	82
query85	1379	294	255	255
query86	458	318	275	275
query87	3276	3123	3129	3123
query88	5076	2311	2297	2297
query89	560	368	372	368
query90	2018	184	182	182
query91	123	96	94	94
query92	55	45	50	45
query93	6855	521	496	496
query94	1186	181	181	181
query95	1097	1099	1093	1093
query96	604	264	261	261
query97	3201	2953	2958	2953
query98	236	220	214	214
query99	1225	857	881	857
Total cold run time: 304181 ms
Total hot run time: 186957 ms

@felixwluo
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 40682 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5536bf5f5b00dbcceb8848820be62cee793d48ff, data reload: false

------ Round 1 ----------------------------------
q1	17622	4464	4376	4376
q2	2415	185	193	185
q3	11059	1216	1211	1211
q4	10521	786	760	760
q5	7690	2803	2725	2725
q6	219	134	135	134
q7	1079	620	611	611
q8	9626	2161	2074	2074
q9	9370	6762	6656	6656
q10	8815	3780	3752	3752
q11	460	238	254	238
q12	389	222	219	219
q13	18632	2948	2971	2948
q14	267	233	234	233
q15	519	483	477	477
q16	511	397	393	393
q17	952	691	684	684
q18	8085	7590	7580	7580
q19	1622	1570	1511	1511
q20	658	292	323	292
q21	5140	3953	3345	3345
q22	350	278	287	278
Total cold run time: 116001 ms
Total hot run time: 40682 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4272	4187	4244	4187
q2	384	261	269	261
q3	3021	2745	2776	2745
q4	1869	1536	1537	1536
q5	5307	5344	5300	5300
q6	204	120	123	120
q7	2252	1890	1911	1890
q8	3179	3309	3344	3309
q9	8589	8618	8583	8583
q10	3893	3735	3678	3678
q11	583	484	503	484
q12	764	577	569	569
q13	16317	2989	2960	2960
q14	301	284	282	282
q15	509	498	481	481
q16	462	421	419	419
q17	1743	1484	1457	1457
q18	7613	7561	7513	7513
q19	1633	1550	1510	1510
q20	1966	1754	1757	1754
q21	5030	4826	4884	4826
q22	582	502	511	502
Total cold run time: 70473 ms
Total hot run time: 54366 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.51% (8923/25130)
Line Coverage: 27.13% (73433/270638)
Region Coverage: 26.32% (37939/144126)
Branch Coverage: 23.11% (19321/83610)
Coverage Report: http://coverage.selectdb-in.cc/coverage/5536bf5f5b00dbcceb8848820be62cee793d48ff_5536bf5f5b00dbcceb8848820be62cee793d48ff/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 187298 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5536bf5f5b00dbcceb8848820be62cee793d48ff, data reload: false

query1	918	361	345	345
query2	6470	2466	2266	2266
query3	6651	202	206	202
query4	23560	21118	21149	21118
query5	4162	434	412	412
query6	257	174	171	171
query7	4584	297	291	291
query8	255	207	188	188
query9	8314	2343	2330	2330
query10	438	247	254	247
query11	14690	14280	14331	14280
query12	145	94	88	88
query13	1657	377	388	377
query14	9457	7654	7542	7542
query15	247	172	177	172
query16	8061	251	269	251
query17	1864	555	539	539
query18	2074	274	273	273
query19	198	151	147	147
query20	106	92	92	92
query21	192	125	126	125
query22	5022	4864	4778	4778
query23	33914	33366	33272	33272
query24	11845	2962	2960	2960
query25	663	367	364	364
query26	1782	158	150	150
query27	3115	321	329	321
query28	7692	2005	2020	2005
query29	1040	605	594	594
query30	301	148	151	148
query31	1001	738	728	728
query32	87	51	55	51
query33	746	261	244	244
query34	1094	482	480	480
query35	819	704	668	668
query36	1055	924	926	924
query37	274	71	70	70
query38	3168	3033	2984	2984
query39	1635	1556	1530	1530
query40	276	123	127	123
query41	42	39	39	39
query42	106	96	93	93
query43	564	553	531	531
query44	1219	732	756	732
query45	288	278	250	250
query46	1075	702	720	702
query47	1907	1871	1856	1856
query48	368	301	296	296
query49	1214	425	418	418
query50	769	399	384	384
query51	6834	6867	6724	6724
query52	106	96	93	93
query53	352	282	280	280
query54	319	247	249	247
query55	79	75	73	73
query56	249	230	231	230
query57	1222	1122	1143	1122
query58	239	201	200	200
query59	3535	3273	3260	3260
query60	262	251	243	243
query61	111	108	107	107
query62	639	438	437	437
query63	308	285	280	280
query64	9585	7216	7201	7201
query65	3121	3054	3037	3037
query66	1409	348	361	348
query67	15633	14991	15105	14991
query68	8464	563	576	563
query69	538	312	311	311
query70	1235	1102	1148	1102
query71	580	267	277	267
query72	8095	2602	2454	2454
query73	740	320	323	320
query74	6614	6132	6156	6132
query75	4103	2662	2683	2662
query76	5051	989	986	986
query77	623	259	262	259
query78	11086	10139	10379	10139
query79	12693	520	509	509
query80	1813	434	417	417
query81	491	227	216	216
query82	729	91	92	91
query83	199	168	164	164
query84	269	80	80	80
query85	1516	258	254	254
query86	403	287	277	277
query87	3427	3060	3076	3060
query88	5441	2321	2312	2312
query89	544	370	379	370
query90	1977	182	173	173
query91	120	93	95	93
query92	54	45	46	45
query93	7617	526	510	510
query94	1225	182	171	171
query95	1093	1100	1091	1091
query96	617	264	263	263
query97	3161	2921	2927	2921
query98	244	219	214	214
query99	1289	848	851	848
Total cold run time: 313435 ms
Total hot run time: 187298 ms

dataroaring
dataroaring previously approved these changes Apr 28, 2024
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 28, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

cambyzju
cambyzju previously approved these changes Apr 29, 2024
Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

eldenmoon
eldenmoon previously approved these changes May 10, 2024
Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@eldenmoon eldenmoon self-requested a review May 10, 2024 09:43
@@ -107,7 +107,7 @@ void JsonbSerializeUtil::jsonb_to_block(const DataTypeSerDeSPtrs& serdes, const
MutableColumnPtr col = column_type_name.column->assume_mutable();
if (col->size() < num_rows + 1) {
DCHECK(col->size() == num_rows);
if (default_values[i].empty()) {
if (default_values[i].empty() || col->empty()) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe it's wrong, the col always empty for the start, so when default_values[i] is not emtpy, it may result incorrect value

@felixwluo felixwluo dismissed stale reviews from eldenmoon, cambyzju, and dataroaring via 796ccaa May 14, 2024 03:52
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@felixwluo
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 41644 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5f58566dcd9d7b3d11d37575609fd3c475c42567, data reload: false

------ Round 1 ----------------------------------
q1	17615	4344	4251	4251
q2	2018	199	203	199
q3	10439	1217	1173	1173
q4	10197	784	857	784
q5	7466	2716	2704	2704
q6	220	142	140	140
q7	955	607	620	607
q8	9220	2135	2094	2094
q9	9235	6655	6719	6655
q10	9084	3912	3883	3883
q11	476	245	242	242
q12	489	229	226	226
q13	17918	3285	3229	3229
q14	297	230	214	214
q15	532	480	483	480
q16	518	390	373	373
q17	966	738	676	676
q18	8316	7873	7626	7626
q19	3817	1571	1537	1537
q20	658	319	317	317
q21	5159	3965	4245	3965
q22	358	269	283	269
Total cold run time: 115953 ms
Total hot run time: 41644 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4517	4434	4397	4397
q2	375	268	270	268
q3	3146	2875	2933	2875
q4	2020	1604	1577	1577
q5	5339	5488	5496	5488
q6	215	128	129	128
q7	2219	1832	1838	1832
q8	3219	3395	3411	3395
q9	8654	8667	8680	8667
q10	4056	3793	3764	3764
q11	589	504	512	504
q12	790	609	633	609
q13	15989	3155	3167	3155
q14	291	275	288	275
q15	532	505	476	476
q16	500	455	449	449
q17	1809	1525	1528	1525
q18	7839	7655	7477	7477
q19	1653	1501	1599	1501
q20	2012	1782	1797	1782
q21	10310	4811	4766	4766
q22	628	498	486	486
Total cold run time: 76702 ms
Total hot run time: 55396 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169192 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5f58566dcd9d7b3d11d37575609fd3c475c42567, data reload: false

query1	936	382	383	382
query2	6937	2409	2361	2361
query3	6643	210	208	208
query4	19210	17434	17220	17220
query5	4127	423	404	404
query6	249	155	165	155
query7	4593	296	301	296
query8	238	185	187	185
query9	8381	2426	2420	2420
query10	445	297	276	276
query11	10657	10018	10066	10018
query12	138	90	87	87
query13	1644	381	384	381
query14	10093	7518	7654	7518
query15	237	165	165	165
query16	8071	277	267	267
query17	1679	522	517	517
query18	2096	271	273	271
query19	199	156	156	156
query20	91	82	86	82
query21	192	129	132	129
query22	4346	3877	3840	3840
query23	33462	32987	32920	32920
query24	6814	2812	2760	2760
query25	562	356	379	356
query26	698	156	156	156
query27	2017	334	326	326
query28	4019	2095	2084	2084
query29	857	610	592	592
query30	238	148	150	148
query31	951	754	723	723
query32	97	53	53	53
query33	502	270	263	263
query34	864	480	486	480
query35	703	606	595	595
query36	1030	932	913	913
query37	104	63	66	63
query38	2859	2765	2786	2765
query39	866	797	798	797
query40	197	121	128	121
query41	45	43	45	43
query42	100	94	92	92
query43	595	558	545	545
query44	1071	719	742	719
query45	175	164	157	157
query46	1060	723	693	693
query47	1845	1755	1754	1754
query48	360	298	304	298
query49	833	381	393	381
query50	757	376	394	376
query51	6944	6793	6723	6723
query52	97	93	90	90
query53	358	293	281	281
query54	537	433	427	427
query55	71	72	70	70
query56	261	245	243	243
query57	1078	1020	1064	1020
query58	232	230	212	212
query59	3514	3103	3109	3103
query60	269	247	259	247
query61	90	86	88	86
query62	587	464	451	451
query63	311	289	290	289
query64	8466	2222	1718	1718
query65	3179	3077	3105	3077
query66	823	333	324	324
query67	14995	14562	14662	14562
query68	5172	545	541	541
query69	493	271	268	268
query70	1161	1031	1158	1031
query71	454	265	265	265
query72	8281	2726	2560	2560
query73	773	326	324	324
query74	5979	5642	5598	5598
query75	3625	2619	2615	2615
query76	3321	966	933	933
query77	596	266	269	266
query78	10265	9757	9749	9749
query79	1652	514	507	507
query80	975	438	427	427
query81	485	222	226	222
query82	670	90	88	88
query83	191	169	166	166
query84	267	88	83	83
query85	995	266	256	256
query86	443	299	294	294
query87	3351	3122	3093	3093
query88	3855	2472	2475	2472
query89	470	385	373	373
query90	2116	183	189	183
query91	122	97	96	96
query92	59	49	50	49
query93	1950	522	503	503
query94	1133	188	189	188
query95	404	313	315	313
query96	584	269	273	269
query97	3204	2967	2978	2967
query98	248	219	204	204
query99	1237	855	856	855
Total cold run time: 261226 ms
Total hot run time: 169192 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.22 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5f58566dcd9d7b3d11d37575609fd3c475c42567, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.07	0.07
query5	0.50	0.47	0.49
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.49	0.47
query10	0.57	0.56	0.54
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.59	0.59	0.60
query14	0.77	0.78	0.78
query15	0.83	0.82	0.81
query16	0.35	0.36	0.37
query17	0.91	1.00	0.92
query18	0.20	0.27	0.25
query19	1.78	1.82	1.72
query20	0.02	0.01	0.01
query21	15.59	0.66	0.64
query22	4.44	8.00	1.62
query23	18.29	1.38	1.29
query24	1.81	0.22	0.20
query25	0.15	0.08	0.08
query26	0.27	0.16	0.16
query27	0.09	0.08	0.08
query28	13.41	1.01	0.99
query29	13.88	3.24	3.23
query30	0.24	0.07	0.06
query31	2.86	0.37	0.38
query32	3.31	0.47	0.47
query33	2.90	2.86	2.93
query34	17.33	4.47	4.48
query35	4.54	4.57	4.67
query36	0.66	0.46	0.49
query37	0.16	0.16	0.16
query38	0.15	0.14	0.14
query39	0.04	0.03	0.03
query40	0.15	0.12	0.14
query41	0.09	0.05	0.04
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 111.06 s
Total hot run time: 30.22 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.58% (8956/25172)
Line Coverage: 27.18% (73974/272138)
Region Coverage: 26.44% (38318/144901)
Branch Coverage: 23.37% (19574/83766)
Coverage Report: http://coverage.selectdb-in.cc/coverage/5f58566dcd9d7b3d11d37575609fd3c475c42567_5f58566dcd9d7b3d11d37575609fd3c475c42567/report/index.html

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 40640 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8c54f195832348ed3cd933ff2a3774666f150eb1, data reload: false

------ Round 1 ----------------------------------
q1	18435	4470	4399	4399
q2	2473	201	200	200
q3	11683	1206	1231	1206
q4	11119	861	735	735
q5	7506	2709	2646	2646
q6	221	137	139	137
q7	959	597	594	594
q8	9214	2044	2061	2044
q9	8736	6464	6472	6464
q10	8884	3682	3752	3682
q11	453	245	241	241
q12	461	223	231	223
q13	17760	3010	3019	3010
q14	270	214	216	214
q15	515	477	481	477
q16	509	385	398	385
q17	955	729	649	649
q18	7976	7419	7491	7419
q19	5814	1526	1473	1473
q20	655	308	316	308
q21	4956	3855	3880	3855
q22	351	279	284	279
Total cold run time: 119905 ms
Total hot run time: 40640 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4349	4232	4206	4206
q2	382	273	271	271
q3	2919	2762	2763	2762
q4	1879	1539	1596	1539
q5	5240	5294	5249	5249
q6	213	125	129	125
q7	2093	1789	1774	1774
q8	3193	3336	3305	3305
q9	8309	8253	8316	8253
q10	3880	3718	3685	3685
q11	592	494	498	494
q12	767	587	595	587
q13	17537	2998	3006	2998
q14	310	265	286	265
q15	516	485	475	475
q16	503	413	432	413
q17	1787	1492	1473	1473
q18	7654	7421	7303	7303
q19	1652	1575	1526	1526
q20	2022	1775	1781	1775
q21	9910	4849	4647	4647
q22	595	513	499	499
Total cold run time: 76302 ms
Total hot run time: 53624 ms

@felixwluo
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39911 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a297753851003434bf3d92d885d617b04a554170, data reload: false

------ Round 1 ----------------------------------
q1	17630	4960	4280	4280
q2	2031	196	195	195
q3	10450	1254	1197	1197
q4	10156	816	778	778
q5	7484	2667	2651	2651
q6	213	132	133	132
q7	942	603	589	589
q8	9226	2087	2104	2087
q9	9231	6490	6487	6487
q10	9013	3762	3697	3697
q11	463	239	253	239
q12	449	214	223	214
q13	17772	2987	2982	2982
q14	262	226	225	225
q15	510	474	471	471
q16	532	389	381	381
q17	986	685	772	685
q18	8073	7378	7517	7378
q19	1608	1550	1469	1469
q20	663	313	322	313
q21	5014	3185	3966	3185
q22	344	285	276	276
Total cold run time: 113052 ms
Total hot run time: 39911 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4351	4248	4219	4219
q2	375	272	275	272
q3	2991	2724	2743	2724
q4	1903	1609	1651	1609
q5	5294	5273	5301	5273
q6	214	125	129	125
q7	2127	1714	1739	1714
q8	3208	3341	3328	3328
q9	8417	8390	8390	8390
q10	3907	3674	3697	3674
q11	585	504	518	504
q12	779	607	588	588
q13	16430	2961	2988	2961
q14	288	264	256	256
q15	522	473	482	473
q16	487	424	411	411
q17	1805	1518	1481	1481
q18	7612	7461	7387	7387
q19	1650	1558	1581	1558
q20	1996	1800	1806	1800
q21	4900	4642	4877	4642
q22	578	490	506	490
Total cold run time: 70419 ms
Total hot run time: 53879 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.77% (9005/25176)
Line Coverage: 27.38% (74556/272269)
Region Coverage: 26.60% (38567/145012)
Branch Coverage: 23.48% (19672/83794)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a297753851003434bf3d92d885d617b04a554170_a297753851003434bf3d92d885d617b04a554170/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 172933 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a297753851003434bf3d92d885d617b04a554170, data reload: false

query1	916	387	384	384
query2	6465	2510	2406	2406
query3	6641	204	206	204
query4	19818	17307	17396	17307
query5	4204	426	421	421
query6	257	156	154	154
query7	4599	303	288	288
query8	240	180	181	180
query9	8843	2462	2424	2424
query10	452	278	266	266
query11	10514	10128	10018	10018
query12	129	91	86	86
query13	1660	369	374	369
query14	9393	7738	7536	7536
query15	219	166	174	166
query16	7896	274	271	271
query17	1829	530	532	530
query18	1998	273	268	268
query19	200	155	162	155
query20	100	86	82	82
query21	200	127	135	127
query22	4296	3960	3813	3813
query23	33616	33046	33016	33016
query24	11972	2850	2912	2850
query25	677	353	359	353
query26	1782	154	157	154
query27	2905	322	333	322
query28	7297	2076	2102	2076
query29	1090	614	603	603
query30	294	152	153	152
query31	953	756	728	728
query32	92	51	54	51
query33	766	289	265	265
query34	996	481	477	477
query35	733	602	613	602
query36	1045	905	901	901
query37	169	66	66	66
query38	2887	2761	2738	2738
query39	859	811	790	790
query40	277	123	126	123
query41	47	43	51	43
query42	104	100	97	97
query43	603	560	557	557
query44	1251	734	746	734
query45	178	157	157	157
query46	1060	712	712	712
query47	1855	1771	1778	1771
query48	386	309	300	300
query49	1224	402	429	402
query50	767	405	401	401
query51	6891	6794	6789	6789
query52	104	90	95	90
query53	352	290	280	280
query54	952	440	428	428
query55	72	71	71	71
query56	268	237	238	237
query57	1140	1044	1044	1044
query58	240	214	206	206
query59	3492	3278	3315	3278
query60	276	256	252	252
query61	100	87	89	87
query62	677	442	438	438
query63	309	286	281	281
query64	9800	2193	1703	1703
query65	3207	3135	3149	3135
query66	1418	329	337	329
query67	15159	14808	14627	14627
query68	4568	551	545	545
query69	444	268	271	268
query70	1122	1146	1110	1110
query71	389	271	264	264
query72	7442	5338	5948	5338
query73	736	328	326	326
query74	5856	5644	5517	5517
query75	3363	2570	2588	2570
query76	2796	982	1019	982
query77	423	271	269	269
query78	10281	10096	9856	9856
query79	2488	516	526	516
query80	1028	453	435	435
query81	523	227	221	221
query82	707	93	92	92
query83	261	175	171	171
query84	241	89	85	85
query85	1627	271	274	271
query86	515	317	303	303
query87	3303	3107	3066	3066
query88	4277	2442	2450	2442
query89	549	395	390	390
query90	1970	192	194	192
query91	130	98	101	98
query92	58	49	50	49
query93	1808	527	518	518
query94	1240	200	189	189
query95	411	311	324	311
query96	598	272	271	271
query97	3201	3040	3025	3025
query98	241	234	214	214
query99	1107	865	858	858
Total cold run time: 274914 ms
Total hot run time: 172933 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.07 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a297753851003434bf3d92d885d617b04a554170, data reload: false

query1	0.04	0.04	0.04
query2	0.09	0.04	0.04
query3	0.24	0.05	0.04
query4	1.68	0.06	0.07
query5	0.50	0.49	0.50
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.49	0.50
query10	0.54	0.54	0.55
query11	0.16	0.11	0.11
query12	0.14	0.11	0.12
query13	0.59	0.60	0.59
query14	0.78	0.78	0.77
query15	0.82	0.81	0.81
query16	0.37	0.37	0.37
query17	1.03	0.97	0.97
query18	0.23	0.23	0.27
query19	1.88	1.75	1.81
query20	0.02	0.01	0.01
query21	15.44	0.71	0.67
query22	4.54	6.29	2.30
query23	18.29	1.40	1.26
query24	1.51	0.29	0.19
query25	0.14	0.09	0.08
query26	0.25	0.16	0.16
query27	0.08	0.07	0.08
query28	13.56	1.00	0.98
query29	12.75	3.41	3.39
query30	0.25	0.06	0.06
query31	2.86	0.37	0.38
query32	3.30	0.48	0.46
query33	2.87	2.89	2.89
query34	17.13	4.43	4.44
query35	4.52	4.60	4.51
query36	0.65	0.46	0.46
query37	0.16	0.16	0.15
query38	0.15	0.15	0.14
query39	0.04	0.04	0.03
query40	0.20	0.15	0.15
query41	0.10	0.04	0.05
query42	0.05	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.74 s
Total hot run time: 31.07 s

Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 29, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

@nextdreamblue nextdreamblue left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@cambyzju cambyzju merged commit e000330 into apache:master May 29, 2024
26 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.x dev/2.1.4-merged p0_w reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] store row column, will get wrong result when query by SHORT-CIRCUIT
9 participants