Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[branch-2.0] Picks "[opt](partial update) Allow to only specify key columns in partial update #40736" #40864

Merged
merged 1 commit into from
Sep 18, 2024

Conversation

bobhan1
Copy link
Contributor

@bobhan1 bobhan1 commented Sep 14, 2024

picks #40736

fix

fix
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@bobhan1
Copy link
Contributor Author

bobhan1 commented Sep 14, 2024

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49359 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7843da8fa2e0a45772bf6d5bec8d0b171c711f63, data reload: false

------ Round 1 ----------------------------------
q1	18195	4394	4343	4343
q2	2071	157	152	152
q3	10258	1939	1982	1939
q4	10117	1271	1360	1271
q5	8536	3966	3937	3937
q6	227	119	122	119
q7	2007	1616	1588	1588
q8	9260	2760	2738	2738
q9	10224	10045	9816	9816
q10	8690	3536	3572	3536
q11	421	237	239	237
q12	475	297	298	297
q13	18382	3992	4051	3992
q14	353	335	317	317
q15	518	463	462	462
q16	544	455	458	455
q17	1168	982	955	955
q18	7348	6850	6951	6850
q19	1709	1581	1533	1533
q20	515	307	304	304
q21	4480	4234	4130	4130
q22	500	388	400	388
Total cold run time: 115998 ms
Total hot run time: 49359 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4311	4303	4328	4303
q2	323	229	225	225
q3	4179	4214	4145	4145
q4	2780	2764	2761	2761
q5	7206	7152	7207	7152
q6	241	116	119	116
q7	3306	2867	2786	2786
q8	4398	4478	4540	4478
q9	13740	13555	13672	13555
q10	4232	4314	4280	4280
q11	751	691	695	691
q12	1022	847	858	847
q13	6644	3792	3723	3723
q14	447	425	423	423
q15	496	462	459	459
q16	650	591	578	578
q17	3811	3861	3839	3839
q18	8743	8704	8716	8704
q19	1745	1723	1673	1673
q20	2366	2139	2121	2121
q21	8526	8541	8564	8541
q22	1029	926	927	926
Total cold run time: 80946 ms
Total hot run time: 76326 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.84% (8141/21513)
Line Coverage: 29.59% (67002/226411)
Region Coverage: 29.08% (34568/118880)
Branch Coverage: 24.99% (17812/71288)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7843da8fa2e0a45772bf6d5bec8d0b171c711f63_7843da8fa2e0a45772bf6d5bec8d0b171c711f63/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 212587 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7843da8fa2e0a45772bf6d5bec8d0b171c711f63, data reload: false

query1	927	394	422	394
query2	6534	2079	2145	2079
query3	6927	207	205	205
query4	23174	21893	22347	21893
query5	19729	6545	6558	6545
query6	295	215	227	215
query7	4334	306	314	306
query8	245	257	249	249
query9	3065	2658	2560	2560
query10	462	316	320	316
query11	15495	15282	15049	15049
query12	123	80	75	75
query13	1033	448	436	436
query14	17728	13274	13795	13274
query15	367	223	236	223
query16	6494	288	267	267
query17	1771	942	906	906
query18	894	316	316	316
query19	209	153	157	153
query20	84	84	78	78
query21	186	102	93	93
query22	5153	5025	5002	5002
query23	34164	33471	33649	33471
query24	7662	6390	6406	6390
query25	535	432	423	423
query26	1267	166	161	161
query27	2262	296	294	294
query28	6087	2284	2247	2247
query29	2828	2819	2843	2819
query30	241	173	175	173
query31	934	743	732	732
query32	71	60	61	60
query33	453	268	271	268
query34	878	481	467	467
query35	1134	927	947	927
query36	1518	1257	1224	1224
query37	90	61	62	61
query38	3047	3011	2929	2929
query39	1385	1339	1326	1326
query40	310	97	86	86
query41	38	36	35	35
query42	84	87	87	87
query43	768	558	624	558
query44	1197	733	729	729
query45	245	236	231	231
query46	1233	979	967	967
query47	1862	1641	1687	1641
query48	506	411	404	404
query49	644	379	378	378
query50	868	626	606	606
query51	4749	4645	4691	4645
query52	95	83	94	83
query53	231	183	179	179
query54	2659	2479	2469	2469
query55	99	87	90	87
query56	223	216	198	198
query57	1182	1210	1069	1069
query58	224	213	201	201
query59	3446	3222	3271	3222
query60	216	205	215	205
query61	98	96	105	96
query62	854	562	475	475
query63	211	183	175	175
query64	3499	1572	1380	1380
query65	3645	3538	3549	3538
query66	764	422	442	422
query67	16283	17990	15664	15664
query68	11208	658	646	646
query69	512	278	255	255
query70	2076	1386	1318	1318
query71	413	317	309	309
query72	6827	4350	4858	4350
query73	755	320	325	320
query74	6239	5916	5789	5789
query75	5379	3787	3706	3706
query76	6774	1189	1212	1189
query77	1190	264	268	264
query78	12613	11445	12513	11445
query79	11399	660	654	654
query80	948	390	398	390
query81	462	237	237	237
query82	558	100	100	100
query83	170	141	138	138
query84	266	73	70	70
query85	882	320	323	320
query86	332	299	292	292
query87	3254	3032	3055	3032
query88	4174	2407	2413	2407
query89	434	289	282	282
query90	1965	214	225	214
query91	164	125	138	125
query92	58	53	56	53
query93	5478	560	538	538
query94	730	216	215	215
query95	1978	1657	1994	1657
query96	673	334	335	334
query97	6556	6379	6447	6379
query98	210	218	216	216
query99	2932	907	951	907
Total cold run time: 323627 ms
Total hot run time: 212587 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.6 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7843da8fa2e0a45772bf6d5bec8d0b171c711f63, data reload: false

query1	0.02	0.02	0.03
query2	0.07	0.03	0.02
query3	0.25	0.05	0.04
query4	1.80	0.06	0.06
query5	0.55	0.52	0.52
query6	1.29	0.62	0.61
query7	0.02	0.01	0.01
query8	0.03	0.03	0.02
query9	0.51	0.48	0.47
query10	0.54	0.52	0.53
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.80	0.77
query15	0.77	0.76	0.77
query16	0.37	0.39	0.38
query17	1.04	1.03	0.98
query18	0.24	0.26	0.24
query19	1.87	1.90	1.88
query20	0.02	0.01	0.01
query21	15.47	0.54	0.56
query22	1.92	2.55	1.61
query23	17.38	1.00	0.93
query24	4.86	2.39	0.90
query25	0.32	0.14	0.03
query26	0.64	0.15	0.16
query27	0.05	0.05	0.05
query28	7.11	0.75	0.74
query29	12.77	2.29	2.26
query30	0.60	0.51	0.54
query31	2.81	0.39	0.37
query32	3.39	0.50	0.49
query33	3.06	3.09	3.08
query34	15.26	4.80	4.79
query35	4.85	4.87	4.82
query36	1.04	1.00	1.01
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 102.95 s
Total hot run time: 30.6 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7843da8fa2e0a45772bf6d5bec8d0b171c711f63 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Sep 14, 2024

run p0

@dataroaring dataroaring merged commit a0e1d4c into apache:branch-2.0 Sep 18, 2024
20 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants