Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 19, 2024

and upgrade awssdk from 2.17.257 to 2.20.131.

Cherry-pick #30799

and upgrade awssdk from 2.17.257 to 2.20.131.

Cherry-pick apache#30799
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 19, 2024

run buildall

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 19, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 49793 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c7ce10f472408d79768813ab639cf2369449ee2, data reload: false

------ Round 1 ----------------------------------
q1	17955	4406	4308	4308
q2	2076	157	159	157
q3	10253	1892	1929	1892
q4	10119	1247	1309	1247
q5	8672	3942	3951	3942
q6	235	151	125	125
q7	2082	1604	1631	1604
q8	9593	2754	2728	2728
q9	13854	10358	10182	10182
q10	8658	3540	3486	3486
q11	415	251	255	251
q12	483	316	312	312
q13	18367	3973	4060	3973
q14	356	344	328	328
q15	511	461	459	459
q16	662	577	590	577
q17	1138	947	912	912
q18	7330	6997	6805	6805
q19	1770	1692	1675	1675
q20	523	308	305	305
q21	4430	4174	4087	4087
q22	528	445	438	438
Total cold run time: 120010 ms
Total hot run time: 49793 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4318	4326	4274	4274
q2	315	226	223	223
q3	4173	4157	4163	4157
q4	2773	2738	2747	2738
q5	7145	7103	7129	7103
q6	241	121	119	119
q7	3260	2833	2856	2833
q8	4394	4478	4504	4478
q9	16941	16867	16926	16867
q10	4276	4238	4262	4238
q11	748	701	682	682
q12	1038	872	860	860
q13	6843	3741	3727	3727
q14	446	427	426	426
q15	506	457	456	456
q16	739	692	672	672
q17	3864	3835	3817	3817
q18	8775	8751	8820	8751
q19	1730	1646	1655	1646
q20	2405	2130	2124	2124
q21	8475	8555	8540	8540
q22	1068	980	968	968
Total cold run time: 84473 ms
Total hot run time: 79699 ms

@w41ter w41ter marked this pull request as draft July 19, 2024 12:10
@doris-robot
Copy link

TPC-DS: Total hot run time: 203108 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c7ce10f472408d79768813ab639cf2369449ee2, data reload: false

query1	930	428	380	380
query2	6528	2500	2593	2500
query3	6921	218	206	206
query4	20289	17859	17917	17859
query5	19730	6506	6549	6506
query6	277	219	232	219
query7	4148	301	304	301
query8	419	397	424	397
query9	3093	2667	2616	2616
query10	419	303	305	303
query11	11301	10747	10752	10747
query12	129	78	76	76
query13	5606	681	666	666
query14	17606	13146	13625	13146
query15	360	241	248	241
query16	6468	294	264	264
query17	1697	1457	878	878
query18	2309	419	419	419
query19	208	152	151	151
query20	77	84	82	82
query21	193	95	95	95
query22	5170	4904	4895	4895
query23	32468	31967	31984	31967
query24	6976	6504	6452	6452
query25	514	437	428	428
query26	528	167	165	165
query27	1888	296	305	296
query28	6120	2347	2316	2316
query29	2974	2892	2780	2780
query30	252	170	177	170
query31	905	731	743	731
query32	71	64	60	60
query33	405	267	272	267
query34	851	480	474	474
query35	1150	908	931	908
query36	1370	1114	1181	1114
query37	92	59	62	59
query38	3065	2957	2964	2957
query39	1394	1331	1330	1330
query40	213	99	99	99
query41	47	49	44	44
query42	85	89	85	85
query43	766	662	695	662
query44	1156	705	726	705
query45	238	238	226	226
query46	1216	940	979	940
query47	1981	1670	1717	1670
query48	1020	725	720	720
query49	624	386	378	378
query50	869	617	612	612
query51	4796	4624	4664	4624
query52	85	86	86	86
query53	451	344	318	318
query54	2674	2434	2440	2434
query55	92	85	82	82
query56	245	230	199	199
query57	1286	1121	1085	1085
query58	207	211	201	201
query59	4287	4049	4189	4049
query60	210	209	220	209
query61	97	93	94	93
query62	910	477	526	477
query63	489	349	346	346
query64	4205	1610	1441	1441
query65	3633	3547	3538	3538
query66	688	394	380	380
query67	15381	18022	15177	15177
query68	9278	665	646	646
query69	593	355	367	355
query70	1646	1478	1376	1376
query71	417	330	313	313
query72	6662	3529	3518	3518
query73	734	319	316	316
query74	6272	5827	5845	5827
query75	5364	3748	3735	3735
query76	5807	1177	1218	1177
query77	963	264	252	252
query78	12625	11507	11465	11465
query79	9198	670	657	657
query80	1123	411	409	409
query81	485	238	235	235
query82	1276	100	102	100
query83	163	136	130	130
query84	265	72	71	71
query85	896	334	343	334
query86	328	287	294	287
query87	3204	3011	3022	3011
query88	4590	2297	2298	2297
query89	486	304	300	300
query90	1960	217	212	212
query91	192	156	141	141
query92	62	55	56	55
query93	7362	539	589	539
query94	708	210	206	206
query95	1135	1084	1057	1057
query96	646	324	325	324
query97	6524	6365	6403	6365
query98	183	176	175	175
query99	3126	922	1058	922
Total cold run time: 317125 ms
Total hot run time: 203108 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.27 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3c7ce10f472408d79768813ab639cf2369449ee2, data reload: false

query1	0.03	0.02	0.03
query2	0.07	0.03	0.02
query3	0.26	0.05	0.05
query4	1.78	0.08	0.08
query5	0.54	0.53	0.52
query6	1.25	0.62	0.62
query7	0.01	0.02	0.01
query8	0.03	0.03	0.02
query9	0.51	0.48	0.47
query10	0.54	0.53	0.54
query11	0.12	0.08	0.09
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.78
query15	0.78	0.77	0.77
query16	0.36	0.37	0.36
query17	1.01	1.04	1.03
query18	0.20	0.27	0.24
query19	1.91	1.87	1.85
query20	0.02	0.01	0.01
query21	15.44	0.56	0.54
query22	1.88	2.35	1.48
query23	16.85	0.95	0.91
query24	4.25	0.80	3.44
query25	0.34	0.11	0.05
query26	0.78	0.15	0.16
query27	0.05	0.04	0.03
query28	6.85	0.74	0.74
query29	12.69	2.34	2.13
query30	0.59	0.54	0.47
query31	2.81	0.40	0.38
query32	3.37	0.49	0.50
query33	3.07	3.11	3.09
query34	15.26	4.78	4.80
query35	4.83	4.85	4.81
query36	1.05	1.00	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.17	0.14	0.13
query41	0.07	0.02	0.02
query42	0.02	0.01	0.01
query43	0.03	0.02	0.02
Total cold run time: 101.46 s
Total hot run time: 30.27 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3c7ce10f472408d79768813ab639cf2369449ee2 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@w41ter w41ter closed this Jul 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants