Skip to content

Conversation

@CalvinKirs
Copy link
Member

@CalvinKirs CalvinKirs commented Jul 16, 2025

picked from #51894

…. s3.oss-cn-xxx.aliyuncs.com) (apache#51894)

### What problem does this PR solve?

apache#50238

FYI
https://help.aliyun.com/zh/oss/developer-reference/use-amazon-s3-sdks-to-access-oss

### Release note

None

(cherry picked from commit 99778fb)
@CalvinKirs CalvinKirs requested a review from morrySnow as a code owner July 16, 2025 06:51
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morrySnow
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39571 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 40d20206150c3ce1078b3c5bfdb11c86e41814ac, data reload: false

------ Round 1 ----------------------------------
q1	17571	6762	6599	6599
q2	2066	210	195	195
q3	10476	1122	1172	1122
q4	10205	731	695	695
q5	7719	2872	2839	2839
q6	217	134	132	132
q7	975	609	593	593
q8	9352	1915	2021	1915
q9	6637	6384	6398	6384
q10	7021	2249	2275	2249
q11	467	253	262	253
q12	413	209	205	205
q13	17783	2996	2975	2975
q14	247	206	210	206
q15	500	469	487	469
q16	475	376	370	370
q17	974	579	572	572
q18	7138	6655	6804	6655
q19	1307	989	886	886
q20	476	200	199	199
q21	4117	3082	3151	3082
q22	1118	976	994	976
Total cold run time: 107254 ms
Total hot run time: 39571 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6614	6752	6528	6528
q2	332	227	231	227
q3	2887	2858	2891	2858
q4	2058	1870	1926	1870
q5	5795	5821	5801	5801
q6	219	126	131	126
q7	2241	1854	1773	1773
q8	3442	3532	3525	3525
q9	9004	9040	9108	9040
q10	3566	3541	3515	3515
q11	567	484	483	483
q12	813	583	610	583
q13	8790	3196	3106	3106
q14	296	275	265	265
q15	503	462	461	461
q16	484	433	441	433
q17	1822	1608	1624	1608
q18	8316	7754	7644	7644
q19	1702	1494	1532	1494
q20	2029	1788	1795	1788
q21	5170	5025	5026	5025
q22	1173	1051	1025	1025
Total cold run time: 67823 ms
Total hot run time: 59178 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196477 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 40d20206150c3ce1078b3c5bfdb11c86e41814ac, data reload: false

query1	1291	893	891	891
query2	6338	1890	1792	1792
query3	10991	4383	4480	4383
query4	33123	23326	23551	23326
query5	3766	454	460	454
query6	269	171	189	171
query7	3991	308	321	308
query8	275	220	217	217
query9	9595	2598	2612	2598
query10	468	261	264	261
query11	17797	15316	15132	15132
query12	165	104	105	104
query13	1560	431	430	430
query14	9363	7261	6652	6652
query15	251	185	181	181
query16	8018	535	486	486
query17	1552	584	594	584
query18	2159	327	325	325
query19	241	166	167	166
query20	127	114	114	114
query21	205	116	112	112
query22	4738	4408	4409	4408
query23	34531	34400	34180	34180
query24	11766	3019	2993	2993
query25	690	445	434	434
query26	1772	180	182	180
query27	2952	356	351	351
query28	7746	2178	2195	2178
query29	1042	475	465	465
query30	278	167	164	164
query31	1047	867	804	804
query32	95	61	59	59
query33	770	321	333	321
query34	929	524	545	524
query35	959	747	725	725
query36	1122	929	951	929
query37	272	75	73	73
query38	3999	3986	4060	3986
query39	1496	1442	1468	1442
query40	261	118	115	115
query41	54	56	51	51
query42	127	106	105	105
query43	530	489	486	486
query44	1304	853	829	829
query45	187	173	179	173
query46	1180	740	750	740
query47	1968	1928	1920	1920
query48	430	345	355	345
query49	1085	390	400	390
query50	833	436	424	424
query51	7695	7205	7356	7205
query52	104	93	92	92
query53	274	190	186	186
query54	1386	485	488	485
query55	84	80	80	80
query56	279	254	255	254
query57	1335	1188	1216	1188
query58	234	217	223	217
query59	3115	3115	3040	3040
query60	296	284	264	264
query61	123	109	138	109
query62	885	701	714	701
query63	229	191	197	191
query64	5023	702	657	657
query65	3610	3296	3281	3281
query66	1291	292	297	292
query67	15884	15471	15724	15471
query68	4869	600	590	590
query69	440	266	271	266
query70	1211	1140	1102	1102
query71	344	264	261	261
query72	6193	4048	4026	4026
query73	758	351	371	351
query74	10353	8936	9277	8936
query75	3381	2648	2632	2632
query76	2679	1027	1026	1026
query77	414	275	270	270
query78	10623	9611	9494	9494
query79	1107	610	604	604
query80	792	429	433	429
query81	501	230	219	219
query82	1365	89	89	89
query83	243	141	140	140
query84	234	78	81	78
query85	1089	309	296	296
query86	313	285	305	285
query87	4406	4209	4237	4209
query88	3601	2460	2393	2393
query89	419	301	303	301
query90	2098	190	188	188
query91	140	111	109	109
query92	65	50	53	50
query93	1104	555	556	555
query94	765	296	270	270
query95	356	260	261	260
query96	605	282	285	282
query97	3285	3091	3132	3091
query98	210	196	191	191
query99	1475	1290	1305	1290
Total cold run time: 302993 ms
Total hot run time: 196477 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 40d20206150c3ce1078b3c5bfdb11c86e41814ac, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.62	0.11	0.10
query5	0.53	0.51	0.51
query6	1.12	0.73	0.73
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.56	0.50	0.52
query10	0.55	0.55	0.57
query11	0.16	0.10	0.10
query12	0.14	0.11	0.12
query13	0.60	0.59	0.59
query14	0.78	0.80	0.81
query15	0.85	0.83	0.82
query16	0.38	0.40	0.39
query17	1.07	1.06	1.03
query18	0.23	0.22	0.21
query19	1.92	1.88	1.87
query20	0.01	0.01	0.01
query21	15.41	0.61	0.62
query22	2.34	1.68	1.43
query23	16.95	1.07	0.72
query24	3.43	1.58	0.99
query25	0.33	0.04	0.08
query26	0.50	0.14	0.13
query27	0.05	0.05	0.04
query28	9.65	0.53	0.47
query29	12.58	3.24	3.21
query30	0.26	0.06	0.06
query31	2.86	0.39	0.37
query32	3.26	0.46	0.45
query33	2.96	3.02	2.95
query34	16.88	4.54	4.47
query35	4.55	4.51	4.57
query36	0.67	0.48	0.47
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.16	0.14	0.12
query41	0.07	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.06 s
Total hot run time: 29.7 s

@morrySnow morrySnow changed the title branch-3.1: [fix](oss)Support Aliyun OSS S3-Compatible Public Endpoint Format s3.oss-cn-xxx.aliyuncs.com) (#51894) branch-3.1: [fix](oss)Support Aliyun OSS S3-Compatible Public Endpoint Format s3.oss-cn-xxx.aliyuncs.com #51894 Jul 16, 2025
@morrySnow morrySnow merged commit 5fbf4b1 into apache:branch-3.1 Jul 16, 2025
23 of 24 checks passed
@CalvinKirs CalvinKirs deleted the branch-3.1--51894 branch July 17, 2025 02:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants