Skip to content

[enhancement](jdbc catalog) Enhance function pushdown of Jdbc Oracle Catalog#30513

Merged
zy-kkk merged 1 commit intoapache:branch-2.0from
zy-kkk:oracle_nvl_2
Jan 30, 2024
Merged

[enhancement](jdbc catalog) Enhance function pushdown of Jdbc Oracle Catalog#30513
zy-kkk merged 1 commit intoapache:branch-2.0from
zy-kkk:oracle_nvl_2

Conversation

@zy-kkk
Copy link
Member

@zy-kkk zy-kkk commented Jan 29, 2024

Proposed changes

Issue Number: close #xxx

pick #29972

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@zy-kkk
Copy link
Member Author

zy-kkk commented Jan 29, 2024

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. kind/test labels Jan 29, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 50123 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7bd4cf2fa1158d77fd92e96a24973590f1101940, data reload: false

------ Round 1 ----------------------------------
q1	17699	4619	4360	4360
q2	2034	152	147	147
q3	10279	1858	1961	1858
q4	10164	1286	1327	1286
q5	8438	4000	3999	3999
q6	231	121	118	118
q7	2012	1628	1597	1597
q8	9302	2720	2732	2720
q9	10713	10458	10437	10437
q10	8636	3549	3523	3523
q11	396	251	242	242
q12	459	301	306	301
q13	18348	3970	4031	3970
q14	346	321	325	321
q15	510	449	459	449
q16	698	592	588	588
q17	1128	966	973	966
q18	7170	7029	6906	6906
q19	1675	1554	1536	1536
q20	536	289	311	289
q21	4473	4114	4146	4114
q22	511	396	399	396
Total cold run time: 115758 ms
Total hot run time: 50123 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4292	4281	4347	4281
q2	314	216	227	216
q3	4194	4142	4155	4142
q4	2759	2749	2753	2749
q5	7334	7134	7207	7134
q6	233	118	116	116
q7	3306	2914	2842	2842
q8	4368	4484	4510	4484
q9	17164	16854	17010	16854
q10	4249	4360	4242	4242
q11	727	683	690	683
q12	1030	849	859	849
q13	7464	3730	3755	3730
q14	457	418	425	418
q15	500	448	469	448
q16	749	696	720	696
q17	3783	3947	3861	3861
q18	8926	8871	8865	8865
q19	1723	1705	1663	1663
q20	2339	2167	2134	2134
q21	8494	8608	8521	8521
q22	1019	958	974	958
Total cold run time: 85424 ms
Total hot run time: 79886 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 244096 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7bd4cf2fa1158d77fd92e96a24973590f1101940, data reload: false

query1	930	391	386	386
query2	6526	2178	1990	1990
query3	6913	206	196	196
query4	19940	18083	17940	17940
query5	19707	6255	6228	6228
query6	280	208	226	208
query7	4153	302	303	302
query8	298	255	238	238
query9	3131	2714	2652	2652
query10	402	308	293	293
query11	11190	10679	10623	10623
query12	117	77	67	67
query13	5656	628	608	608
query14	17481	13417	13567	13417
query15	401	235	245	235
query16	6460	267	269	267
query17	3199	875	859	859
query18	2253	426	405	405
query19	204	144	142	142
query20	75	74	81	74
query21	184	96	88	88
query22	5286	4966	4973	4966
query23	32555	31785	32094	31785
query24	7047	6524	6519	6519
query25	513	426	421	421
query26	532	167	161	161
query27	1887	298	295	295
query28	6001	2236	2194	2194
query29	2875	2745	2769	2745
query30	234	164	159	159
query31	894	739	761	739
query32	60	62	59	59
query33	403	251	251	251
query34	845	468	471	468
query35	1153	950	931	931
query36	1469	1701	1477	1477
query37	90	62	58	58
query38	3059	2894	2876	2876
query39	1376	1328	1315	1315
query40	200	100	96	96
query41	37	33	32	32
query42	94	87	90	87
query43	657	619	552	552
query44	1105	714	708	708
query45	237	230	228	228
query46	1236	963	950	950
query47	1888	1763	1693	1693
query48	960	684	671	671
query49	623	380	374	374
query50	870	617	609	609
query51	5635	5535	5513	5513
query52	100	70	87	70
query53	441	322	314	314
query54	2410	2278	2260	2260
query55	83	70	79	70
query56	203	193	200	193
query57	1162	1057	1028	1028
query58	200	208	204	204
query59	3489	3448	3212	3212
query60	199	195	198	195
query61	85	87	84	84
query62	737	473	475	473
query63	479	333	338	333
query64	2069	1293	1296	1293
query65	3724	3587	3643	3587
query66	824	379	363	363
query67	16080	17718	15380	15380
query68	7762	636	666	636
query69	555	332	325	325
query70	2066	1627	1763	1627
query71	368	301	304	301
query72	4479	3351	3394	3351
query73	728	318	322	318
query74	6365	5889	5897	5889
query75	4388	3552	3566	3552
query76	4549	1191	1216	1191
query77	559	246	249	246
query78	32949	53779	54319	53779
query79	15465	660	629	629
query80	4556	383	397	383
query81	573	231	232	231
query82	1384	95	96	95
query83	332	133	132	132
query84	261	69	68	68
query85	1813	279	281	279
query86	452	354	410	354
query87	3278	2991	2987	2987
query88	7071	2278	2299	2278
query89	446	272	270	270
query90	2512	213	219	213
query91	151	116	118	116
query92	62	53	52	52
query93	6111	588	551	551
query94	1662	213	205	205
query95	1111	1065	1090	1065
query96	650	343	317	317
query97	6401	6353	6383	6353
query98	202	174	178	174
query99	3662	920	923	920
Total cold run time: 344529 ms
Total hot run time: 244096 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.81 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7bd4cf2fa1158d77fd92e96a24973590f1101940, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.02	0.02
query3	0.25	0.04	0.05
query4	1.83	0.06	0.06
query5	0.53	0.52	0.52
query6	1.25	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.51	0.47	0.48
query10	0.54	0.54	0.54
query11	0.12	0.09	0.09
query12	0.11	0.08	0.08
query13	0.62	0.61	0.61
query14	0.78	0.80	0.78
query15	0.76	0.76	0.77
query16	0.37	0.37	0.36
query17	0.98	1.02	0.97
query18	0.21	0.26	0.28
query19	1.92	1.85	1.85
query20	0.01	0.01	0.01
query21	15.48	0.55	0.53
query22	2.05	2.80	1.45
query23	17.46	1.04	0.94
query24	5.46	1.04	1.37
query25	2.20	0.17	0.15
query26	0.15	0.14	0.15
query27	0.15	0.16	0.15
query28	6.95	0.76	0.71
query29	12.66	2.33	2.41
query30	0.57	0.52	0.51
query31	2.82	0.39	0.37
query32	3.42	0.50	0.48
query33	3.08	3.10	3.05
query34	15.29	4.79	4.79
query35	4.85	4.86	4.83
query36	1.06	1.01	1.01
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.01	0.01	0.01
query40	0.16	0.13	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.93 s
Total hot run time: 30.81 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7bd4cf2fa1158d77fd92e96a24973590f1101940 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@zy-kkk zy-kkk merged commit b69344f into apache:branch-2.0 Jan 30, 2024
@zy-kkk zy-kkk deleted the oracle_nvl_2 branch January 30, 2024 15:24
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants