Skip to content

[fix](Hive-Catalog) fix NPE when using jdbc to access Hive metadata#31559

Merged
zy-kkk merged 1 commit intoapache:masterfrom
BePPPower:fixJdbcHive
Feb 29, 2024
Merged

[fix](Hive-Catalog) fix NPE when using jdbc to access Hive metadata#31559
zy-kkk merged 1 commit intoapache:masterfrom
BePPPower:fixJdbcHive

Conversation

@BePPPower
Copy link
Copy Markdown
Contributor

@BePPPower BePPPower commented Feb 28, 2024

Proposed changes

Issue Number: close #xxx

This bug was introduced by: #30844

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@BePPPower
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 38267 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f6acb9d426cf6b6409890bd7e1ad38a319ea5514, data reload: false

------ Round 1 ----------------------------------
q1	17928	4239	4174	4174
q2	2307	150	138	138
q3	11922	970	985	970
q4	5005	991	970	970
q5	8068	2979	3116	2979
q6	187	125	126	125
q7	1306	790	790	790
q8	9930	2064	2049	2049
q9	7225	6359	6320	6320
q10	8215	2456	2523	2456
q11	424	215	210	210
q12	728	318	321	318
q13	17959	3216	3265	3216
q14	293	258	252	252
q15	530	488	492	488
q16	473	406	422	406
q17	954	899	888	888
q18	6449	6185	5857	5857
q19	1579	1522	1530	1522
q20	478	277	274	274
q21	5768	3568	3575	3568
q22	633	307	297	297
Total cold run time: 108361 ms
Total hot run time: 38267 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4057	4017	4021	4017
q2	304	215	222	215
q3	2976	2951	2971	2951
q4	1863	1834	1890	1834
q5	5190	5142	5158	5142
q6	199	115	117	115
q7	2181	1724	1743	1724
q8	3144	3219	3239	3219
q9	8307	8263	8261	8261
q10	4692	3679	3661	3661
q11	520	433	423	423
q12	678	532	528	528
q13	3756	3081	3087	3081
q14	275	253	255	253
q15	540	500	488	488
q16	511	469	462	462
q17	1696	1692	1695	1692
q18	7642	7520	7399	7399
q19	1658	1650	1653	1650
q20	2083	1890	1898	1890
q21	4887	4690	4745	4690
q22	539	456	467	456
Total cold run time: 57698 ms
Total hot run time: 54151 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 168816 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f6acb9d426cf6b6409890bd7e1ad38a319ea5514, data reload: false

query1	923	342	338	338
query2	6529	1756	1679	1679
query3	6706	210	209	209
query4	23389	20591	20542	20542
query5	4238	364	361	361
query6	269	161	172	161
query7	4605	298	295	295
query8	262	203	200	200
query9	8420	2272	2253	2253
query10	424	227	202	202
query11	14682	14247	14204	14204
query12	129	86	83	83
query13	1637	437	434	434
query14	8970	6227	6726	6227
query15	206	175	181	175
query16	7081	273	261	261
query17	1017	525	493	493
query18	1905	270	261	261
query19	202	151	145	145
query20	86	82	83	82
query21	190	128	132	128
query22	4864	4559	4587	4559
query23	30685	30015	29946	29946
query24	11791	3110	3034	3034
query25	639	353	334	334
query26	1824	151	157	151
query27	3011	307	308	307
query28	7021	1844	1828	1828
query29	1199	557	561	557
query30	283	133	141	133
query31	873	683	681	681
query32	93	57	57	57
query33	733	227	230	227
query34	1023	481	485	481
query35	848	732	750	732
query36	967	886	873	873
query37	163	61	64	61
query38	3090	3009	2978	2978
query39	1302	1249	1255	1249
query40	281	107	99	99
query41	37	36	35	35
query42	102	94	99	94
query43	451	471	424	424
query44	1070	688	710	688
query45	191	183	177	177
query46	1046	800	784	784
query47	1546	1470	1433	1433
query48	405	334	344	334
query49	1150	306	306	306
query50	779	361	369	361
query51	4380	4254	4298	4254
query52	95	95	91	91
query53	336	262	261	261
query54	307	217	217	217
query55	82	84	79	79
query56	219	211	208	208
query57	952	859	904	859
query58	210	183	213	183
query59	2179	2036	2084	2036
query60	232	220	210	210
query61	87	85	90	85
query62	596	368	357	357
query63	279	259	251	251
query64	6549	2988	3183	2988
query65	3266	3226	3251	3226
query66	1439	316	311	311
query67	14231	13993	14230	13993
query68	5041	557	556	556
query69	527	360	375	360
query70	1233	1265	1140	1140
query71	381	252	246	246
query72	6221	2794	2695	2695
query73	705	317	317	317
query74	6324	6021	5984	5984
query75	3059	2414	2414	2414
query76	2807	1034	1141	1034
query77	347	238	229	229
query78	9047	8531	8455	8455
query79	1547	507	505	505
query80	1069	347	353	347
query81	497	198	201	198
query82	938	87	84	84
query83	219	119	121	119
query84	278	79	73	73
query85	1364	346	336	336
query86	423	276	302	276
query87	3269	3087	3075	3075
query88	2664	2229	2228	2228
query89	402	329	320	320
query90	1923	162	164	162
query91	148	120	121	120
query92	56	50	50	50
query93	1301	515	494	494
query94	1220	180	176	176
query95	435	336	341	336
query96	582	259	257	257
query97	4255	4171	4134	4134
query98	235	209	190	190
query99	1037	641	647	641
Total cold run time: 264330 ms
Total hot run time: 168816 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 32.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f6acb9d426cf6b6409890bd7e1ad38a319ea5514, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.02	0.02
query3	0.24	0.06	0.06
query4	1.68	0.10	0.10
query5	0.52	0.52	0.52
query6	1.27	0.66	0.68
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.51	0.51
query10	0.56	0.57	0.56
query11	0.12	0.09	0.10
query12	0.12	0.11	0.10
query13	0.61	0.61	0.62
query14	0.78	0.81	0.78
query15	0.84	0.83	0.80
query16	0.36	0.40	0.37
query17	0.94	0.94	0.98
query18	0.27	0.25	0.25
query19	1.79	1.75	1.70
query20	0.01	0.02	0.02
query21	15.41	0.67	0.60
query22	2.53	3.75	3.20
query23	17.31	1.00	1.19
query24	2.09	0.62	0.18
query25	0.36	0.03	0.04
query26	0.16	0.14	0.14
query27	0.03	0.04	0.03
query28	12.40	0.84	0.82
query29	12.48	3.30	3.33
query30	0.59	0.55	0.46
query31	2.79	0.35	0.36
query32	3.36	0.47	0.49
query33	3.23	3.23	3.17
query34	15.38	4.77	4.73
query35	4.77	4.74	4.73
query36	1.15	1.07	1.06
query37	0.07	0.05	0.05
query38	0.05	0.03	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.15
query41	0.07	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.03
Total cold run time: 105.27 s
Total hot run time: 32.68 s

@doris-robot
Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f6acb9d426cf6b6409890bd7e1ad38a319ea5514 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       18.1 seconds inserted 10000000 Rows, about 552K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 28, 2024
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

Copy link
Copy Markdown
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.x reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants