Skip to content

Conversation

@zy-kkk
Copy link
Member

@zy-kkk zy-kkk commented Jun 12, 2024

When using mysql catalog to connect to Doris, some lower versions of Doris's Json type will be displayed as JsonB, and we need to be compatible with it

bp #36177

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zy-kkk zy-kkk changed the title [fix](jdbc catalog) fix jdbc mysql client match jsonb type [branch-2.0][fix](jdbc catalog) fix jdbc mysql client match jsonb type Jun 12, 2024
@zy-kkk
Copy link
Member Author

zy-kkk commented Jun 12, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49931 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b67a3c519cf05e09c0f8409609af872d3b066951, data reload: false

------ Round 1 ----------------------------------
q1	17636	4447	4379	4379
q2	2075	157	151	151
q3	10454	1917	1952	1917
q4	10342	1244	1320	1244
q5	8391	3937	3873	3873
q6	228	149	125	125
q7	2013	1613	1586	1586
q8	9546	2716	2693	2693
q9	13632	10369	10176	10176
q10	8691	3545	3520	3520
q11	413	244	240	240
q12	462	306	305	305
q13	18344	3993	4032	3993
q14	353	327	333	327
q15	505	465	464	464
q16	664	565	577	565
q17	1191	954	919	919
q18	7281	7009	6991	6991
q19	1752	1654	1633	1633
q20	538	291	296	291
q21	4438	4149	4100	4100
q22	524	439	461	439
Total cold run time: 119473 ms
Total hot run time: 49931 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4316	4296	4269	4269
q2	323	234	233	233
q3	4199	4196	4144	4144
q4	2755	2730	2736	2730
q5	7216	7101	7132	7101
q6	240	121	120	120
q7	3191	2841	2883	2841
q8	4358	4457	4516	4457
q9	16887	16787	16721	16721
q10	4229	4250	4227	4227
q11	758	656	714	656
q12	1054	876	875	875
q13	6807	3725	3746	3725
q14	459	422	429	422
q15	512	467	455	455
q16	737	685	681	681
q17	3788	3892	3832	3832
q18	8720	8771	8791	8771
q19	1719	1633	1657	1633
q20	2406	2112	2139	2112
q21	8438	8567	8414	8414
q22	1048	991	986	986
Total cold run time: 84160 ms
Total hot run time: 79405 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203238 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b67a3c519cf05e09c0f8409609af872d3b066951, data reload: false

query1	933	422	378	378
query2	6541	2888	2646	2646
query3	6918	213	209	209
query4	19991	18078	18092	18078
query5	19742	6525	6527	6525
query6	287	224	234	224
query7	4152	304	305	304
query8	453	398	387	387
query9	3136	2720	2673	2673
query10	417	310	304	304
query11	11298	10798	10725	10725
query12	123	80	74	74
query13	5595	704	693	693
query14	18453	13191	13308	13191
query15	363	245	246	245
query16	6464	293	269	269
query17	1721	1454	865	865
query18	2352	416	411	411
query19	207	152	155	152
query20	85	78	83	78
query21	192	99	92	92
query22	5072	5102	4861	4861
query23	32532	32058	31997	31997
query24	6863	6542	6571	6542
query25	530	426	428	426
query26	533	168	161	161
query27	1787	298	298	298
query28	6163	2391	2347	2347
query29	2907	2718	2740	2718
query30	238	168	166	166
query31	901	724	750	724
query32	68	61	64	61
query33	401	270	255	255
query34	845	485	490	485
query35	1129	922	909	909
query36	1318	1131	1272	1131
query37	89	62	63	62
query38	3118	2957	2949	2949
query39	1389	1328	1313	1313
query40	206	99	98	98
query41	47	45	44	44
query42	82	86	92	86
query43	814	671	719	671
query44	1158	725	713	713
query45	251	239	236	236
query46	1224	964	958	958
query47	2030	1844	1702	1702
query48	994	739	701	701
query49	612	362	385	362
query50	874	606	614	606
query51	4701	4710	4663	4663
query52	106	81	93	81
query53	450	325	323	323
query54	2653	2469	2462	2462
query55	85	80	79	79
query56	237	217	212	212
query57	1276	1100	1106	1100
query58	218	199	193	193
query59	4326	4318	3674	3674
query60	226	200	226	200
query61	97	92	92	92
query62	836	534	498	498
query63	493	344	342	342
query64	2510	1551	1398	1398
query65	3606	3568	3571	3568
query66	781	374	380	374
query67	16438	15123	15026	15026
query68	9552	650	664	650
query69	573	341	359	341
query70	1759	1365	1426	1365
query71	413	309	320	309
query72	6526	3510	3469	3469
query73	733	331	329	329
query74	6224	5791	5891	5791
query75	5395	3742	3727	3727
query76	6220	1141	1181	1141
query77	1025	269	272	269
query78	12436	11688	11521	11521
query79	9709	661	659	659
query80	1451	409	402	402
query81	488	238	233	233
query82	1685	102	102	102
query83	196	140	136	136
query84	267	74	71	71
query85	878	317	316	316
query86	333	335	288	288
query87	3185	3015	3076	3015
query88	4900	2379	2373	2373
query89	487	280	286	280
query90	1962	225	221	221
query91	180	138	145	138
query92	63	54	55	54
query93	7189	597	591	591
query94	702	204	225	204
query95	1108	1065	1057	1057
query96	674	348	338	338
query97	6357	6402	6433	6402
query98	198	195	185	185
query99	3044	885	871	871
Total cold run time: 318549 ms
Total hot run time: 203238 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b67a3c519cf05e09c0f8409609af872d3b066951, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.05	0.05
query4	1.78	0.07	0.07
query5	0.54	0.53	0.50
query6	1.23	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.54	0.54	0.54
query11	0.12	0.08	0.09
query12	0.12	0.10	0.08
query13	0.62	0.62	0.61
query14	0.80	0.79	0.78
query15	0.77	0.76	0.76
query16	0.36	0.39	0.37
query17	1.00	1.01	1.01
query18	0.22	0.26	0.24
query19	1.94	1.87	1.84
query20	0.02	0.01	0.01
query21	15.47	0.55	0.55
query22	2.01	2.16	1.62
query23	17.02	1.01	0.96
query24	3.64	1.27	1.15
query25	0.34	0.06	0.05
query26	0.52	0.16	0.15
query27	0.04	0.04	0.03
query28	9.05	0.71	0.73
query29	12.81	2.17	2.37
query30	0.57	0.52	0.53
query31	2.82	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.06	3.06
query34	15.28	4.78	4.79
query35	4.85	4.84	4.86
query36	1.07	1.03	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.27 s
Total hot run time: 30.84 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b67a3c519cf05e09c0f8409609af872d3b066951 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xiaokang xiaokang merged commit 2a36ea5 into apache:branch-2.0 Jun 19, 2024
@zy-kkk zy-kkk deleted the mysql_jsonb20 branch June 19, 2024 04:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants