Skip to content

[UT](pipeline) Add test cases for hash join#46976

Merged
zhangstar333 merged 4 commits intoapache:masterfrom
Gabriel39:ut_0114
Jan 15, 2025
Merged

[UT](pipeline) Add test cases for hash join#46976
zhangstar333 merged 4 commits intoapache:masterfrom
Gabriel39:ut_0114

Conversation

@Gabriel39
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Gabriel39
Copy link
Contributor Author

run buildall

1 similar comment
@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32597 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2884329c216da9f1caf09636b856cc54fd8816b0, data reload: false

------ Round 1 ----------------------------------
q1	17591	6170	5990	5990
q2	2050	312	176	176
q3	10478	1279	716	716
q4	10233	863	440	440
q5	7697	2183	2046	2046
q6	207	184	146	146
q7	910	779	607	607
q8	9248	1382	1176	1176
q9	5194	4792	4847	4792
q10	6769	2301	1857	1857
q11	477	277	265	265
q12	338	347	215	215
q13	17790	3713	3066	3066
q14	238	244	214	214
q15	580	535	516	516
q16	633	603	586	586
q17	580	855	329	329
q18	7064	6501	6420	6420
q19	1833	964	526	526
q20	330	319	186	186
q21	2812	2321	2020	2020
q22	377	343	308	308
Total cold run time: 103429 ms
Total hot run time: 32597 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6277	6200	6221	6200
q2	243	335	246	246
q3	2282	2660	2339	2339
q4	1383	1821	1393	1393
q5	4390	4734	4797	4734
q6	188	174	148	148
q7	2097	1973	1833	1833
q8	2617	2797	2686	2686
q9	7204	7256	7135	7135
q10	3035	3304	2789	2789
q11	593	531	507	507
q12	697	745	632	632
q13	3478	3964	3210	3210
q14	298	299	291	291
q15	577	533	514	514
q16	660	698	651	651
q17	1227	1728	1251	1251
q18	7777	7533	7243	7243
q19	780	1116	1066	1066
q20	2062	2028	1914	1914
q21	5679	5250	4842	4842
q22	608	603	566	566
Total cold run time: 54152 ms
Total hot run time: 52190 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187644 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2884329c216da9f1caf09636b856cc54fd8816b0, data reload: false

query1	975	378	366	366
query2	6526	2067	2014	2014
query3	6709	217	220	217
query4	33600	23336	23104	23104
query5	4365	615	475	475
query6	296	220	191	191
query7	4621	504	315	315
query8	302	239	229	229
query9	9572	2771	2758	2758
query10	468	312	272	272
query11	18144	15255	15051	15051
query12	166	107	105	105
query13	1662	535	402	402
query14	10459	6903	7023	6903
query15	277	202	184	184
query16	8627	614	471	471
query17	1670	718	555	555
query18	2121	384	296	296
query19	207	203	154	154
query20	119	125	111	111
query21	212	123	99	99
query22	4033	4306	3977	3977
query23	34092	33071	33118	33071
query24	6491	2217	2224	2217
query25	506	446	384	384
query26	1186	272	156	156
query27	2025	476	325	325
query28	5434	2474	2437	2437
query29	726	550	415	415
query30	227	184	165	165
query31	957	865	793	793
query32	95	62	60	60
query33	516	366	302	302
query34	774	847	522	522
query35	779	822	738	738
query36	986	1014	950	950
query37	126	100	80	80
query38	4361	4101	4097	4097
query39	1481	1424	1386	1386
query40	206	116	101	101
query41	53	90	54	54
query42	124	101	103	101
query43	500	529	487	487
query44	1347	843	824	824
query45	174	179	168	168
query46	847	1030	645	645
query47	1840	1840	1752	1752
query48	388	403	318	318
query49	762	483	406	406
query50	620	668	392	392
query51	6993	6832	6824	6824
query52	105	107	98	98
query53	230	276	183	183
query54	483	524	391	391
query55	84	79	89	79
query56	269	248	266	248
query57	1171	1115	1094	1094
query58	250	236	223	223
query59	2877	3029	2840	2840
query60	285	267	244	244
query61	135	112	116	112
query62	826	785	700	700
query63	235	200	190	190
query64	4148	1041	678	678
query65	3250	3131	3207	3131
query66	1082	431	306	306
query67	15852	15723	15364	15364
query68	5186	823	541	541
query69	478	294	264	264
query70	1232	1089	1129	1089
query71	360	289	252	252
query72	5865	3823	3829	3823
query73	654	754	367	367
query74	10019	9176	8718	8718
query75	3203	3152	2674	2674
query76	3178	1198	767	767
query77	476	373	332	332
query78	10041	9961	9395	9395
query79	3938	805	593	593
query80	701	520	434	434
query81	525	279	241	241
query82	924	152	130	130
query83	175	175	160	160
query84	243	99	79	79
query85	797	342	311	311
query86	392	290	305	290
query87	4358	4471	4344	4344
query88	4994	2219	2168	2168
query89	409	329	290	290
query90	1835	194	188	188
query91	135	141	108	108
query92	74	57	54	54
query93	2666	864	535	535
query94	708	398	262	262
query95	336	270	261	261
query96	491	610	285	285
query97	2787	2888	2796	2796
query98	229	200	201	200
query99	1421	1504	1393	1393
Total cold run time: 289859 ms
Total hot run time: 187644 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2884329c216da9f1caf09636b856cc54fd8816b0, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.10
query5	0.42	0.41	0.43
query6	1.13	0.66	0.65
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.60	0.52	0.51
query10	0.57	0.56	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.62	0.60
query14	2.73	2.86	2.74
query15	0.90	0.83	0.82
query16	0.38	0.39	0.39
query17	1.03	1.05	1.07
query18	0.22	0.21	0.21
query19	1.88	2.01	1.83
query20	0.02	0.01	0.02
query21	15.36	0.92	0.59
query22	0.76	0.81	0.68
query23	15.29	1.48	0.57
query24	3.25	0.92	1.17
query25	0.21	0.14	0.09
query26	0.31	0.14	0.14
query27	0.06	0.05	0.05
query28	13.98	1.53	1.05
query29	12.57	3.94	3.20
query30	0.27	0.11	0.08
query31	2.82	0.62	0.40
query32	3.22	0.55	0.48
query33	3.10	3.10	3.03
query34	16.78	5.15	4.50
query35	4.55	4.52	4.49
query36	0.67	0.51	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.15	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 106.52 s
Total hot run time: 31.33 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 40.92% (10663/26059)
Line Coverage: 31.49% (90201/286431)
Region Coverage: 30.65% (46208/150763)
Branch Coverage: 26.83% (23437/87344)
Coverage Report: http://coverage.selectdb-in.cc/coverage/2884329c216da9f1caf09636b856cc54fd8816b0_2884329c216da9f1caf09636b856cc54fd8816b0/report/index.html

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32779 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a00081b9e5802ed8bd597aa21eba6be13da8b119, data reload: false

------ Round 1 ----------------------------------
q1	17579	6189	6043	6043
q2	2052	303	173	173
q3	10415	1224	719	719
q4	10222	865	453	453
q5	7745	2173	1992	1992
q6	211	180	144	144
q7	902	757	600	600
q8	9250	1354	1155	1155
q9	5167	4962	4935	4935
q10	6809	2297	1850	1850
q11	489	278	258	258
q12	342	358	222	222
q13	17787	3691	3141	3141
q14	221	237	216	216
q15	578	516	528	516
q16	654	615	591	591
q17	555	842	318	318
q18	6909	6422	6489	6422
q19	1859	953	542	542
q20	316	320	191	191
q21	2778	2154	1994	1994
q22	374	340	304	304
Total cold run time: 103214 ms
Total hot run time: 32779 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6326	6273	6284	6273
q2	247	332	241	241
q3	2307	2762	2426	2426
q4	1465	1889	1443	1443
q5	4478	4836	4934	4836
q6	194	180	144	144
q7	2115	1951	1853	1853
q8	2620	2855	2735	2735
q9	7327	7301	7260	7260
q10	3095	3291	2777	2777
q11	593	520	537	520
q12	713	771	628	628
q13	3503	3989	3349	3349
q14	277	299	271	271
q15	590	560	528	528
q16	645	718	679	679
q17	1225	1762	1289	1289
q18	7736	7629	7336	7336
q19	789	1097	1112	1097
q20	2036	2026	1912	1912
q21	5705	5049	5031	5031
q22	607	596	587	587
Total cold run time: 54593 ms
Total hot run time: 53215 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 40.93% (10665/26059)
Line Coverage: 31.48% (90176/286431)
Region Coverage: 30.66% (46220/150763)
Branch Coverage: 26.83% (23434/87344)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a00081b9e5802ed8bd597aa21eba6be13da8b119_a00081b9e5802ed8bd597aa21eba6be13da8b119/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 196227 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a00081b9e5802ed8bd597aa21eba6be13da8b119, data reload: false

query1	1302	952	941	941
query2	6214	2083	1982	1982
query3	11130	4443	4596	4443
query4	62105	29298	23622	23622
query5	5402	587	449	449
query6	432	205	190	190
query7	5560	526	298	298
query8	335	251	241	241
query9	8350	2797	2765	2765
query10	453	311	256	256
query11	17511	15278	15645	15278
query12	166	122	113	113
query13	1428	596	455	455
query14	11256	7372	7331	7331
query15	215	198	178	178
query16	7446	635	452	452
query17	1137	731	561	561
query18	1920	404	306	306
query19	195	191	156	156
query20	119	113	113	113
query21	209	130	105	105
query22	4551	4661	4358	4358
query23	34103	33621	33681	33621
query24	5587	2403	2464	2403
query25	503	515	382	382
query26	643	275	156	156
query27	1656	473	340	340
query28	4288	2495	2469	2469
query29	555	575	450	450
query30	213	188	157	157
query31	901	892	830	830
query32	74	66	60	60
query33	469	387	330	330
query34	781	850	543	543
query35	788	848	749	749
query36	1032	1066	956	956
query37	122	109	85	85
query38	4442	4390	4233	4233
query39	1547	1444	1444	1444
query40	205	117	115	115
query41	75	50	54	50
query42	128	113	103	103
query43	532	541	500	500
query44	1417	877	859	859
query45	203	191	170	170
query46	911	1070	678	678
query47	1866	1888	1820	1820
query48	402	413	364	364
query49	704	512	398	398
query50	678	693	414	414
query51	7069	7091	6912	6912
query52	100	100	99	99
query53	241	261	190	190
query54	512	517	445	445
query55	85	84	87	84
query56	268	295	277	277
query57	1192	1134	1082	1082
query58	229	226	236	226
query59	3061	3074	2916	2916
query60	278	267	248	248
query61	111	116	123	116
query62	773	800	727	727
query63	220	186	193	186
query64	1349	1010	679	679
query65	3250	3246	3196	3196
query66	789	397	310	310
query67	15860	15783	15589	15589
query68	5040	842	541	541
query69	501	298	262	262
query70	1199	1125	1124	1124
query71	420	289	260	260
query72	6331	3943	3863	3863
query73	793	751	362	362
query74	10012	9280	8840	8840
query75	3229	3139	2672	2672
query76	3734	1184	780	780
query77	500	375	273	273
query78	10058	10033	9518	9518
query79	2591	795	613	613
query80	1658	535	448	448
query81	551	280	239	239
query82	345	149	121	121
query83	264	185	156	156
query84	288	95	77	77
query85	783	415	300	300
query86	414	305	279	279
query87	4565	4534	4403	4403
query88	3511	2247	2190	2190
query89	397	329	300	300
query90	1569	194	197	194
query91	136	137	142	137
query92	61	58	51	51
query93	2013	893	554	554
query94	704	408	308	308
query95	336	273	275	273
query96	488	611	288	288
query97	2812	2887	2707	2707
query98	228	213	193	193
query99	1387	1497	1347	1347
Total cold run time: 314566 ms
Total hot run time: 196227 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.81 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a00081b9e5802ed8bd597aa21eba6be13da8b119, data reload: false

query1	0.03	0.04	0.04
query2	0.07	0.03	0.04
query3	0.23	0.07	0.06
query4	1.62	0.11	0.11
query5	0.43	0.43	0.40
query6	1.16	0.65	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.49	0.51
query10	0.58	0.57	0.56
query11	0.15	0.10	0.10
query12	0.13	0.11	0.11
query13	0.61	0.60	0.60
query14	2.72	2.84	2.73
query15	0.90	0.84	0.84
query16	0.40	0.38	0.39
query17	1.05	1.08	1.01
query18	0.23	0.21	0.21
query19	1.86	1.87	2.01
query20	0.01	0.01	0.01
query21	15.38	0.94	0.61
query22	0.75	0.79	0.63
query23	15.33	1.50	0.54
query24	2.96	0.35	1.07
query25	0.18	0.14	0.10
query26	0.30	0.15	0.14
query27	0.06	0.06	0.07
query28	13.87	1.54	1.05
query29	12.56	3.89	3.23
query30	0.25	0.08	0.06
query31	2.83	0.59	0.37
query32	3.22	0.55	0.46
query33	2.99	3.16	3.06
query34	16.73	5.16	4.57
query35	4.58	4.54	4.54
query36	0.65	0.49	0.52
query37	0.10	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.18	0.14	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.97 s
Total hot run time: 30.81 s

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 15, 2025
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@zhangstar333 zhangstar333 merged commit cc183eb into apache:master Jan 15, 2025
14 of 16 checks passed
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
### What problem does this PR solve?
Add test cases for hash join
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants