Skip to content

[test](leading) add leading tpc-ds regression test cases - #31681

Merged
morrySnow merged 1 commit into
apache:masterfrom
LiBinfeng-01:add_leading_tpcds
Mar 5, 2024
Merged

[test](leading) add leading tpc-ds regression test cases#31681
morrySnow merged 1 commit into
apache:masterfrom
LiBinfeng-01:add_leading_tpcds

Conversation

@LiBinfeng-01

@LiBinfeng-01 LiBinfeng-01 commented Mar 1, 2024

Copy link
Copy Markdown
Contributor

Proposed changes

add leading tpc-ds
include:
query1
query24
query64
query67
query72
query78

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot

doris-robot commented Mar 1, 2024

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@LiBinfeng-01

LiBinfeng-01 commented Mar 1, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

doris-robot commented Mar 1, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 32428 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4d88feaa163c2e6fc2d8f70538ca7eb62fa5c24d, data reload: false

------ Round 1 ----------------------------------
q1	18300	4463	4449	4449
q2	2171	222	225	222
q3	10710	1126	1115	1115
q4	5021	1187	1200	1187
q5	7838	2147	2066	2066
q6	162	121	117	117
q7	1196	1125	1093	1093
q8	9840	1107	1183	1107
q9	6178	5243	5012	5012
q10	7922	2026	1992	1992
q11	541	314	315	314
q12	778	410	404	404
q13	18076	3012	2963	2963
q14	318	282	324	282
q15	380	361	352	352
q16	545	502	519	502
q17	800	316	316	316
q18	5746	4831	4730	4730
q19	1187	423	437	423
q20	603	433	441	433
q21	5966	2915	2869	2869
q22	524	480	490	480
Total cold run time: 104802 ms
Total hot run time: 32428 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4822	4785	4817	4785
q2	307	215	213	213
q3	2229	1893	1866	1866
q4	1627	1324	1371	1324
q5	3373	3016	3024	3016
q6	159	101	100	100
q7	1871	1903	1853	1853
q8	1803	1730	1707	1707
q9	5488	5259	5217	5217
q10	2722	2220	2383	2220
q11	482	412	417	412
q12	759	664	684	664
q13	3115	2783	2745	2745
q14	294	285	280	280
q15	375	355	337	337
q16	490	501	509	501
q17	1155	780	768	768
q18	6093	5269	5457	5269
q19	1125	694	638	638
q20	1539	1460	1409	1409
q21	4973	4481	4390	4390
q22	681	582	603	582
Total cold run time: 45482 ms
Total hot run time: 40296 ms

@doris-robot

doris-robot commented Mar 1, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 188011 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4d88feaa163c2e6fc2d8f70538ca7eb62fa5c24d, data reload: false

query1	1143	397	393	393
query2	7905	2406	2322	2322
query3	6746	295	303	295
query4	21359	23340	22732	22732
query5	5206	6815	795	795
query6	406	341	297	297
query7	4707	435	471	435
query8	321	246	244	244
query9	8690	3410	3379	3379
query10	562	337	340	337
query11	18249	18220	18275	18220
query12	388	232	188	188
query13	1778	646	660	646
query14	9951	8059	7918	7918
query15	281	243	262	243
query16	7942	394	407	394
query17	1344	722	666	666
query18	2038	397	418	397
query19	269	231	246	231
query20	149	137	137	137
query21	234	159	161	159
query22	5399	5114	4987	4987
query23	24902	25261	24404	24404
query24	4586	2102	2081	2081
query25	608	559	503	503
query26	774	249	248	248
query27	2113	476	484	476
query28	3193	2832	2812	2812
query29	863	783	739	739
query30	290	195	199	195
query31	934	829	851	829
query32	105	101	88	88
query33	559	385	389	385
query34	873	660	672	660
query35	947	883	872	872
query36	1250	1194	1189	1189
query37	131	111	111	111
query38	3232	3099	3024	3024
query39	1400	1117	1117	1117
query40	254	165	168	165
query41	93	83	86	83
query42	152	150	160	150
query43	597	579	582	579
query44	1266	1058	1064	1058
query45	219	231	264	231
query46	908	772	794	772
query47	1735	1697	1674	1674
query48	599	519	527	519
query49	736	487	486	486
query50	648	556	549	549
query51	10122	10314	9875	9875
query52	148	156	134	134
query53	333	329	340	329
query54	369	352	362	352
query55	138	133	131	131
query56	347	348	351	348
query57	1100	1058	1069	1058
query58	341	324	334	324
query59	3563	3322	3455	3322
query60	411	385	364	364
query61	166	161	175	161
query62	474	447	437	437
query63	333	329	322	322
query64	3035	1900	1818	1818
query65	2438	2353	2308	2308
query66	880	395	387	387
query67	15292	15134	15209	15134
query68	1206	710	710	710
query69	671	555	551	551
query70	1571	1603	1586	1586
query71	449	421	430	421
query72	2782	2334	2313	2313
query73	669	495	481	481
query74	7291	7020	7340	7020
query75	3078	2835	2718	2718
query76	1214	664	674	664
query77	497	417	410	410
query78	6882	6495	6667	6495
query79	1086	764	772	764
query80	677	611	602	602
query81	485	262	269	262
query82	162	146	142	142
query83	242	234	228	228
query84	273	131	137	131
query85	843	529	530	529
query86	431	470	444	444
query87	3313	3142	3120	3120
query88	3701	3520	3456	3456
query89	454	417	431	417
query90	949	231	237	231
query91	207	201	205	201
query92	86	84	81	81
query93	1041	712	695	695
query94	504	272	277	272
query95	577	520	524	520
query96	614	382	391	382
query97	2946	2887	2945	2887
query98	295	316	308	308
query99	867	757	752	752
Total cold run time: 244587 ms
Total hot run time: 188011 ms

@doris-robot

doris-robot commented Mar 1, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 26.69 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4d88feaa163c2e6fc2d8f70538ca7eb62fa5c24d, data reload: false

query1	0.05	0.04	0.04
query2	0.12	0.04	0.03
query3	0.26	0.07	0.06
query4	1.59	0.08	0.08
query5	0.50	0.50	0.49
query6	1.51	0.96	0.95
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.69	0.64	0.65
query10	0.69	0.70	0.67
query11	0.20	0.15	0.15
query12	0.19	0.15	0.16
query13	0.50	0.47	0.47
query14	0.72	0.72	0.71
query15	0.91	0.89	0.88
query16	0.42	0.40	0.38
query17	1.19	1.23	1.33
query18	0.33	0.30	0.30
query19	2.15	2.06	2.06
query20	0.03	0.02	0.02
query21	15.40	0.94	0.99
query22	0.58	0.56	0.56
query23	13.65	0.64	0.64
query24	0.78	0.20	0.18
query25	0.04	0.05	0.04
query26	0.20	0.19	0.20
query27	0.04	0.04	0.04
query28	1.40	0.72	0.69
query29	12.94	4.55	4.52
query30	0.86	0.78	0.80
query31	0.88	0.41	0.40
query32	3.24	0.41	0.40
query33	2.37	2.27	2.23
query34	2.23	2.25	2.20
query35	2.20	2.20	2.23
query36	0.99	1.00	0.94
query37	0.08	0.06	0.07
query38	0.06	0.04	0.05
query39	0.03	0.02	0.04
query40	0.20	0.17	0.18
query41	0.09	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 70.48 s
Total hot run time: 26.69 s

@LiBinfeng-01

LiBinfeng-01 commented Mar 4, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

@LiBinfeng-01

LiBinfeng-01 commented Mar 4, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

1 similar comment
@LiBinfeng-01

LiBinfeng-01 commented Mar 5, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Mar 5, 2024
@github-actions

github-actions Bot commented Mar 5, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actions Bot commented Mar 5, 2024

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow changed the title [Nereids] add leading tpc-ds (test)[leading] add leading tpc-ds regression test cases Mar 5, 2024
@morrySnow morrySnow changed the title (test)[leading] add leading tpc-ds regression test cases [test](leading) add leading tpc-ds regression test cases Mar 5, 2024
@morrySnow
morrySnow merged commit 092757a into apache:master Mar 5, 2024
yiguolei pushed a commit that referenced this pull request Mar 6, 2024
@LiBinfeng-01 libinfeng @Doris-Extras
[test](leading) add leading tpc-ds regression test cases (#31681)
97640ee 
Co-authored-by: libinfeng <libinfeng@selectdb.com>
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
@LiBinfeng-01 libinfeng @HappenLee
[test](leading) add leading tpc-ds regression test cases (apache#31681)
62eedcc 
Co-authored-by: libinfeng <libinfeng@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@englefly englefly englefly approved these changes
@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@LiBinfeng-01 @doris-robot @englefly @morrySnow