Skip to content

[mtmv](test)Add more test case for Iceberg mtmv. #47026

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
Jibing-Li merged 1 commit into from
Jan 17, 2025
Merged

[mtmv](test)Add more test case for Iceberg mtmv. #47026

Jibing-Li merged 1 commit into from
Jan 17, 2025

Conversation

@Jibing-Li
Copy link
Contributor

@Jibing-Li Jibing-Li commented Jan 15, 2025 •
edited
Loading

What problem does this PR solve?

Add more test case for Iceberg mtmv.

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 15, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Jibing-Li Jibing-Li marked this pull request as ready for review January 15, 2025 08:27
@Jibing-Li
Copy link
Contributor Author

Jibing-Li commented Jan 15, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jan 15, 2025

TPC-H: Total hot run time: 33159 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 62c7126a9c8b5048d98640cc1c57a224dd24e238, data reload: false

------ Round 1 ----------------------------------
q1	17587	6140	6074	6074
q2	2049	308	167	167
q3	10409	1266	720	720
q4	10223	965	537	537
q5	7530	2343	2607	2343
q6	210	181	146	146
q7	893	762	613	613
q8	9246	1366	1166	1166
q9	5245	4842	4933	4842
q10	6792	2385	1927	1927
q11	485	286	267	267
q12	350	357	217	217
q13	17763	3668	3038	3038
q14	228	225	221	221
q15	588	527	518	518
q16	616	609	593	593
q17	551	844	325	325
q18	7361	6589	6477	6477
q19	1246	962	531	531
q20	310	332	192	192
q21	2810	2155	1935	1935
q22	371	335	310	310
Total cold run time: 102863 ms
Total hot run time: 33159 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6188	6177	6164	6164
q2	237	330	239	239
q3	2282	2640	2344	2344
q4	1433	1779	1365	1365
q5	4247	4724	4774	4724
q6	196	180	141	141
q7	2078	1966	1852	1852
q8	2623	2766	2666	2666
q9	7223	7212	7153	7153
q10	3028	3306	2829	2829
q11	592	519	501	501
q12	671	786	640	640
q13	3446	3977	3241	3241
q14	290	304	261	261
q15	576	515	528	515
q16	661	695	629	629
q17	1216	1731	1241	1241
q18	7735	7528	7303	7303
q19	779	1089	1047	1047
q20	2001	2075	1890	1890
q21	5769	5343	4841	4841
q22	590	623	576	576
Total cold run time: 53861 ms
Total hot run time: 52162 ms

@Jibing-Li
Copy link
Contributor Author

Jibing-Li commented Jan 15, 2025

run feut

@doris-robot
Copy link

doris-robot commented Jan 15, 2025

TPC-DS: Total hot run time: 189276 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 62c7126a9c8b5048d98640cc1c57a224dd24e238, data reload: false

query1	976	374	375	374
query2	6525	2105	2077	2077
query3	6806	216	223	216
query4	33721	23410	23707	23410
query5	4387	602	444	444
query6	265	197	186	186
query7	4612	481	303	303
query8	285	241	233	233
query9	9385	2771	2777	2771
query10	471	304	238	238
query11	17956	15234	15139	15139
query12	155	102	104	102
query13	1640	521	400	400
query14	9979	6816	7371	6816
query15	241	195	193	193
query16	8060	611	443	443
query17	1616	745	563	563
query18	2099	408	309	309
query19	227	181	175	175
query20	133	112	114	112
query21	216	127	103	103
query22	4539	4637	4510	4510
query23	34111	33768	33326	33326
query24	6615	2301	2273	2273
query25	495	457	373	373
query26	1217	272	154	154
query27	2000	450	337	337
query28	5034	2446	2443	2443
query29	708	539	424	424
query30	231	187	157	157
query31	989	877	827	827
query32	92	60	60	60
query33	510	393	292	292
query34	735	846	491	491
query35	846	815	728	728
query36	998	1018	976	976
query37	120	107	81	81
query38	4090	4234	4227	4227
query39	1449	1427	1409	1409
query40	210	114	100	100
query41	53	54	52	52
query42	139	100	98	98
query43	508	533	493	493
query44	1295	798	805	798
query45	185	168	167	167
query46	848	1037	645	645
query47	1840	1858	1764	1764
query48	378	400	311	311
query49	774	481	388	388
query50	637	643	390	390
query51	6900	6915	6926	6915
query52	104	98	92	92
query53	225	251	187	187
query54	470	495	420	420
query55	82	76	77	76
query56	283	262	241	241
query57	1151	1168	1086	1086
query58	250	226	234	226
query59	3191	3149	2934	2934
query60	271	265	255	255
query61	129	114	119	114
query62	861	774	707	707
query63	232	196	195	195
query64	4409	987	699	699
query65	3213	3133	3154	3133
query66	837	417	309	309
query67	15980	15868	15561	15561
query68	4866	827	535	535
query69	450	298	253	253
query70	1188	1063	1131	1063
query71	385	287	255	255
query72	5967	3817	3786	3786
query73	651	738	360	360
query74	10201	9220	8823	8823
query75	3150	3168	2666	2666
query76	3276	1181	780	780
query77	476	369	280	280
query78	10104	10046	9347	9347
query79	3938	788	576	576
query80	705	526	435	435
query81	497	289	240	240
query82	646	158	117	117
query83	173	174	153	153
query84	248	86	152	86
query85	781	355	288	288
query86	399	304	309	304
query87	4412	4559	4335	4335
query88	4826	2187	2185	2185
query89	407	318	289	289
query90	1776	190	192	190
query91	135	144	107	107
query92	67	57	56	56
query93	2525	865	538	538
query94	702	406	284	284
query95	331	271	256	256
query96	485	616	281	281
query97	2806	2875	2757	2757
query98	234	199	200	199
query99	1637	1493	1401	1401
Total cold run time: 288433 ms
Total hot run time: 189276 ms

@doris-robot
Copy link

doris-robot commented Jan 15, 2025

ClickBench: Total hot run time: 31.01 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 62c7126a9c8b5048d98640cc1c57a224dd24e238, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.10	0.10
query5	0.44	0.42	0.44
query6	1.16	0.66	0.65
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.51	0.52
query10	0.55	0.57	0.55
query11	0.14	0.10	0.11
query12	0.14	0.10	0.11
query13	0.60	0.60	0.59
query14	2.83	2.76	2.74
query15	0.90	0.82	0.83
query16	0.36	0.37	0.39
query17	1.00	1.00	1.06
query18	0.23	0.21	0.20
query19	1.84	1.86	2.02
query20	0.01	0.01	0.01
query21	15.76	0.97	0.58
query22	0.76	0.87	0.57
query23	15.33	1.39	0.53
query24	3.10	1.13	0.92
query25	0.12	0.23	0.05
query26	0.30	0.14	0.13
query27	0.06	0.04	0.04
query28	13.63	1.53	1.04
query29	12.60	3.91	3.28
query30	0.25	0.09	0.06
query31	2.82	0.58	0.38
query32	3.22	0.54	0.47
query33	3.01	3.00	3.16
query34	16.90	5.19	4.52
query35	4.56	4.57	4.48
query36	0.83	0.51	0.47
query37	0.10	0.06	0.07
query38	0.05	0.03	0.03
query39	0.04	0.02	0.03
query40	0.18	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.03	0.04	0.03
Total cold run time: 106.6 s
Total hot run time: 31.01 s

zfr9527
zfr9527 approved these changes Jan 17, 2025
View reviewed changes
Copy link
Contributor

@zfr9527 zfr9527 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Jan 17, 2025

PR approved by anyone and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 17, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Jan 17, 2025

PR approved by at least one committer and no changes requested.

@Jibing-Li Jibing-Li merged commit bfa49b0 into apache:master Jan 17, 2025
27 checks passed
@Jibing-Li Jibing-Li deleted the mtmv branch January 17, 2025 09:36
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
@Jibing-Li @lzyy2024
[mtmv](test)Add more test case for Iceberg mtmv. (apache#47026)
60550cf 
Add more test case for Iceberg mtmv.
zddr pushed a commit to zddr/incubator-doris that referenced this pull request Jun 19, 2025
@Jibing-Li @zddr
[mtmv](test)Add more test case for Iceberg mtmv. (apache#47026)
cb8ed9d 
Add more test case for Iceberg mtmv.
zddr pushed a commit to zddr/incubator-doris that referenced this pull request Jun 19, 2025
@Jibing-Li @zddr
[mtmv](test)Add more test case for Iceberg mtmv. (apache#47026)
b671c01 
Add more test case for Iceberg mtmv.
@zddr zddr mentioned this pull request Jun 20, 2025
Merged
morrySnow pushed a commit that referenced this pull request Jun 23, 2025
@zddr @Jibing-Li @BePPPower
branch-3.1: [enhance](mtmv)MTMV support iceberg/hudi/paimon (#52040)
4234a27 
Cherry-pick from
#43959
#44419
#44415
#44567
#44673
#44998
#45273
#44911
#44726
#45652
#45659
#46257
#46641
#47026
#47166
#48172
#49956
#50979

---------

Co-authored-by: James <lijibing@selectdb.com>
Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes

+1 more reviewer

@zfr9527 zfr9527 zfr9527 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.0-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@Jibing-Li @hello-stephen @doris-robot @zfr9527 @morrySnow