Skip to content

[fix](iceberg) Fix execute action validation gaps#61381

Open
suxiaogang223 wants to merge 1 commit intoapache:masterfrom
suxiaogang223:codex/fix-iceberg-execute-action-validation
Open

[fix](iceberg) Fix execute action validation gaps#61381
suxiaogang223 wants to merge 1 commit intoapache:masterfrom
suxiaogang223:codex/fix-iceberg-execute-action-validation

Conversation

@suxiaogang223
Copy link
Contributor

@suxiaogang223 suxiaogang223 commented Mar 16, 2026

What problem does this PR solve?

Issue Number: N/A

Related PR: N/A

Problem Summary:

  • Fix rollback_to_timestamp so epoch millis input is parsed correctly instead of falling through to rollbackToTime(-1).
  • Reject invalid rewrite_data_files input when min-file-size-bytes > max-file-size-bytes during FE validation.
  • Add Iceberg regression coverage for the epoch-millis rollback path and invalid rewrite_data_files file-size bounds.

Release note

None

Check List (For Author)

  • Test
    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

Regression test:

  • bash run-regression-test.sh --run -d external_table_p0/iceberg/action -s test_iceberg_optimize_actions_ddl

  • In the current local environment, the regression framework ran successfully but the Iceberg suite was skipped because enableIcebergTest is disabled, so the new Iceberg cases were not executed locally.

  • Behavior changed:

    • No.
    • Yes. Buggy Iceberg execute action inputs are now rejected or interpreted correctly instead of silently succeeding or executing with -1.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Mar 16, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 26714 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e64c68badb7065d04157f177b604dd368b0bd707, data reload: false

------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	17657	4511	4300	4300
q2	q3	10644	760	523	523
q4	4679	360	250	250
q5	7560	1196	1035	1035
q6	197	176	146	146
q7	785	831	661	661
q8	9343	1472	1300	1300
q9	4926	4767	4704	4704
q10	6329	1916	1649	1649
q11	456	270	234	234
q12	726	575	467	467
q13	18036	2968	2161	2161
q14	224	236	215	215
q15	q16	739	738	660	660
q17	720	820	441	441
q18	5867	5363	5259	5259
q19	1142	980	612	612
q20	543	487	387	387
q21	4524	1814	1402	1402
q22	360	535	308	308
Total cold run time: 95457 ms
Total hot run time: 26714 ms

----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	4703	4702	4570	4570
q2	q3	3888	4448	3893	3893
q4	936	1200	804	804
q5	4112	4434	4361	4361
q6	181	167	138	138
q7	1755	1633	1537	1537
q8	2437	2688	2540	2540
q9	7720	7431	7620	7431
q10	3753	3999	3721	3721
q11	498	436	424	424
q12	478	603	456	456
q13	2714	3282	2623	2623
q14	285	307	283	283
q15	q16	748	809	737	737
q17	1153	1367	1341	1341
q18	7308	6779	6567	6567
q19	889	841	908	841
q20	2089	2196	1973	1973
q21	3948	3463	3243	3243
q22	472	423	444	423
Total cold run time: 50067 ms
Total hot run time: 47906 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 168533 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e64c68badb7065d04157f177b604dd368b0bd707, data reload: false

query5	4331	654	499	499
query6	324	223	206	206
query7	4226	473	262	262
query8	339	246	231	231
query9	8714	2747	2738	2738
query10	537	412	334	334
query11	7014	5091	4871	4871
query12	184	128	126	126
query13	1265	460	362	362
query14	5719	3722	3453	3453
query14_1	2872	2852	2775	2775
query15	201	192	175	175
query16	977	476	457	457
query17	908	727	624	624
query18	2459	453	355	355
query19	212	211	186	186
query20	138	128	129	128
query21	219	132	112	112
query22	13266	14179	14642	14179
query23	16156	15880	15942	15880
query23_1	15713	15711	15750	15711
query24	7514	1652	1248	1248
query24_1	1217	1215	1216	1215
query25	572	555	416	416
query26	1237	264	155	155
query27	2831	475	295	295
query28	4485	1851	1849	1849
query29	810	547	478	478
query30	301	231	189	189
query31	1025	945	872	872
query32	78	69	68	68
query33	504	332	291	291
query34	895	870	519	519
query35	632	678	597	597
query36	1095	1098	948	948
query37	127	94	80	80
query38	2968	2954	2877	2877
query39	851	832	821	821
query39_1	804	805	791	791
query40	229	155	139	139
query41	63	100	59	59
query42	263	255	257	255
query43	236	251	220	220
query44	
query45	194	190	180	180
query46	869	978	595	595
query47	2148	2154	2080	2080
query48	306	307	233	233
query49	630	451	379	379
query50	678	270	212	212
query51	4131	4056	4086	4056
query52	258	266	255	255
query53	289	340	288	288
query54	299	276	261	261
query55	90	88	86	86
query56	306	312	304	304
query57	1945	1823	1679	1679
query58	284	269	267	267
query59	2800	2920	2747	2747
query60	345	326	315	315
query61	155	155	140	140
query62	630	582	539	539
query63	307	280	279	279
query64	5013	1262	965	965
query65	
query66	1454	455	344	344
query67	24179	24528	24274	24274
query68	
query69	397	324	278	278
query70	979	972	992	972
query71	342	302	297	297
query72	2746	2704	2152	2152
query73	547	546	310	310
query74	9617	9662	9425	9425
query75	2839	2726	2495	2495
query76	2277	1043	690	690
query77	352	376	315	315
query78	10908	11162	10467	10467
query79	1115	851	571	571
query80	1342	615	528	528
query81	543	261	227	227
query82	1112	148	126	126
query83	337	260	241	241
query84	293	120	92	92
query85	894	477	434	434
query86	422	350	321	321
query87	3187	3083	2985	2985
query88	3520	2646	2657	2646
query89	424	379	356	356
query90	2029	178	174	174
query91	170	158	137	137
query92	77	76	70	70
query93	918	859	491	491
query94	639	330	296	296
query95	586	332	318	318
query96	634	515	231	231
query97	2512	2525	2409	2409
query98	239	221	217	217
query99	1028	988	929	929
Total cold run time: 248142 ms
Total hot run time: 168533 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants