How do I need to merge small files with the new API

[SusurHe]

I find the class org.apache.iceberg.actions.Actions was deprecated, when i want to use it to merge small files;
Now I find the new class SparkActions, but I don't know how to set target files size?

[pan3793]

You can find demo from TestNewRewriteDataFilesAction

[RussellSpitzer]

Specifically see

iceberg/spark/v3.0/spark3/src/test/java/org/apache/iceberg/spark/actions/TestNewRewriteDataFilesAction.java

Lines 228 to 230 in 119d20d

	Result result = basicRewrite(table)
	.option(RewriteDataFiles.TARGET_FILE_SIZE_BYTES, Long.toString(targetSize))
	.execute();

For setting options like target file size

[ashoksri0]

can we do the same thing in java api without spark

[RussellSpitzer]

Short answer: No
Long answer: You can do similar things with the pure java api but this would involve reading all the files you want to your local machine, combining them, then writing them from your local machine. I'm not sure if it would be easier to just manually implement that or to implement a "Local" RewriteDataAction

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'