Skip to content

Conversation

@hililiwei
Copy link
Contributor

@hililiwei hililiwei commented Jul 4, 2023

This PR is trying to fix #6630, but is it reasonable to overwrite partitions every time in a streaming task?

@pvary
Copy link
Contributor

pvary commented Jul 4, 2023

@hililiwei: What was the issue here? Why did you closed the PR?

@hililiwei
Copy link
Contributor Author

@pvary The reason I closed it is because I want to clarify first whether we need to do partition or table overwrite in the streaming mode. If we don’t, we should add a check to prevent this behavior.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Purpose of MAX_CONTINUOUS_EMPTY_COMMITS in IcebergFilesCommitter

2 participants