Skip to content

branch-3.0: [fix](iceberg)Fix the inconsistency between the data in pg and the data in MinIO. #50578#50640

Merged
morningman merged 1 commit intobranch-3.0from
auto-pick-50578-branch-3.0
May 14, 2025
Merged

branch-3.0: [fix](iceberg)Fix the inconsistency between the data in pg and the data in MinIO. #50578#50640
morningman merged 1 commit intobranch-3.0from
auto-pick-50578-branch-3.0

Conversation

@github-actions
Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot commented May 7, 2025

Cherry-picked from #50578

@github-actions github-actions Bot requested a review from dataroaring as a code owner May 7, 2025 04:00
@hello-stephen
Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this May 7, 2025
@dataroaring dataroaring reopened this May 7, 2025
@hello-stephen
Copy link
Copy Markdown
Contributor

run buildall

Copy link
Copy Markdown
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label May 14, 2025
@github-actions
Copy link
Copy Markdown
Contributor Author

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Copy Markdown
Contributor Author

PR approved by anyone and no changes requested.

…ta in MinIO. (#50578)

### What problem does this PR solve?

Problem Summary:

Part of the metadata of an Iceberg table is stored in PostgreSQL (PG),
while the remaining data files are stored in MinIO.

However, the data in PG is saved on the local disk, whereas the data in
MinIO is not saved on the local disk. Therefore, when a user modifies
the Iceberg table and then restarts Docker, at this time, the data in PG
is the data after the user's modification, but the data in MinIO has not
been updated to the modified version.

So, the data in MinIO should also be saved on the local disk. In this
way, we can ensure the consistency of the data between PG and MinIO.
@dataroaring dataroaring force-pushed the auto-pick-50578-branch-3.0 branch from c18be40 to 76f97b1 Compare May 14, 2025 02:06
@dataroaring
Copy link
Copy Markdown
Contributor

run buildall

@morningman morningman merged commit 6069ebb into branch-3.0 May 14, 2025
25 of 27 checks passed
@github-actions github-actions Bot deleted the auto-pick-50578-branch-3.0 branch May 14, 2025 07:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants