You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
healchow
changed the title
[Bug] Data loss occurs when checkpoint restores ingesting into iceberg
[Bug][Sort] Lost data in Iceberg when restoring checkpoint
Jul 3, 2023
What happened
Data loss occurs when checkpoint restores ingesting into iceberg
What you expected to happen
data normal
How to reproduce
Assume that the current chk is n
Manually roll back the task to the point where chk is m (m<n)
Before m catches up to n, the task checkpoint succeeds but the checkpoint notify fails, and the data during this period will be lost
Environment
No response
InLong version
master
InLong Component
InLong Sort
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: