Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask]: Store watermark in the snapshot level #1721

Closed
2 of 3 tasks
wangtaohz opened this issue Jul 20, 2023 · 2 comments
Closed
2 of 3 tasks

[Subtask]: Store watermark in the snapshot level #1721

wangtaohz opened this issue Jul 20, 2023 · 2 comments
Labels
type:subtask Subtask of another issue

Comments

@wangtaohz
Copy link
Contributor

Search before asking

  • I have searched in the issues and found no similar issues.

Description

Currently, the watermark is stored in table properties, which makes it impossible to trace historical watermarks. We should store the watermark at the snapshot level, such as in the snapshot summary.

Parent issue

#1354

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@wangtaohz wangtaohz added the type:subtask Subtask of another issue label Jul 20, 2023
@czy006
Copy link
Contributor

czy006 commented Mar 23, 2024 •
edited
Loading

I found iceberg 1.5.0 have watermark issues apache/iceberg#8553 apache/iceberg#9346 helpful for this issues? I want to understand and solve this problem @wangtaohz @zhoujinsong

@zhoujinsong
Copy link
Contributor

Closed as not planned.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type:subtask Subtask of another issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@zhoujinsong @czy006 @wangtaohz