Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ALTERing MV refresh options #26572

Open
Tracked by #26010
ggevay opened this issue Apr 10, 2024 · 2 comments
Open
Tracked by #26010

ALTERing MV refresh options #26572

ggevay opened this issue Apr 10, 2024 · 2 comments
Assignees
Labels
A-ADAPTER Topics related to the ADAPTER layer A-CLUSTER Topics related to the CLUSTER layer A-compute Area: compute

Comments

@ggevay
Copy link
Contributor

ggevay commented Apr 10, 2024

We probably won't implement this in the short term, because it's tough for various reasons:

We'd need to change the running round-up operator. Alternatively, we could just completely recreate the dataflow.

The MV collection's write frontier might regress. One way to get around this would be to just say that the new refresh schedule takes effect only after the next originally planned refresh, but this would prevent such usage of this feature where an already-sealed MV is unsealed and also prevent using the mechanism for REFRESH ON DEMAND. Another solution would be to entirely recreate the collection (and all dependant collections). Another solution would be to not immediately move the write frontier to the next refresh, but keep moving it second by second.

7/9/2024: Subsequent discussion noted that altering existing objects is extremely hard in dataflow land, so the correct solution here might be drop/create.

@ggevay ggevay added A-compute Area: compute A-ADAPTER Topics related to the ADAPTER layer labels Apr 10, 2024
@ggevay ggevay added the A-CLUSTER Topics related to the CLUSTER layer label Jun 10, 2024
@bosconi bosconi self-assigned this Jul 1, 2024
@bosconi bosconi added the D-good first issue (internal) Difficulty: Good for newcomers joining Materialize label Jul 1, 2024
@ggevay
Copy link
Contributor Author

ggevay commented Jul 4, 2024

Adding the "D-good first issue" label was a misclick? The description says "it's tough for various reasons". (It's in the "Much Later" section of the tracking issue.)

@ggevay ggevay removed the D-good first issue (internal) Difficulty: Good for newcomers joining Materialize label Jul 4, 2024
@bosconi
Copy link
Member

bosconi commented Jul 10, 2024

As discussed, yes, this is not a good first or second issue. Icebox. Brr.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-ADAPTER Topics related to the ADAPTER layer A-CLUSTER Topics related to the CLUSTER layer A-compute Area: compute
Projects
None yet
Development

No branches or pull requests

2 participants