Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

suspend background operations on source pageserver before relocation to avoid remote metadata corruption #2740

Closed
LizardWizzard opened this issue Nov 2, 2022 · 4 comments
Closed

suspend background operations on source pageserver before relocation to avoid remote metadata corruption #2740

LizardWizzard opened this issue Nov 2, 2022 · 4 comments
Assignees
@LizardWizzard
Labels
a/reliability Area: relates to reliability of the service c/storage/pageserver Component: storage: pageserver c/storage Component: storage
Milestone
2023/03

Comments

@LizardWizzard
Copy link
Contributor

No description provided.

@LizardWizzard LizardWizzard mentioned this issue Nov 2, 2022
Closed
1 task
@LizardWizzard LizardWizzard self-assigned this Nov 2, 2022
@LizardWizzard LizardWizzard added a/reliability Area: relates to reliability of the service c/storage/pageserver Component: storage: pageserver c/storage/s3 c/storage Component: storage labels Nov 2, 2022
@LizardWizzard LizardWizzard linked a pull request Nov 2, 2022 that will close this issue
try to toggle background activity without a race condition #2665
Closed
@neondatabase-bot neondatabase-bot bot added this to the 2022/11 milestone Nov 9, 2022
@neondatabase-bot neondatabase-bot bot modified the milestones: 2022/11, 2023/01 Dec 20, 2022
@neondatabase-bot neondatabase-bot bot modified the milestones: 2023/01, 2023/02 Jan 9, 2023
@neondatabase-bot neondatabase-bot bot modified the milestones: 2023/02, 2023/03 Feb 19, 2023
@NanoBjorn
Copy link
Contributor

@LizardWizzard this issue means that calling tenant/{tenant_id}/ignore does not actually mean, that all of the background operations of the tenant are finished?

@LizardWizzard
Copy link
Contributor Author

@NanoBjorn
The idea of this task is to suspend background jobs without calling ignore so tenant can continue answering compute requests

@LizardWizzard
Copy link
Contributor Author

cc @jcsp That was one of the ideas to avoid concurrent updates to index_part.json. Feel free to close if wont be relevant for the design chosen to solve the HA

@jcsp
Copy link
Contributor

jcsp commented Aug 14, 2023

Thanks for the ping -- I'll close this + create a fresh ticket later, I think we will want to suspend background operations during migration, but it'll be an optimization rather than a corruption-avoidance thing.

@jcsp jcsp closed this as completed Aug 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@LizardWizzard LizardWizzard

Labels
a/reliability Area: relates to reliability of the service c/storage/pageserver Component: storage: pageserver c/storage Component: storage
Projects
None yet
Milestone
2023/03
Development

Successfully merging a pull request may close this issue.

try to toggle background activity without a race condition neondatabase/neon
3 participants
@jcsp @NanoBjorn @LizardWizzard