Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only sync from available BSLs #3187

Closed
wants to merge 1 commit into from
Closed

Conversation

carlisia
Copy link
Contributor

@carlisia carlisia commented Dec 15, 2020

What do y'all think of this idea?

Mainly:

  • if BSL is not available, continue and don't attempt to sync (bc, unavailable)
  • only even initialize the backup store if the BSL is available AND the # of items to sync is > 0

Some changes to make this work: a new field location.Soec.BackupList would need to be added to the BSL. This field would be a list of strings containing a list of all backups in the store corresponding to that BSL. This field would be populated everytime a BSL was validated.

The sync interval would additionally be dependent on the BSL logic for how frequent to validate a location (https://github.com/vmware-tanzu/velero/blob/main/internal/storage/storagelocation.go#L39-L77).

Signed-off-by: Carlisia carlisia@vmware.com

Signed-off-by: Carlisia <carlisia@vmware.com>
@nrb
Copy link
Contributor

nrb commented Dec 15, 2020

a new field location.Soec.BackupList would need to be added to the BSL.

  1. We may very easily run into Kube API server object size limits with this, because users could have a LOT of backups in a BSL depending on their scheduled frequency.
  2. I think this should be in the Status if we're fully managing it, versus letting the user set it.

Would it be possible to record only the number of backups instead of a full list and get the same result? I like the overall idea here, just trying to think of a way to make sure we can scale it.

@nrb
Copy link
Contributor

nrb commented Mar 11, 2021

@carlisia What's the status of this PR?

@carlisia
Copy link
Contributor Author

@nrb sorry I missed your question. I will be thinking through this issue and the questions you raised when I start thinking about the CLI work for v1.7, which is soon.

@dsu-igeek
Copy link
Contributor

This is superseded by merging the sync and BSL controller together, per Carlisia

@dsu-igeek dsu-igeek closed this Jun 2, 2021
@carlisia carlisia deleted the c-sync branch June 28, 2021 13:31
@carlisia
Copy link
Contributor Author

I realized I hadn't opened a ticket for this. Here it is: Merge the BSL and sync controllers · Issue #3908 · vmware-tanzu/velero.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants