Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Velero data movement - data path design #5594

Closed
Lyndon-Li opened this issue Nov 16, 2022 · 1 comment
Closed

Velero data movement - data path design #5594

Lyndon-Li opened this issue Nov 16, 2022 · 1 comment
Assignees
Labels
Area/Design Design Documents

Comments

@Lyndon-Li
Copy link
Contributor

Lyndon-Li commented Nov 16, 2022

We need to create a design to answer below data movement data path questions for backup:

  1. After a snapshot is taken, how is the snapshot exposed to the data mover pod
  2. How many snapshots are exposed to one data mover pod, what is the parallel processing like
  3. For file system data movement, after the snapshots are exposed, how to launch Kopia uploader as mentioned in the design Unified Repository Design #4926
  4. For file system data movement, how is the data organized in the Unified Repository
  5. What about block data movement, we can set it as non-goal and cover it in a separate design in future. But at present, we at least need to clarify how to choose the data movement mode(file system, block) and how is the mode persisted
  6. How does the uploader writes data to Unified Repository. This should be the same with pod volume backup as shown in Unified Repository Design #4926, but we need to clarify the entire data flow
  7. How is the Unified Repository is invoked for initialization

Similarly, we need to answer some questions for restore:

  1. After the target PV is created, how is the PV exposed to the data mover pod
  2. How many target PVs are exposed to one data mover pod, what is the parallel processing like
  3. For file system data movement, after the PVs are exposed, how to launch Kopia uploader
  4. An entire workflow to show how the uploader reads data from Unified Repository
@Lyndon-Li Lyndon-Li changed the title Velero data movement data path design for backup Velero data movement - data path design for backup Nov 16, 2022
@Lyndon-Li Lyndon-Li changed the title Velero data movement - data path design for backup Velero data movement - data path design Nov 16, 2022
@reasonerjt reasonerjt added Area/Design Design Documents and removed 1.11-candidate labels Jan 10, 2023
@reasonerjt
Copy link
Contributor

This will be covered in v1.11 when we deliver the overall design of data mover in velero.
Closing as dup of #4112

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area/Design Design Documents
Projects
None yet
Development

No branches or pull requests

2 participants