Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement database composer and partial fetch for Postgres #1434

Merged
merged 15 commits into from Mar 18, 2023

Conversation

Catmoonlight
Copy link
Contributor

@Catmoonlight Catmoonlight commented Feb 20, 2023

Pull request description

Add features to process partial backup, i.e. restore specified databases in default tablespace from archive

Database composer is a new type of tar composer that separates files from different folders into different tarballs. Using this composer with skip-redundant-tars option allows to restore databases without downloading all tars from archive.

Restoring specified databases is implemented with only-databases option. In current version this options allows to specify db ids to restore. It is planned to specify database names if metadata stored in archive

@usernamedt usernamedt self-requested a review February 20, 2023 18:40
internal/databases/postgres/backup_fetch_handler_new.go Outdated Show resolved Hide resolved
cmd/pg/backup_fetch.go Outdated Show resolved Hide resolved
internal/splitmerge/splitmerge_test.go Outdated Show resolved Hide resolved
pkg/storages/storage/utils_test.go Outdated Show resolved Hide resolved
cmd/pg/backup_fetch.go Outdated Show resolved Hide resolved
@Catmoonlight Catmoonlight marked this pull request as ready for review March 1, 2023 09:05
@Catmoonlight Catmoonlight requested a review from a team as a code owner March 1, 2023 09:05
@usernamedt
Copy link
Member

Partial backup test needs to be included to the CI workflow.

@usernamedt usernamedt changed the title Partial fetch Implement database composer and partial fetch for Postgres Mar 18, 2023
@usernamedt usernamedt merged commit dfb04c8 into wal-g:master Mar 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants