Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Native backup #123

Closed
jesperpedersen opened this issue May 17, 2023 · 5 comments
Closed

Native backup #123

jesperpedersen opened this issue May 17, 2023 · 5 comments
Assignees
@Jubilee101
Labels
feature New feature

Comments

@jesperpedersen
Copy link
Member

Replace pg_basebackup with a native solution based on the replication protocol
@jesperpedersen jesperpedersen added the feature New feature label May 17, 2023
@jesperpedersen
Copy link
Member Author

@Jubilee101 Please, fill this out

jesperpedersen pushed a commit that referenced this issue May 17, 2023
@Jubilee101 @jesperpedersen
[#123] Native backup: Foundation
f15030e 
Based upon a patch by jesper.pedersen@redhat.com
@Jubilee101
Copy link
Collaborator

Jubilee101 commented May 17, 2023 •
edited

@Jubilee101 Please, fill this out

@jesperpedersen Just to make sure, you mean with commits right? Or do I need to put doc here?

@jesperpedersen
Copy link
Member Author

It should be the brief summary of your doc

@Jubilee101
Copy link
Collaborator

Jubilee101 commented May 17, 2023 •
edited

Currently pgmoneta generates backups by sending pg_basebackup command to Postgres database server. We want to rid of this dependency on Postgres binaries by implementing the process this command triggers. This roughly involves:

  1. Sending the BASE_BACKUP command to the server.
  2. Implementing the Streaming Replication Protocol to receive the backup and the necessary write-ahead log.
  3. Saving the backup locally, verifying checksum and performing compression if necessary.

For more details, please see my disscussion forum: #120

@Jubilee101 Jubilee101 mentioned this issue May 18, 2023
Closed
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue May 28, 2023
@Jubilee101
[pgmoneta#123] Native backup: Foundation
51d9ed2 
Based upon a patch by jesper.pedersen@redhat.com
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue May 28, 2023
@Jubilee101
[pgmoneta#123]Common functionalities for native backup
dabe80c
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue May 28, 2023
@Jubilee101
[pgmoneta#123]Common functionalities for native backup
a1069dd
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue May 28, 2023
@Jubilee101
[pgmoneta#123]Common functionalities for native backup
593b89f
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue May 28, 2023
@Jubilee101
[pgmoneta#123]Common functionalities for native backup
1f0ca6f
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue May 30, 2023
@Jubilee101
[pgmoneta#123]Common functionalities for querying server version
aafdd9c
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jun 17, 2023
@Jubilee101
[pgmoneta#123] Receive and consume copy stream messages
fd990d1
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jun 17, 2023
@Jubilee101
[pgmoneta#123] Receive and consume copy stream messages
cf4a7f5
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jun 20, 2023
@Jubilee101
[pgmoneta#123] Receive and consume copy stream messages
3a8d8a7
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jun 20, 2023
@Jubilee101
[pgmoneta#123] Receive and consume copy stream messages
f440f5c
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jun 23, 2023
@Jubilee101
[pgmoneta#123] Receive and parse DataRow messages in stream buffer
f05dd09
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 4, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive (for server ve…
bee095c 
…rsion < 15)
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 4, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive (for server ve…
ecb901c 
…rsion < 15)
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 4, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive (for server ve…
6219bac 
…rsion < 15)
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 4, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive (for server ve…
4833cd7 
…rsion < 15)
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 5, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive
243a7fb
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 6, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive
d7cb400
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 7, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive
a30a473
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 10, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive
0b70849
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 10, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive
94910f1
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 10, 2023
@Jubilee101
[pgmoneta#123] Receive and extract base backup archive
bc0b35c
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 11, 2023
@Jubilee101
[pgmoneta#123] Base backup functionality integration
0ebef67
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 11, 2023
@Jubilee101
[pgmoneta#123] Base backup functionality integration
6bec20c
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 11, 2023
@Jubilee101
[pgmoneta#123] Base backup functionality integration
6b98807
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 12, 2023
@Jubilee101
[pgmoneta#123] Base backup functionality integration
83cbad2
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 12, 2023
@Jubilee101
[pgmoneta#123] Base backup functionality integration
e9637e0
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Jul 14, 2023
@Jubilee101
[pgmoneta#123] Update pgmoneta.spec
14cfb84
jesperpedersen pushed a commit that referenced this issue Jul 14, 2023
@Jubilee101 @jesperpedersen
[#123] Update pgmoneta.spec
82b5ff3
jesperpedersen added a commit that referenced this issue Jul 18, 2023
@jesperpedersen
[#123] Use WAL true for BASE_BACKUP
2562c44
@Jubilee101
Copy link
Collaborator

Hey should we close this issue? Or do we want to use this for more advanced backups as well?

jesperpedersen added a commit that referenced this issue Aug 8, 2023
@jesperpedersen
[#123] [#139] Remove pgsql_dir dependency
ed75a6e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Jubilee101 Jubilee101

Labels
feature New feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jesperpedersen @Jubilee101