Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Client Side Timeline/Backup LSN Support #187

Closed
5 tasks done
Jubilee101 opened this issue Feb 15, 2024 · 1 comment
Closed
5 tasks done

Client Side Timeline/Backup LSN Support #187

Jubilee101 opened this issue Feb 15, 2024 · 1 comment
Assignees
@Jubilee101
Labels
feature New feature

Comments

@Jubilee101
Copy link
Collaborator

Jubilee101 commented Feb 15, 2024 •
edited

Currently pgmoneta has little support for fetching/extracting LSN info related to timeline and backup. We would like the following feature:

  • .history file streaming
  • .history file parsing
  • Corresponding prometheus support
  • Make sure pgmoneta starts fetching WAL segments of the next timeline when the current one ends
  • Extracting starting/ending LSN from backup_label into backup.info

Some references:
https://www.highgo.ca/2021/11/01/the-postgresql-timeline-concept/
https://developer.aliyun.com/article/234
https://www.postgresql.org/docs/current/protocol-replication.html
@Jubilee101 Jubilee101 added the feature New feature label Feb 15, 2024
@Jubilee101 Jubilee101 self-assigned this Feb 15, 2024
@Jubilee101 Jubilee101 changed the title Timeline Support Timeline/Backup LSN Support Feb 15, 2024
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Feb 19, 2024
@Jubilee101
[pgmoneta#187] Make WAL streaming follow timeline change
0bfd5ff
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
5cf33f2
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
0bd4367
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
7f3f2bc
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
bd9d2a4
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
71d5a42
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
2807be4
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
897016e
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 2, 2024
@Jubilee101
[pgmoneta#187] Parse .history and expose to prometheus
64588c8
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 3, 2024
@Jubilee101
[pgmoneta#187]transfer cur_timeline info during reload & fix timeline…
d02312b 
…_history

initialization
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 3, 2024
@Jubilee101
[pgmoneta#187]transfer cur_timeline info during reload & fix timeline…
9953a28 
…_history initialization
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 3, 2024
@Jubilee101
[pgmoneta#187]copy cur_timeline & initialize timeline_history
bd64d52
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Mar 4, 2024
@Jubilee101
[pgmoneta#187] Extract WAL info from backup_label
2ad847b
jesperpedersen pushed a commit that referenced this issue Mar 4, 2024
@Jubilee101 @jesperpedersen
[#187] Extract WAL info from backup_label
50c3177
@Jubilee101 Jubilee101 mentioned this issue Mar 5, 2024
Closed
2 tasks
@Jubilee101
Copy link
Collaborator Author

Close this as most tasks have been done. I'll later submit a separate issue for server side LSN. That'll tie into the extension project, and require looking into postgres internals - base backup command as well as mvcc stuff.

@Jubilee101 Jubilee101 changed the title Timeline/Backup LSN Support Client Side Timeline/Backup LSN Support Apr 8, 2024
Jubilee101 added a commit to Jubilee101/pgmoneta that referenced this issue Apr 8, 2024
@Jubilee101
[pgmoneta#187] Receive WAL end pos of backup from server
f8e707b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Jubilee101 Jubilee101

Labels
feature New feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Jubilee101