Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large number of GetObjectTagging requests with S3 Scality storage #2319

Open
MonChr opened this issue Apr 9, 2024 · 2 comments
Open

Large number of GetObjectTagging requests with S3 Scality storage #2319

MonChr opened this issue Apr 9, 2024 · 2 comments
Assignees
Labels

Comments

@MonChr
Copy link

MonChr commented Apr 9, 2024

Please provide the following information when submitting an issue (feature requests or general comments can skip this):

1. pgBackRest version:
pgBackRest 2.50

2. PostgreSQL version:
PostgreSQL 15.6

3. Operating system/version:
Red Hat Enterprise Linux 8.9

4. Install pgBackRest:
From package : pgbackrest-2.50-1PGDG.rhel8.x86_64

5. pgbackrest configuration:
[global]
compress-type=none
delta=y
lock-path=/var/run/postgresql
process-max=3
log-level-console=info
log-level-file=info
log-level-stderr=info
log-path=/var/log/pgbackrest
log-timestamp=y
archive-async=y
archive-missing-retry=y
archive-push-queue-max=50GiB
archive-get-queue-max=20GiB
spool-path=/applis/spoolwal
archive-check=y
archive-copy=y
archive-mode-check=y
backup-standby=n
expire-auto=y
start-fast=y
repo1-retention-full-type=time
repo1-retention-archive-type=full
repo1-retention-full=15
repo1-retention-diff=15
repo1-retention-history=0
repo1-type=s3
repo1-s3-uri-style=path
repo1-s3-bucket=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
repo1-s3-endpoint=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
repo1-s3-key=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
repo1-s3-key-secret=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
repo1-path=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
repo1-s3-region=eu-west-3
repo1-s3-verify-tls=n
repo1-bundle=y
repo1-block=y
repo1-bundle-limit=1MiB
repo1-bundle-size=10MiB

[xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx]
pg1-host-type=ssh
pg1-socket-path=/var/run/postgresql
pg1-host-user=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
pg1-path=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
pg1-port=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

7. Description of the issue:
Hi,
We are surprised by the pgbackrest activity profile with very numerous GetObjectTagging requests at the S3 Scality ring. Is this "normal" behavior, is it due to our configuration?
Thank you for your insight.
image

@dwsteele dwsteele self-assigned this Apr 10, 2024
@dwsteele
Copy link
Member

dwsteele commented Apr 10, 2024

We do not explicitly fetch tags (i.e. https://docs.aws.amazon.com/AmazonS3/latest/API/API_GetObjectTagging.html) so not sure where this is coming from. It could be that Scality is piggy-backing these requests on a list request.

@MonChr
Copy link
Author

MonChr commented Apr 10, 2024

Thank you for your response, we are also questioning Scality on this subject.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants