Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backup to s3 corrupted whih larger SSTables files #33

Closed
aharonh opened this issue Jun 12, 2024 · 0 comments · Fixed by #34
Closed

Backup to s3 corrupted whih larger SSTables files #33

aharonh opened this issue Jun 12, 2024 · 0 comments · Fixed by #34

Comments

@aharonh
Copy link
Member

aharonh commented Jun 12, 2024

The known nuvo/skbn issue nuvo/skbn#30 causes scilent failures when larger db files are backed-up to s3. This is due to use of default parameters for s3 multipart upload. To allow larger files upload, enable configuration of s3 max upload parts and s3 part size parameters. Adjust defaults to allow for up to 1.2 Tb files. For larger max files size, make sure to adjust those paramters.

Adding verbose logging information to help detect issues in transfer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant