Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Harden marking S3 uploads as large images #1579

Merged
merged 1 commit into from
Jul 17, 2024
Merged

Conversation

manthey
Copy link
Member

@manthey manthey commented Jul 17, 2024

The S3 assetstore upload process saves the uploaded file potentially before the upload is finalized in S3. Reading the file immediately can report that the S3 key does not exist. When detecting uploaded files for S3, check if the S3 reported size is the same as the uploaded size. If not, poll and wait before checking.

The S3 assetstore upload process saves the uploaded file potentially
before the upload is finalized in S3.  Reading the file immediately can
report that the S3 key does not exist.  When detecting uploaded files
for S3, check if the S3 reported size is the same as the uploaded size.
If not, poll and wait before checking.
@manthey manthey merged commit e6022f4 into master Jul 17, 2024
15 of 16 checks passed
@manthey manthey deleted the harden-s3-uploads branch July 17, 2024 13:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant