You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
So upload_chunk_size is for multipart uploads only. But the no persistent disk example is supposed to use the PutObject API, since that is best when you don't have disk to store the upload state file.
https://github.com/fluent/fluent-bit-docs/blob/master/pipeline/outputs/s3.md#using-s3-without-persisted-disk
In this example config,
total_file_size
is specified as 1M. However, default value ofupload_chunk_size
is 5,242,880 bytes andupload_chunk_size
can not be larger thantotal_file_size
.https://github.com/fluent/fluent-bit/blob/44190c2a1c4b939dc9ecb2908148d38c82a40831/plugins/out_s3/s3.c#L353-L357
Also,
upload_chunk_size
must be at least 5,242,880 bytes.https://github.com/fluent/fluent-bit/blob/44190c2a1c4b939dc9ecb2908148d38c82a40831/plugins/out_s3/s3.c#L358-L361
Proposal:
Would you modify the example as below?
The text was updated successfully, but these errors were encountered: