You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ONEIO_S3_MAX_CONCURRENCY - number of multipart parts uploaded in parallel
(default 4, capped at 16).
ONEIO_S3_REQUEST_TIMEOUT_SECS - per-request timeout for S3 upload requests
(default 300, the previous hardcoded value).
Changed
S3 multipart uploads now run parts in parallel, reading each part's byte
range from a single open handle before uploading it. Previously parts were
uploaded one at a time, so a single TCP stream set the ceiling and one stalled part blocked
everything until the request timeout. Part retries, abort-on-failure and
part ordering are unchanged.
Peak memory for a multipart upload is concurrency * part_size (4 x 8 MiB
with the defaults).
Multipart parts are read from one open handle instead of reopening the path
in each worker, so a file replaced at the same path mid-upload can no longer
contribute bytes from two versions to a single object.