Skip to content

v0.27.0

Latest

Choose a tag to compare

@github-actions github-actions released this 24 Oct 01:54
· 3 commits to main since this release
v0.27.0
33f02e4

Added

  • ONEIO_S3_MAX_CONCURRENCY - number of multipart parts uploaded in parallel
    (default 4, capped at 16).
  • ONEIO_S3_REQUEST_TIMEOUT_SECS - per-request timeout for S3 upload requests
    (default 300, the previous hardcoded value).

Changed

  • S3 multipart uploads now run parts in parallel, reading each part's byte
    range from a single open handle before uploading it. Previously parts were
    uploaded one at a time, so a single TCP stream set the ceiling and one stalled part blocked
    everything until the request timeout. Part retries, abort-on-failure and
    part ordering are unchanged.
  • Peak memory for a multipart upload is concurrency * part_size (4 x 8 MiB
    with the defaults).
  • Multipart parts are read from one open handle instead of reopening the path
    in each worker, so a file replaced at the same path mid-upload can no longer
    contribute bytes from two versions to a single object.