Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
s3: fix for corrupted cache on multipart uploads #1867
Added a check for when the external output of a script to s3 is multipart, and setting the multipart chunksize to the correct one to recover the same ETag.
Also set the multipart threshold to ContentLength + 1 of the object if it's single part to avoid the copy to do it in multiple parts.
Added an exception for when the output object's ETag doesn't match the one copied to the cache.
Patch for s3 in #1410. Multipart uploads of variable size not supported