PUTs fail to S3 with Request Error: Header "x-amz-content-sha256" set to the hex-encoded SHA256 hash ... AWS Version 4

[cyberduck]

4e36ae0 created the issue

Something must be wrong with my macOS install? Writing a 100M file to Amazon S3 fails with:

Request Error: Header "x-amz-content-sha256" set to the hex-encoded SHA256 hash of the request payload is required for AWS Version 4 request signing, please set this on: PUT https://X.s3.amazonaws.com:443/test/duck_100M HTTP/1.1. Please contact your web hosting service provider for assistance.

I've reinstalled and confirmed Cyberduck 7.1.0 does not have this problem.

"defaults read ch.sudo.cyberduck" shows:
"s3.location" = "us-west-2";
"s3.signature.version" = AWS4HMACSHA256;

---

Attachments

• cyberduck-log-11038.txt (29.1 KiB)

[cyberduck]

@dkocher commented

I cannot reproduce this error. Can you please provide some log output.

[cyberduck]

4e36ae0 commented

Thank you for investigating. I attached logs though I don't see these menu items in my Cyberduck:
Action → Include Info Messages and Action → Include Debug Messages

Hopefully the logs are still useful, let me know if you want me to test anything else or gather more logs.

[cyberduck]

@dkocher commented

Can you let me know if you can still reproduce with version 7.4.

[cyberduck]

4e36ae0 commented

Same error with 7.4.0. Do you want another set of logs, were the previous logs helpful? If it's something in my config maybe you could tell me what to clear or I could attach the file?

[cyberduck]

4e36ae0 commented

Aha a breakthrough! It appears to be specific to certain files. Download this file (100M of NULs) then try uploading to an Amazon S3 bucket.
https://jam.cloud.caringo.com/public/duck_100M
You should now see the V4 signature error related to "x-amz-content-sha256".

A colleague verified the same error with a 100MB random bytes file, so it seems more about the size than contents.

dd if=/dev/urandom of=Desktop/test-100M.out bs=1024k count=100

Hopefully you can see the bug now, let me know if you need anything. Thanks!

[cyberduck]

@dkocher commented

I can reproduce the bug which should only affects files with exactly 104857600B in file length.

[cyberduck]

@ylangisc commented

In 83789e7.