Remove checksums from HTTP range request, add part checksums

[klauspost]

Description

Range requests silently ignores request for checksums. We now do so as well.

However part checksums should be stored and returned. This makes it possible for clients to compute expected checksums from parts.

This matches AWS S3 behavior.

We didn't store checksums, so this will only apply to new objects uploaded.

Motivation and Context

Compatibility

How to test this PR?

Mint tests here: minio/minio-go#1815

Types of changes

• Compatibility

[klauspost]

Testing part requests:

PUT /minio-go-test-o4bpfnzskfja5bnv/kqp1366oy42pnslpj59tk6gkxvzeny?partNumber=2&uploadId=YTQ0NDc3MTktNWViMS00YWY4LWI0NmMtYTgyMjMyYzE5YjAyLmU2YTMwYzcxLThhOGItNGY4Ni1hZmY4LTVhNTc1ZjE1MDNlZQ HTTP/1.1
[...]
X-Amz-Checksum-Crc32c: XUrXxQ==


GET /minio-go-test-o4bpfnzskfja5bnv/kqp1366oy42pnslpj59tk6gkxvzeny?partNumber=2 HTTP/1.1
[...]

HTTP/1.1 206 Partial Content
Content-Length: 10485760
Accept-Ranges: bytes
Content-Range: bytes 10485760-20971519/135266304
Content-Security-Policy: block-all-mixed-content
Content-Type: application/octet-stream
Date: Fri, 28 Apr 2023 10:10:10 GMT
Etag: "69d1b781cdc0867667046c1976a524d6-13"
Last-Modified: Fri, 28 Apr 2023 10:10:10 GMT
Server: MinIO
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Checksum-Crc32c: XUrXxQ==

[klauspost]

Checking range requests. Compare range vs non-range:

---------START-HTTP---------
HEAD /minio-go-test-ftvb3sx12po5psy3/6n3eqio5mzhdj21ijb0qdksga3mndr HTTP/1.1
Host: 127.0.0.1:9001
User-Agent: MinIO (windows; amd64) minio-go/v7.0.53 MinIO-go-FunctionalTest/0.1.0
Authorization: AWS4-HMAC-SHA256 Credential=minio/20230428/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-checksum-mode;x-amz-content-sha256;x-amz-date, Signature=**REDACTED**
X-Amz-Checksum-Mode: ENABLED
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230428T103952Z

HTTP/1.1 200 OK
Content-Length: 135266304
Accept-Ranges: bytes
Content-Security-Policy: block-all-mixed-content
Content-Type: application/octet-stream
Date: Fri, 28 Apr 2023 10:39:52 GMT
Etag: "f53530ed27095b54f75fd57277a19245"
Last-Modified: Fri, 28 Apr 2023 10:39:52 GMT
Server: MinIO
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Checksum-Sha256: 8Tlu9msuw/cpmWNEnQx97axliBjiE6gK1doiY0N9WuA=
X-Amz-Id-2: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Request-Id: 175A13152B53B9EC
X-Amz-Server-Side-Encryption: aws:kms
X-Amz-Server-Side-Encryption-Aws-Kms-Key-Id: arn:aws:kms:my-minio-key
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block
---------END-HTTP---------


---------START-HTTP---------
GET /minio-go-test-ftvb3sx12po5psy3/6n3eqio5mzhdj21ijb0qdksga3mndr HTTP/1.1
Host: 127.0.0.1:9001
User-Agent: MinIO (windows; amd64) minio-go/v7.0.53 MinIO-go-FunctionalTest/0.1.0
Authorization: AWS4-HMAC-SHA256 Credential=minio/20230428/us-east-1/s3/aws4_request, SignedHeaders=host;range;x-amz-checksum-mode;x-amz-content-sha256;x-amz-date, Signature=**REDACTED**
Range: bytes=100-1000
X-Amz-Checksum-Mode: ENABLED
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230428T103952Z

HTTP/1.1 206 Partial Content
Content-Length: 901
Accept-Ranges: bytes
Content-Range: bytes 100-1000/135266304
Content-Security-Policy: block-all-mixed-content
Content-Type: application/octet-stream
Date: Fri, 28 Apr 2023 10:39:52 GMT
Etag: "f53530ed27095b54f75fd57277a19245"
Last-Modified: Fri, 28 Apr 2023 10:39:52 GMT
Server: MinIO
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Request-Id: 175A13152BCDC6D8
X-Amz-Server-Side-Encryption: aws:kms
X-Amz-Server-Side-Encryption-Aws-Kms-Key-Id: arn:aws:kms:my-minio-key
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block