Skip to content

feat: add post-upload crc32c validation for most uploads #3146

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

BenWhitehead
Copy link
Collaborator

  • Resumable Uploads (JSON & gRPC)
  • BlobWriteSessionConfigs.getDefault() (JSON & gRPC)
  • BlobWriteSessionConfigs.bufferToTempDirThenUpload() (JSON & gRPC)
  • BlobWriteSessionConfigs.bufferToDiskThenUpload() (JSON & gRPC)
  • BlobWriteSessionConfigs.journaling() (gRPC)

BlobWriteSessionConfigs.parallelCompositeUpload() already performs crc32c checksum validation. Storage.create(BlobInfo, byte[]) already performs crc32c checksum validation

BlobAppendableUpload already performes crc32c checksum validation

BlobWriteSessionConfigs.bidiWrite() will be addressed in the future

Pending

  • tests
  • exception wrapping

@product-auto-label product-auto-label bot added size: l Pull request size is large. api: storage Issues related to the googleapis/java-storage API. labels Jun 11, 2025
* Resumable Uploads (JSON & gRPC)
* BlobWriteSessionConfigs.getDefault() (JSON & gRPC)
* BlobWriteSessionConfigs.bufferToTempDirThenUpload() (JSON & gRPC)
* BlobWriteSessionConfigs.bufferToDiskThenUpload() (JSON & gRPC)
* BlobWriteSessionConfigs.journaling() (gRPC)

BlobWriteSessionConfigs.parallelCompositeUpload() already performs crc32c checksum validation.
Storage.create(BlobInfo, byte[]) already performs crc32c checksum validation

BlobAppendableUpload already performes crc32c checksum validation

BlobWriteSessionConfigs.bidiWrite() will be addressed in the future
@BenWhitehead BenWhitehead force-pushed the feat/post-upload-crc32c-validation branch from 4cca7cb to 286bcd6 Compare June 11, 2025 20:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: storage Issues related to the googleapis/java-storage API. size: l Pull request size is large.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant