Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to batch Storage.create() requests #2351

Closed
chamikaramj opened this issue Aug 17, 2017 · 7 comments
Closed

Add ability to batch Storage.create() requests #2351

chamikaramj opened this issue Aug 17, 2017 · 7 comments
Assignees
Labels
api: storage Issues related to the Cloud Storage API. priority: p2 Moderately-important priority. Fix may not be included in next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.

Comments

@chamikaramj
Copy link

Seems like current batching API [1] does not support batching create [2] requests. Batching create requests might be needed for some use cases; for example, if a user needs to create a large number of small files.

If this is already supported it might be good to add an example.

[1] https://github.com/GoogleCloudPlatform/google-cloud-java/blob/master/google-cloud-storage/src/main/java/com/google/cloud/storage/StorageBatch.java#L55
[2] https://github.com/GoogleCloudPlatform/google-cloud-java/blob/master/google-cloud-storage/src/main/java/com/google/cloud/storage/Storage.java#L1427

@chamikaramj
Copy link
Author

cc: @garrettjonesgoogle

@garrettjonesgoogle garrettjonesgoogle added api: storage Issues related to the Cloud Storage API. priority: p2 Moderately-important priority. Fix may not be included in next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. labels Aug 18, 2017
@yihanzhen
Copy link
Contributor

This has been added to our feature backlog: https://github.com/GoogleCloudPlatform/google-cloud-java/wiki/Feature-backlog . This issue will be closed but is linked in the backlog and can continue to be used for comment and discussion.

@aditya232
Copy link

Any timeline for this feature?We have a use case where we have to upload a number of small files to GCS and could do way better on throughput if this feature was available.

@PadrePadrone
Copy link

This feature would significantly imrove our application performance.
Any timeline for it?

@janaton
Copy link

janaton commented Aug 25, 2020

This has been added to our feature backlog: https://github.com/GoogleCloudPlatform/google-cloud-java/wiki/Feature-backlog . This issue will be closed but is linked in the backlog and can continue to be used for comment and discussion.

@yihanzhen please, is there any new ticket we could watch? I can not find any reference to this closed ticket in the reference Feature-backlog document and also no new ticket that could be related to this topic. We would also greatly appropriate this batched feature to radically speed up upload of several thousands small files. Thanks a lot

@yihanzhen
Copy link
Contributor

Hey I no longer work on java libraries. I filed ^^^^ in the java storage's repo for current project owners to triage. Please follow it there for updates.

@janaton
Copy link

janaton commented Aug 27, 2020

Thank you very much for forwarding this issue to the correct place

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: storage Issues related to the Cloud Storage API. priority: p2 Moderately-important priority. Fix may not be included in next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.
Projects
None yet
Development

No branches or pull requests

6 participants