Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segmentation for uploading objects via InputStream #63

Closed
snhrdt opened this Issue May 7, 2014 · 2 comments

Comments

Projects
None yet
4 participants
@snhrdt
Copy link

snhrdt commented May 7, 2014

While I understand why the current code cannot support segmentation for objects uploaded via an InputStream, I would suggest to refactor the whole UploadInstructions / UploadPayloadInputStream / ... code to support at least indicating that the data that are streamed are going to be bigger than 5GiB (or whatever is configured as segment size on the OpenStack side), and to create the SegmentationPlan "on the fly" and not before the actual upload of the object.

By doing this, storing objects via streaming will be possible even for objects larger than the configured max segment size.

@shrikantdesai

This comment has been minimized.

Copy link

shrikantdesai commented Sep 27, 2018

any examples around use case ? I am using joss client trying to upload larger than 5GB file in chunks

@nrachan2004

This comment has been minimized.

Copy link

nrachan2004 commented Jan 11, 2019

Is there an issue when we use uploadInstructions.deleteAfter. It does not seem to delete the segmented files

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.