support streaming? #17

Closed
skippy opened this Issue Sep 20, 2010 · 6 comments

Comments

Projects
None yet
2 participants
@skippy

skippy commented Sep 20, 2010

any chance that streaming support will be added? sending objs that are 2-3 gigs in length are taking upto 8 gigs of memory to send.

the crux is this line in objects.rb
body = content.is_a?(IO) ? content.read : content

aws-s3 and right_aws both do this, though having gone through the code I know it is non-trivial.

@qoobaa

This comment has been minimized.

Show comment
Hide comment
@qoobaa

qoobaa Sep 21, 2010

Owner

You can try to implement it on your own if you need the feature.

Owner

qoobaa commented Sep 21, 2010

You can try to implement it on your own if you need the feature.

@skippy

This comment has been minimized.

Show comment
Hide comment

skippy commented Sep 25, 2010

thx

@qoobaa

This comment has been minimized.

Show comment
Hide comment
@qoobaa

qoobaa Sep 25, 2010

Owner

If I find some time I'll try to implement this. Currently I just don't need streaming.

Owner

qoobaa commented Sep 25, 2010

If I find some time I'll try to implement this. Currently I just don't need streaming.

@skippy

This comment has been minimized.

Show comment
Hide comment
@skippy

skippy Sep 25, 2010

hey,
I totally understand! I'm ok for now, but I did notice the gem excon, which takes care of a lot of the streaming quirks around the net/http library.

thanks Qoobaa for the very nice library and api!

skippy commented Sep 25, 2010

hey,
I totally understand! I'm ok for now, but I did notice the gem excon, which takes care of a lot of the streaming quirks around the net/http library.

thanks Qoobaa for the very nice library and api!

@qoobaa

This comment has been minimized.

Show comment
Hide comment
@qoobaa

qoobaa Sep 26, 2010

Owner

I've just added basic streaming support. Could you check if it works for you? I haven't released a new gem yet, it's on the master.

Owner

qoobaa commented Sep 26, 2010

I've just added basic streaming support. Could you check if it works for you? I haven't released a new gem yet, it's on the master.

@qoobaa

This comment has been minimized.

Show comment
Hide comment
@qoobaa

qoobaa Oct 12, 2010

Owner

It should work on the latest release.

Owner

qoobaa commented Oct 12, 2010

It should work on the latest release.

This issue was closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment