question: streaming large responses

[rodnaph]

i've been using http-kit with compojure (just as a drop in replacement for jetty, no special considerations), but have come across some memory issues when trying to stream large responses (15mb+ email attachments from an imap connection).

jetty handles this fine with the ring response...

{:body (io/input-stream content-stream)}

but http-kit blows the heap (limited to 32mb).

should i look into debugging this further, or is this outside the scope of what http-kit is targeted at?

thanks

[shenfeng]

jetty and http-kit handle this differently.

http-kit will try to read all the input-stream to memory before write them. jetty will read a little, then write the output.

It's very hard for http-kit to optimise for this scenario. (I have no clue how to do it yet)

If the content-stream is a file, large file is optimised.

{:body big-file}

[rodnaph]

Ah ok, I suspected it might be doing that.

No problem, as long as I know what's going on. Thanks!