Use sendfile system call on Linux in HTTPServerResponseImpl::sendFile

[carun]

At the moment, HTTPServerResponseImpl::sendFile uses StreamCopied::copyStream which in turn uses intermediate buffer copies. This is inefficient on Linux as the buffers are copied from user space to user space and again from user space to kernel space.

poco/Net/src/HTTPServerResponseImpl.cpp

Line 131 in 3fc3e5f

StreamCopier::copyStream(istr, *_pStream);

poco/Foundation/src/StreamCopier.cpp

Line 36 in 3fc3e5f

istr.read(buffer.begin(), bufferSize);

As the size of the file increases this will become evident as the kernel buffer cache will get filled up pretty quickly and we have to resort to running

$ free -m
              total        used        free      shared  buff/cache   available
Mem:          32115        1859       12880           1       17374       29812
Swap:          3935         167        3768

$ echo 3 | sudo tee /proc/sys/vm/drop_caches
3

$ free -m
              total        used        free      shared  buff/cache   available
Mem:          32115        1866       29841           1         407       29816
Swap:          3935         167        3768

Linux has sendfile system call. This can be used to speed up the sends and also minimize the memory usage of the process and in turn reduce the kernel buffer cache.

[aleks-f]

It would require exposing the file descriptors, either at the HTTPResponse (from HTTPSession) level, or at the streams layer. Plus reliably detecting if sendfile() is available (since 2.2, so I think practically can be relied on being there for linux).

[github-actions]

This issue is stale because it has been open for 365 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 60 days since being marked as stale.

[github-actions]

This issue was closed because it has been inactive for 60 days since being marked as stale.