Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Out of Memory error when running s3fs for couple of days. #748
Hi, i am experiencing an out of memory error when running s3fs for couple of days. Seems to depend on the amount of data uploaded.. but the disk seems not to be full.
Version of s3fs being used (s3fs --version)
Version of fuse being used (pkg-config --modversion fuse)
System information (uname -r)
Distro (cat /etc/issue)
s3fs command line used (if applicable)
Please tell me the exact version of s3fs you are using.
Thanks in advance for your assistance.
referenced this issue
May 6, 2018
@H6 I'm sorry for my late reply
I checked, reproduced and corrected the memory leak about v1.83.
If both s3fs and curl are linked with the NSS library, the possibility that the memory used inside CURL is increasing remains.
Takeshi, Thanks for your help on this issue! I have installed the latest version with the config change that you recommended and so far it seems to have no memory leak issues (3 days). I will continue to monitor it for a few more days and report back, if I encounter any issues. Thanks again, Pankaj Batra…
On Sun, May 27, 2018 at 7:21 AM, Takeshi Nakatani ***@***.***> wrote: @H6 <https://github.com/H6> I'm sorry for my late reply I checked, reproduced and corrected the memory leak about v1.83. And I merged #768 <#768> PR into the master branch. If you can, it is helpful if you build the latest code of the master branch and try it. If both s3fs and curl are linked with the NSS library, the possibility that the memory used inside CURL is increasing remains. In this case, set YES to the environment variable NSS_SDB_USE_CACHE. Here, I have not confirmed about this, but there are cases where memory usage increases in CURL+NSS. In order to avoid this memory increasing, try "export NSS_SDB_USE_CACHE=YES". — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#748 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AWX3WQWHNrvTfH9nz7RaN3LgqM5R9ToVks5t2oxMgaJpZM4TVCmi> .
-- Thanks, Pankaj Batra