Source defaults from init if found

[chrisroberts]

No description provided.

[kamaradclimber]

default.elasticsearch[:default_file][:scrub_limits_conf] should be true by default to avoid having a breaking change

[chrisroberts]

@kamaradclimber 👍

[kamaradclimber]

this is fine with me

[maxim]

Folks, when will this be merged? I have a broken production, it dies randomly, and looks like this is the reason (see gist: https://gist.github.com/maxim/26278d8bc31e1c8d905b). If it isn't ready to merge, is there a workaround?

[maxim]

For anyone who needs to workaround this issue right now, before it's merged — follow this gist. It implies that you have a wrapper cookbook or that you can put additional cookbook in your runlist containing this fix.

https://gist.github.com/maxim/6032578

[karmi]

@maxim I'd be very surprised if limits would be responsible for the Unknown mlockall error 0 you're seeing -- much more probably, the system cannot lock memory (too weak virtual machine, permissions, ...). I suspect you'd hit problems coming from file limits later.

[karmi]

So, I've created a mashup of @chrisroberts and @ctrabolds versions, so now we have a sane approach to /etc/security/limits.* and run ulimit in the init script to be on the defensive. Thanks for writing and testing the code, @chrisroberts! Please let me know if this works as expected and has the same behaviour as your changes.

[maxim]

@karmi saw your mention on IRC as well. I ran ES on a machine with this configuration for months without problems, and all I did was rebuild identical-config'ed machine with updated ES. As soon as I applied my workaround - the crashing issue was gone, and since then (15 days ago) it's been running perfectly.

I'm surprised that you say limits have nothing to do with it, since the docs for ulimit -l state:

The maximum number of bytes of memory that may be locked into RAM. In effect this limit is rounded down to the nearest multiple of the system page size. This limit affects mlock(2) and mlockall(2) and the mmap(2) MAP_LOCKED operation.