New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Elasticsearch stops itself randomly.. No error visible #2419
Comments
Check syslog and kern.log around the time when elasticsearch disappeared, do you see anything about oom-killer there? |
Yes there is. I am running this on an Amazon EC2 Micro instance. This server only serves analytical and logging data and receives minimal web traffic.
|
Basically, what happens here is system runs out of physical memory and kills the es out of self preservation. There are only two things you can do - reduce memory consumed by es or add more memory to the server (move to a larger instance in your case). Considering that micro instance has only 613M of memory, I would suggest the latter approach unless you have really small index. |
yah i just went ahead and boosted the memory. thanks. |
I have same problem in VPS with 2 gb ram memory, please help |
I'm having the same problem on an r3.2xlarge instance with 60 GB of RAM. OS: Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-48-generic x86_64).
|
That's elasticsearch being killed by a sigterm signal - the same one sent by You may want to check if it was killed by the oomkiller - I don't remember if it tries a sigterm before the sigkill but it might and that'd look like this. If it is the oomkiller this isn't an Elasticsearch bug - its you giving the process more memory than the machine can let it have. If. References: |
This might be old, but you might get an error such as this: -bash: fork: Cannot allocate memory ...if you try starting a new instance. |
i am having the same issue, i have 4gb ram and a 2 core cpu running elasticsearch 2.4.0 on ubuntu 14.04. |
@keshav-marketingmindz Did you solve your issue? I am in the same boat with you. |
@nextofsearch what do you see in syslog for the time when elasticsearch died? |
@nextofsearch Yes i resolved it, i used two different servers both are centOS. One server for elasticsearch only and one for other such as php mysql and our website. This worked for me. Hope will work for you too. |
i hava the same problem,then i try to modify the elasticsearch.conf:set.default.ES_HEAP_SIZE=256,it works! So i think the reason is the deficiency of memory.Hope it's helpful(对于这个问题,我觉得是服务器内存不足的原因,原来的ES_HEAP_SIZE试过1024、512,1024无法启动,512启动以后会突然崩溃,256可以正常运行) |
@brianvoss elastic recommend not going above 32 Gb https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html |
I installed the Debian package (0.19.11) on Ubuntu 12.04.1 LTS. Running with Oracle Java 7 had this same issue happening on OpenJDK 7
java version "1.7.0_09"
Java(TM) SE Runtime Environment (build 1.7.0_09-b05)
Java HotSpot(TM) 64-Bit Server VM (build 23.5-b02, mixed mode)
Basically after running for about 20 minutes elasticsearch will just stop running. I can't find a crash in the error log or even a shutdown sequence it's just not running anymore.
I am a little unsure what queries are being run. I am running it with Graylog2. But I don't think that is the issue as I turned off the Graylog daemons and even with nothing connected elasticsearch still terminated itself.
Graylog2 Server - 0.9.6p1 - Current Stable
Graylog2 Web Interface - 0.9.6p1 - Current Stable
The text was updated successfully, but these errors were encountered: