Elasticsearch Doesn't start, doesn't give any logs. #21300
Comments
clintongormley
added
feedback_needed
:Delivery/Packaging
|
Hi @ronakjain90 The logs should be in |
|
also, how much RAM does your node have? |
|
Hi, I have no logs under the directory I have been using ES 2.3 in an ubuntu instance of 1GB which works fine. but right now I've tried installing 5.0 in an instance of 2GB ram. |
|
It is maybe a combination of the default min/max heap size for Elasticsearch 5.0 that are now both aligned on |
|
I agree with @tlrx, this is probably a memory issue. You can check |
|
Hi Thanks for responding. I don't see anything in |
|
@ronakjain90 Please look for the |
|
You are right. It is a memory issue. Is there any way I can run this in a 2GB instance. If not what is the minimum memory requirement.? I think we should have a section that shows minimum system requirements so that users would know about it before hand? |
|
@ronakjain90 You can adjust the heap size settings in |
|
Thank you so much. Works like a charm. |
|
So the culprit here is the |
|
Related to #12716 |
On ubuntu 14.04, which uses upstart, where as our debian package uses sysvinit, there is no stdout/stderr message printed when starting up, because the start-stop-daemon swallows it. As Elasticsearch is started to daemonize, we can remove the background flag from the start-stop-daemon and thus see, if the system does not have enough memory for starting up - something that happens often on VMs, since Elasticsearch 5.0 uses 2gb by default instead of one. Relates elastic#21300 Relates elastic#12716
|
#21298 root@aaa# service elasticsearch start |
|
The error message is telling you the problem. You tried to set the heap size via |
…21343) On ubuntu 14.04, which uses upstart, where as our debian package uses sysvinit, there is no stdout/stderr message printed when starting up, because the start-stop-daemon swallows it. As Elasticsearch is started to daemonize, we can remove the background flag from the start-stop-daemon and thus see, if the system does not have enough memory for starting up - something that happens often on VMs, since Elasticsearch 5.0 uses 2gb by default instead of one. Relates #21300 Relates #12716
…21343) On ubuntu 14.04, which uses upstart, where as our debian package uses sysvinit, there is no stdout/stderr message printed when starting up, because the start-stop-daemon swallows it. As Elasticsearch is started to daemonize, we can remove the background flag from the start-stop-daemon and thus see, if the system does not have enough memory for starting up - something that happens often on VMs, since Elasticsearch 5.0 uses 2gb by default instead of one. Relates #21300 Relates #12716
…21343) On ubuntu 14.04, which uses upstart, where as our debian package uses sysvinit, there is no stdout/stderr message printed when starting up, because the start-stop-daemon swallows it. As Elasticsearch is started to daemonize, we can remove the background flag from the start-stop-daemon and thus see, if the system does not have enough memory for starting up - something that happens often on VMs, since Elasticsearch 5.0 uses 2gb by default instead of one. Relates #21300 Relates #12716
|
Hello all, **Noting that I've configured min/max heap size for Elasticsearch on 1gb [# Xms represents the initial size of total heap space Xmx represents the maximum size of total heap space-Xms1g The Error is shown below:- Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. 2018-08-03 22:19:02,901 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@5460cf3a[pattern=/var/log/elasticsearch/logging-test-%d{yyyy-MM-dd}-%i.log.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), SizeBasedTriggeringPolicy(size=134217728)]), strategy=DefaultRolloverStrategy(min=-2147483648, max=2147483647, useMax=false), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c{1.}] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@5460cf3a[pattern=/var/log/elasticsearch/logging-test-%d{yyyy-MM-dd}-%i.log.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), SizeBasedTriggeringPolicy(size=134217728)]), strategy=DefaultRolloverStrategy(min=-2147483648, max=2147483647, useMax=false), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c{1.}] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] 2018-08-03 22:19:02,903 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender 2018-08-03 22:19:02,910 main ERROR Unable to create file /var/log/elasticsearch/logging-test_access.log java.io.IOException: Could not create directory /private/var/log/elasticsearch 2018-08-03 22:19:02,911 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_access.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@31dadd46[pattern=/var/log/elasticsearch/logging-test_access-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}] %m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_access.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@31dadd46[pattern=/var/log/elasticsearch/logging-test_access-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}] %m%n, filePermissions=null, fileOwner=null]] 2018-08-03 22:19:02,913 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender 2018-08-03 22:19:02,919 main ERROR Unable to create file /var/log/elasticsearch/logging-test_deprecation.log java.io.IOException: Could not create directory /private/var/log/elasticsearch 2018-08-03 22:19:02,921 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_deprecation.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7e6ef134[pattern=/var/log/elasticsearch/logging-test_deprecation-%i.log.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=1073741824)]), strategy=DefaultRolloverStrategy(min=1, max=4, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c{1.}] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_deprecation.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7e6ef134[pattern=/var/log/elasticsearch/logging-test_deprecation-%i.log.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=1073741824)]), strategy=DefaultRolloverStrategy(min=1, max=4, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c{1.}] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] 2018-08-03 22:19:02,924 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender 2018-08-03 22:19:02,929 main ERROR Unable to create file /var/log/elasticsearch/logging-test_index_search_slowlog.log java.io.IOException: Could not create directory /private/var/log/elasticsearch 2018-08-03 22:19:02,934 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_index_search_slowlog.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@1921ad94[pattern=/var/log/elasticsearch/logging-test_index_search_slowlog-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_index_search_slowlog.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@1921ad94[pattern=/var/log/elasticsearch/logging-test_index_search_slowlog-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] 2018-08-03 22:19:02,941 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender 2018-08-03 22:19:02,947 main ERROR Unable to create file /var/log/elasticsearch/logging-test_index_indexing_slowlog.log java.io.IOException: Could not create directory /private/var/log/elasticsearch 2018-08-03 22:19:02,948 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_index_indexing_slowlog.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@6bca7e0d[pattern=/var/log/elasticsearch/logging-test_index_indexing_slowlog-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@2766ca9d] unable to create manager for [/var/log/elasticsearch/logging-test_index_indexing_slowlog.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@6bca7e0d[pattern=/var/log/elasticsearch/logging-test_index_indexing_slowlog-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] 2018-08-03 22:19:02,949 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender 2018-08-03 22:19:02,950 main ERROR Null object returned for RollingFile in Appenders. |
|
@AmrMostafaMarzouk Instead of posting on closed issues, you will have better luck if you use the forum. |
|
In my case there was no log or error output while running through: The problem showed when I executed script directly: Maybe it's best to update service startup script to fail if java is not installed? |
Elasticsearch version: 5.0.0
Plugins installed: none
JVM version:
openjdk version "1.8.0_91"
OpenJDK Runtime Environment (build 1.8.0_91-8u91-b14-0ubuntu4~14.04-b14)
OpenJDK 64-Bit Server VM (build 25.91-b14, mixed mode)
OS version: Ubuntu 14.04.5 LTS
Description of the problem including expected versus actual behavior: Elasticsearch fails to start, doesn't gives any logs.
Steps to reproduce: I'm using Ansible script to create my infrastructure. I had the same issue when I tried to upgrade my ES from 2.3 to ES 5.0. To determine the root cause, I've tried it in a new server with no installations.
name: Install apt-transport-https
apt: name=apt-transport-https state=present
name: Add Java (OpenJDK) Repository
apt_repository: repo='ppa:openjdk-r/ppa' state=present
name: Install Java (OpenJDK)
apt: pkg=openjdk-8-jdk state=installed update_cache=yes
name: Add Elasticsearch Key
apt_key:
url: 'https://artifacts.elastic.co/GPG-KEY-elasticsearch'
name: Add Elasticsearch Repository
apt_repository: repo='deb https://artifacts.elastic.co/packages/5.x/apt stable main' state=present
name: Install Elasticsearch
apt: pkg=elasticsearch state=installed update_cache=yes
name: Init Elasticsearch
command: update-rc.d elasticsearch defaults 95 10
name: Enable Elasticsearch (Start on boot)
service: name=elasticsearch enabled=yes
Provide logs (if relevant): I don't see any logs, link to the YML file.
https://gist.github.com/ronakjain90/08ae1c225f806af81e383aba24804a60
Describe the feature: Since I'm just trying to install the ES with no extra plugins, it seems weird that it just fails to start providing no clue why is it is crashing, since there are no logs that I can see. ES 5.0 works fine in my MacBook though.
The text was updated successfully, but these errors were encountered: