Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Logstash high CPU usage #9205

Closed
JulianYuan opened this issue Mar 2, 2018 · 1 comment
Closed

Logstash high CPU usage #9205

JulianYuan opened this issue Mar 2, 2018 · 1 comment

Comments

@JulianYuan
Copy link

I upgraded Elastic Stack from 5.6.3 to 6.2.2, but the Logstash CPU usage go high and no error logs.

Logstash stats
2018-03-02_095340

Logstash Config:

input {
  beats {
    port => 5044
    add_field => {
      "logstashId" => "logstash1"
    }
  }
}

output {
  elasticsearch {
    action => "index"
    hosts  => ["localhost:9200"]
    index  => "test-%{+YYYY.MM.dd}"
    manage_template => false
    template_overwrite => true
    document_type => "%{[@metadata][type]}"
  }
}

$top
top - 09:40:02 up 371 days, 3 min,  2 users,  load average: 1.74, 1.49, 1.28
Tasks: 190 total,   1 running, 189 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.5 us,  0.1 sy,  0.0 ni, 99.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 20396440 total,  8862336 free,  6573776 used,  4960328 buff/cache
KiB Swap: 16515068 total, 15727996 free,   787072 used. 13406740 avail Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
26113 admin  20   0 11.969g 1.453g  20304 S 100.0  7.5   1119:41 java
    1 root      20   0   74020  35220   1332 S   0.0  0.2   6:19.52 systemd
    2 root      20   0       0      0      0 S   0.0  0.0   0:04.59 kthreadd

$ top -H -p 26113
top - 09:40:18 up 371 days, 3 min,  2 users,  load average: 1.53, 1.46, 1.27
Threads:  64 total,   1 running,  63 sleeping,   0 stopped,   0 zombie
%Cpu(s): 26.0 us,  1.8 sy,  0.0 ni, 72.3 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 20396440 total,  8861800 free,  6574300 used,  4960340 buff/cache
KiB Swap: 16515068 total, 15727996 free,   787072 used. 13406216 avail Mem

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
26154 admin  20   0 11.969g 1.453g  20304 R 96.3  7.5 993:23.30 LogStash::Runne
26126 admin  20   0 11.969g 1.453g  20304 S  2.7  7.5  24:44.55 java
26127 admin  20   0 11.969g 1.453g  20304 S  2.7  7.5  24:44.69 java
26128 admin  20   0 11.969g 1.453g  20304 S  2.7  7.5  24:44.26 java
26129 admin  20   0 11.969g 1.453g  20304 S  2.7  7.5  24:44.46 java

$jstack -F 26113 > temp.log
Thread 26154: (state = IN_NATIVE)
 - com.kenai.jffi.Foreign.invokeN3O1(long, long, long, long, long, java.lang.Object, int, int, int) @bci=0 (Compiled frame; information may be imprecise)
 - com.kenai.jffi.Invoker.invokeN3(com.kenai.jffi.CallContext, long, long, long, long, int, java.lang.Object, com.kenai.jffi.ObjectParameterStrategy, com.kenai.jffi.ObjectParameterInfo) @bci=79, line=1061 (Compiled frame)
 - jnr.posix.LinuxLibC$jnr$ffi$0.open(java.lang.CharSequence, int, int) @bci=82 (Compiled frame)
 - jnr.posix.BaseNativePOSIX.open(java.lang.CharSequence, int, int) @bci=7, line=619 (Compiled frame)
 - jnr.posix.CheckedPOSIX.open(java.lang.CharSequence, int, int) @bci=7, line=464 (Compiled frame)
 - jnr.posix.LazyPOSIX.open(java.lang.CharSequence, int, int) @bci=7, line=460 (Compiled frame)
 - org.jruby.util.RegularFileResource.openChannel(org.jruby.util.io.ModeFlags, int) @bci=31, line=160 (Compiled frame)
 - org.jruby.util.io.PosixShim.open(java.lang.String, java.lang.String, org.jruby.util.io.ModeFlags, int) @bci=42, line=414 (Compiled frame)
 - org.jruby.RubyIO.cloexecOpen(org.jruby.Ruby, org.jruby.RubyIO$Sysopen) @bci=31, line=1266 (Compiled frame)
 - org.jruby.RubyIO.sysopenFunc(org.jruby.Ruby, org.jruby.RubyIO$Sysopen) @bci=2, line=1252 (Compiled frame)
 - org.jruby.RubyIO.sysopenInternal(org.jruby.Ruby, org.jruby.RubyIO$Sysopen) @bci=2, line=1244 (Compiled frame)
 - org.jruby.RubyIO.sysopen(org.jruby.Ruby, java.lang.String, int, int) @bci=31, line=1229 (Compiled frame)
 - org.jruby.RubyFile.fileOpenGeneric(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, int, int, org.jruby.util.io.IOEncodable, int) @bci=134, line=1373 (Compiled frame)
 - org.jruby.RubyIO.ioOpen(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject) @bci=177, line=3526 (Compiled frame)
 - org.jruby.RubyIO.openKeyArgs(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.builtin.IRubyObject) @bci=59, line=3489 (Compiled frame)
 - org.jruby.RubyIO.read19(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=180, line=3600 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L4_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=46 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.config.source.local.RUBY$block$read$1(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block, java.lang.String, org.jruby.runtime.Block$Type) @bci=336, line=73 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L8_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=30 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.invokeExact_MT(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=29 (Compiled frame)
 - org.jruby.runtime.CompiledIRBlockBody.yieldDirect(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.builtin.IRubyObject) @bci=34, line=156 (Compiled frame)
 - org.jruby.runtime.BlockBody.yield(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject) @bci=19, line=114 (Compiled frame)
 - org.jruby.runtime.Block.yield(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject) @bci=7, line=165 (Compiled frame)
 - org.jruby.RubyArray.each(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block) @bci=38, line=1734 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeVirtual_L3_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=38 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.config.source.local.RUBY$method$read$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=191, line=63 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=50 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.config.source.local.RUBY$method$read$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=31, line=96 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L7_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=22 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=52 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.config.source.local.RUBY$method$local_pipeline_configs$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=109, line=192 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=50 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.config.source.local.RUBY$method$pipeline_configs$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=83, line=163 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=50 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=99 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.config.source_loader.RUBY$block$fetch$2(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block, java.lang.String, org.jruby.runtime.Block$Type) @bci=57, line=59 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L8_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=30 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.invokeExact_MT(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=29 (Compiled frame)
 - org.jruby.runtime.CompiledIRBlockBody.yieldDirect(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.builtin.IRubyObject) @bci=34, line=156 (Compiled frame)
 - org.jruby.runtime.BlockBody.yield(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject) @bci=19, line=114 (Compiled frame)
 - org.jruby.runtime.Block.yield(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject) @bci=7, line=165 (Compiled frame)
 - org.jruby.RubyArray.collect(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block) @bci=52, line=2472 (Compiled frame)
 - org.jruby.RubyArray.collect19(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block) @bci=10, line=2481 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeVirtual_L3_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=38 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=82 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.config.source_loader.RUBY$method$fetch$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=196, line=58 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=50 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.agent.RUBY$method$converge_state_and_update$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=56, line=148 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=50 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.agent.RUBY$block$execute$1(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block, java.lang.String, org.jruby.runtime.Block$Type) @bci=102, line=105 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L8_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=30 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.invokeExact_MT(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=29 (Compiled frame)
 - org.jruby.runtime.CompiledIRBlockBody.callDirect(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=35, line=145 (Compiled frame)
 - org.jruby.runtime.IRBlockBody.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=13, line=71 (Compiled frame)
 - org.jruby.runtime.Block.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=8, line=124 (Compiled frame)
 - org.jruby.RubyProc.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block) @bci=55, line=289 (Compiled frame)
 - org.jruby.RubyProc.call19(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=24, line=273 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeSpecial_L4_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=52 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.delegate(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.guard(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=78 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.vendor.bundle.jruby.$2_dot_3_dot_0.gems.stud_minus_0_dot_0_dot_23.lib.stud.interval.RUBY$method$interval$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=226, line=18 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L7_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=22 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.invokeExact_MT(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=27 (Compiled frame)
 - org.jruby.internal.runtime.methods.CompiledIRMethod.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.RubyModule, java.lang.String, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=42, line=77 (Compiled frame)
 - org.jruby.internal.runtime.methods.MixedModeIRMethod.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.RubyModule, java.lang.String, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=54, line=93 (Compiled frame)
 - org.jruby.ir.targets.InvokeSite.invoke(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=142, line=145 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeVirtual_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=51 (Interpreted frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.agent.RUBY$method$execute$0(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=205, line=94 (Interpreted frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.agent.RUBY$method$execute$0$__VARARGS__(org.jruby.runtime.ThreadContext, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block, org.jruby.RubyModule, java.lang.String) @bci=27 (Interpreted frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L7_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=22 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.invokeExact_MT(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=27 (Compiled frame)
 - org.jruby.internal.runtime.methods.CompiledIRMethod.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.RubyModule, java.lang.String, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=42, line=77 (Compiled frame)
 - org.jruby.internal.runtime.methods.MixedModeIRMethod.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.RubyModule, java.lang.String, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=54, line=93 (Compiled frame)
 - org.jruby.ir.targets.InvokeSite.invoke(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=142, line=145 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeVirtual_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=43 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=14 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.logstash_minus_core.lib.logstash.runner.RUBY$block$execute$5(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block, java.lang.String, org.jruby.runtime.Block$Type) @bci=56, line=348 (Interpreted frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L8_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=24 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.invokeExact_MT(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=29 (Compiled frame)
 - org.jruby.runtime.CompiledIRBlockBody.callDirect(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=35, line=145 (Compiled frame)
 - org.jruby.runtime.IRBlockBody.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=13, line=71 (Compiled frame)
 - org.jruby.runtime.Block.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=8, line=124 (Compiled frame)
 - org.jruby.RubyProc.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block) @bci=55, line=289 (Compiled frame)
 - org.jruby.RubyProc.call19(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=24, line=273 (Compiled frame)
 - org.jruby.RubyProc$INVOKER$i$0$0$call19.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.RubyModule, java.lang.String, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=9 (Compiled frame)
 - org.jruby.ir.targets.InvokeSite.invoke(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=142, line=145 (Compiled frame)
 - java.lang.invoke.LambdaForm$DMH.invokeVirtual_L6_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=20 (Compiled frame)
 - java.lang.invoke.LambdaForm$BMH.reinvoke(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=37 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.linkToCallSite(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=16 (Compiled frame)
 - data.ELK.logstash_minus_6_dot_2_dot_2.vendor.bundle.jruby.$2_dot_3_dot_0.gems.stud_minus_0_dot_0_dot_23.lib.stud.task.RUBY$block$initialize$1(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.parser.StaticScope, org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block, java.lang.String, org.jruby.runtime.Block$Type) @bci=129, line=24 (Interpreted frame)
 - java.lang.invoke.LambdaForm$DMH.invokeStatic_L8_L(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=24 (Compiled frame)
 - java.lang.invoke.LambdaForm$MH.invokeExact_MT(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object) @bci=29 (Compiled frame)
 - org.jruby.runtime.CompiledIRBlockBody.callDirect(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=35, line=145 (Compiled frame)
 - org.jruby.runtime.IRBlockBody.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.Block, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=13, line=71 (Compiled frame)
 - org.jruby.runtime.Block.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.Block) @bci=8, line=124 (Compiled frame)
 - org.jruby.RubyProc.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[], org.jruby.runtime.builtin.IRubyObject, org.jruby.runtime.Block) @bci=55, line=289 (Compiled frame)
 - org.jruby.RubyProc.call(org.jruby.runtime.ThreadContext, org.jruby.runtime.builtin.IRubyObject[]) @bci=7, line=246 (Interpreted frame)
 - org.jruby.internal.runtime.RubyRunnable.run() @bci=162, line=104 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=748 (Interpreted frame)

What could be possible reason for high CPU usage?
@JulianYuan
Copy link
Author

In this case, the value of "config.reload.interval" is not same between 5.6 and 6.2:

5.6:

config.reload.interval : 3

6.2

config.reload.interval : 3s

so it reload the config files all the time. after the value changed from '3' to '3s', the CPU usage go down

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JulianYuan