Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fluentd does not restart children if they die #13

Open
dmnfortytwo opened this issue Apr 9, 2018 · 0 comments
Open

fluentd does not restart children if they die #13

dmnfortytwo opened this issue Apr 9, 2018 · 0 comments

Comments

@dmnfortytwo
Copy link

2018-04-06 13:13:00 +0000 [warn]: #0 failed to write data into buffer by buffer overflow action=:throw_exception
2018-04-06 13:13:00 +0000 [warn]: #0 emit transaction failed: error_class=Fluent::Plugin::Buffer::BufferOverflowError error="can't create buffer metadata for /var/lib/td-agent/buffers/output_elasticsearch-7/buff$
r.*.log. Stop creating buffer files: error = Too many open files @ rb_sysopen - /var/lib/td-agent/buffers/output_elasticsearch-7/buffer.b5692dd0baff981007f92e2649ebfdbc3.log.meta" location="/opt/td-agent/embedde$
/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:294:in `rescue in create_new_chunk'" tag="fluent.info"
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:294:in `rescue in create_new_chunk'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:283:in `create_new_chunk'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:50:in `initialize'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buf_file.rb:163:in `new'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buf_file.rb:163:in `generate_chunk'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer.rb:530:in `block in write_once'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/2.4.0/monitor.rb:214:in `mon_synchronize'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer.rb:530:in `write_once'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer.rb:277:in `block in write'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer.rb:275:in `each'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer.rb:275:in `write'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:967:in `block in handle_stream_simple'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:851:in `write_guard'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:966:in `handle_stream_simple'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:841:in `execute_chunking'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:771:in `emit_buffered'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/out_copy.rb:58:in `block in process'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/out_copy.rb:56:in `each'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/out_copy.rb:56:in `each_with_index'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/out_copy.rb:56:in `process'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/multi_output.rb:148:in `emit_sync'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/event_router.rb:159:in `emit_events'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/event_router.rb:96:in `emit_stream'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/event_router.rb:87:in `emit'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/engine.rb:207:in `block in log_event_loop'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/engine.rb:205:in `each'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/engine.rb:205:in `log_event_loop'
2018-04-06 13:13:00 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.info" event={"worker"=>0, "message"=>"fluentd worker is now running worker=0"} error_class=Fluent::Plugin::Buffer::BufferOverf$
owError error="can't create buffer metadata for /var/lib/td-agent/buffers/output_elasticsearch-7/buffer.*.log. Stop creating buffer files: error = Too many open files @ rb_sysopen - /var/lib/td-agent/buffers/out$
ut_elasticsearch-7/buffer.b5692dd0baff981007f92e2649ebfdbc3.log.meta"
2018-04-06 13:13:00 +0000 [warn]: #0 failed to flush the buffer. retry_time=0 next_retry_seconds=2018-04-06 13:13:10 +0000 chunk="5691a86c7266329a125a8f2f4a31216d" error_class=NoMethodError error="undefined meth$
d `downcase' for #<Array:0x00007f53f1562a10>"
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-elasticsearch-2.4.0/lib/fluent/plugin/out_elasticsearch.rb:379:in `block in write'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/event.rb:323:in `each'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/event.rb:323:in `block in each'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:170:in `open'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/event.rb:322:in `each'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-elasticsearch-2.4.0/lib/fluent/plugin/out_elasticsearch.rb:340:in `write'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:1093:in `try_flush'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:1318:in `flush_thread_run'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/output.rb:439:in `block (2 levels) in start'
  2018-04-06 13:13:00 +0000 [warn]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/thread.rb:78:in `block in thread_create'
2018-04-06 13:13:01 +0000 [warn]: #0 failed to write data into buffer by buffer overflow action=:throw_exception
2018-04-06 13:13:01 +0000 [warn]: #0 emit transaction failed: error_class=Fluent::Plugin::Buffer::BufferOverflowError error="can't create buffer metadata for /var/lib/td-agent/buffers/output_elasticsearch-7/buffe
r.*.log. Stop creating buffer files: error = Too many open files @ rb_sysopen - /var/lib/td-agent/buffers/output_elasticsearch-7/buffer.b5692dd0c882c3b11f2a767066ba06050.log.meta" location="/opt/td-agent/embedded
/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/buffer/file_chunk.rb:294:in `rescue in create_new_chunk'" tag="fluent.warn"
  2018-04-06 13:13:01 +0000 [warn]: #0 suppressed same stacktrace
2018-04-06 13:13:01 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"retry_time"=>0, "next_retry_seconds"=>"2018-04-06 13:13:10 +0000", "chunk"=>"5691a86c7266329a125a8f2f4a31216d", "
error"=>"#<NoMethodError: undefined method `downcase' for #<Array:0x00007f53f1562a10>>", "message"=>"failed to flush the buffer. retry_time=0 next_retry_seconds=2018-04-06 13:13:10 +0000 chunk=\"5691a86c7266329a1
25a8f2f4a31216d\" error_class=NoMethodError error=\"undefined method `downcase' for #<Array:0x00007f53f1562a10>\""} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="can't create buffer metadata for 
/var/lib/td-agent/buffers/output_elasticsearch-7/buffer.*.log. Stop creating buffer files: error = Too many open files @ rb_sysopen - /var/lib/td-agent/buffers/output_elasticsearch-7/buffer.b5692dd0c882c3b11f2a76
7066ba06050.log.meta"
2018-04-06 13:13:01 +0000 [warn]: #0 thread exited by unexpected error plugin=Fluent::Plugin::ForwardInput title=:event_loop error_class=LoadError error="library not found for class Digest::SHA512 -- digest/sha2.
so"
2018-04-06 13:13:01 +0000 [error]: #0 unexpected error error_class=LoadError error="library not found for class Digest::SHA512 -- digest/sha2.so"
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/2.4.0/digest.rb:16:in `const_missing'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/in_forward.rb:422:in `check_ping'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/in_forward.rb:200:in `block in handle_connection'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/in_forward.rb:248:in `block (3 levels) in read_messages'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/in_forward.rb:247:in `feed_each'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/in_forward.rb:247:in `block (2 levels) in read_messages'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin/in_forward.rb:256:in `block in read_messages'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/server.rb:739:in `on_read_without_connection'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/cool.io-1.5.3/lib/cool.io/io.rb:123:in `on_readable'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/server.rb:711:in `on_readable'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/cool.io-1.5.3/lib/cool.io/io.rb:186:in `on_readable'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/cool.io-1.5.3/lib/cool.io/loop.rb:88:in `run_once'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/cool.io-1.5.3/lib/cool.io/loop.rb:88:in `run'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/event_loop.rb:84:in `block in start'
  2018-04-06 13:13:01 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/plugin_helper/thread.rb:78:in `block in thread_create'
2018-04-06 13:13:01 +0000 [error]: #0 library not found for class Digest::SHA512 -- digest/sha2.so path=nil error_class=LoadError error="library not found for class Digest::SHA512 -- digest/sha2.so"
  2018-04-06 13:13:01 +0000 [error]: #0 suppressed same stacktrace
2018-04-06 13:13:01 +0000 [info]: Worker 0 finished unexpectedly with status 2
2018-04-06 13:13:01 +0000 [info]: Received graceful stop

Other children are working, this is still a zombie. (Actually, there are two more zombies)

root@harvester-gce-eu-1:/var/log/td-agent# ps auxww | fgrep td-agent
root      1406  0.0  0.0   6536   728 pts/0    S+   09:26   0:00 fgrep --color=auto td-agent
td-agent  2470  0.0  0.0 130136 33972 ?        Sl   Apr05   1:27 /opt/td-agent/embedded/bin/ruby /usr/sbin/td-agent --log /var/log/td-agent/td-agent.log --daemon /var/run/td-agent/td-agent.pid
td-agent  2476  0.0  0.0 132184 35540 ?        Sl   Apr05   1:26 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /usr/sbin/td-agent --log /var/log/td-agent/td-agent.log --daemon /var/run/td-agent/td-agent.pid --under-supervisor
td-agent  2517  0.0  0.0 138848 41836 ?        Sl   Apr05   1:28 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_12.conf --log /var/log/td-agent/child_12.log
td-agent  2521 15.1  0.1 1652472 120748 ?      Sl   Apr05 852:08 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_12.conf --log /var/log/td-agent/child_12.log --under-supervisor
td-agent  2523  0.0  0.0 140896 42676 ?        Sl   Apr05   1:33 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_11.conf --log /var/log/td-agent/child_11.log
td-agent  2531 15.3  0.4 1734392 258952 ?      Sl   Apr05 860:07 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_11.conf --log /var/log/td-agent/child_11.log --under-supervisor
td-agent  2533  0.0  0.0      0     0 ?        Z    Apr05   0:25 [ruby] <defunct>
td-agent  2549  0.0  0.0      0     0 ?        Z    Apr05   0:28 [ruby] <defunct>
td-agent  2559  0.0  0.0 138848 41808 ?        Sl   Apr05   1:30 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_8.conf --log /var/log/td-agent/child_8.log
td-agent  2566 15.4  0.3 1687288 190764 ?      Sl   Apr05 865:19 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_8.conf --log /var/log/td-agent/child_8.log --under-supervisor
td-agent  2570  0.0  0.0      0     0 ?        Z    Apr05   0:25 [ruby] <defunct>
td-agent  2582  0.0  0.0 140896 36216 ?        Sl   Apr05   1:32 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_6.conf --log /var/log/td-agent/child_6.log
td-agent  2590 15.5  0.3 2739960 226796 ?      Sl   Apr05 873:34 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_6.conf --log /var/log/td-agent/child_6.log --under-supervisor
td-agent  2592  0.0  0.0 138848 35712 ?        Sl   Apr05   1:32 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_5.conf --log /var/log/td-agent/child_5.log
td-agent  2600 15.8  0.2 8972024 127700 ?      Sl   Apr05 888:41 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_5.conf --log /var/log/td-agent/child_5.log --under-supervisor
td-agent  2602  0.0  0.0 138848 32352 ?        Sl   Apr05   1:38 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_4.conf --log /var/log/td-agent/child_4.log
td-agent  2625 15.5  0.2 1699576 166152 ?      Sl   Apr05 876:07 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_4.conf --log /var/log/td-agent/child_4.log --under-supervisor
td-agent  2627  0.0  0.0      0     0 ?        Z    Apr05   0:24 [ruby] <defunct>
td-agent  2653  0.0  0.0 138848 29928 ?        Sl   Apr05   1:38 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_2.conf --log /var/log/td-agent/child_2.log
td-agent  2660 15.5  0.4 5836536 278052 ?      Sl   Apr05 875:39 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_2.conf --log /var/log/td-agent/child_2.log --under-supervisor
td-agent  2664  0.0  0.0 138848 29908 ?        Sl   Apr05   1:39 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_1.conf --log /var/log/td-agent/child_1.log
td-agent  2672 15.6  0.4 3825400 260256 ?      Sl   Apr05 877:34 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_1.conf --log /var/log/td-agent/child_1.log --under-supervisor
td-agent  2680  0.0  0.0 146020 32984 ?        Sl   Apr05   1:40 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_0.conf --log /var/log/td-agent/child_0.log
td-agent  2687  0.5  0.1 280240 74048 ?        Sl   Apr05  32:54 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb -c /etc/td-agent/child_0.conf --log /var/log/td-agent/child_0.log --under-supervisor

My master config:

<source>
  @type multiprocess
  <process>
    cmdline -c /etc/td-agent/child_0.conf --log /var/log/td-agent/child_0.log
    sleep_before_start 1s
    sleep_before_shutdown 5s
  </process>
  <process>
    cmdline -c /etc/td-agent/child_1.conf --log /var/log/td-agent/child_1.log
    sleep_before_start 1s
    sleep_before_shutdown 5s
  </process>
...
  <process>
    cmdline -c /etc/td-agent/child_12.conf --log /var/log/td-agent/child_12.log
    sleep_before_start 1s
    sleep_before_shutdown 5s
  </process>
</source>

My versions:

2018-03-28 19:46:33 +0000 [info]: starting fluentd-1.0.2 pid=22210 ruby="2.4.2"
2018-03-28 19:46:33 +0000 [info]: spawn command to main:  cmdline=["/opt/td-agent/embedded/bin/ruby", "-Eascii-8bit:ascii-8bit", "/opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.0.2/lib/fluent/command/fluentd.rb", "-c", "/etc/td-agent/child_7.conf", "--log", "/var/log/td-agent/child_7.log", "--under-supervisor"]
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '2.4.0'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-flowcounter' version '1.3.0'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-kafka' version '0.6.5'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-multiprocess' version '0.2.2'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-prometheus' version '1.0.1'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.0.1'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-s3' version '1.1.0'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-td' version '1.0.0'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-td-monitoring' version '0.2.3'
2018-03-28 19:46:34 +0000 [info]: gem 'fluent-plugin-webhdfs' version '1.2.2'
2018-03-28 19:46:34 +0000 [info]: gem 'fluentd' version '1.0.2'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant