problem with in_tail of fluentd 0.10.12

[k24d]

I noticed that the "in_tail" plugin shipped with fluentd-0.10.12 consumes 100% CPU time on my box.

OS: Ubuntu 10.04 / RHEL 6
Ruby: 1.9.2p290 (2011-07-09 revision 32553) [x86_64-linux]
fluentd: "gem install --version 0.10.12 fluentd"

It seems the 'io' object passed to IOHandler is always readable, and 'on_readable' is called repeatedly.

Sorry that I have no idea how to fix it.

[k24d]

Here is my fluent.conf:

<source>
  type tail
  path /var/log/apache2/ssl_access.log
  format apache
  tag apache2.ssl_access
</source>

<match **>
  type stdout
</match>

Run fluentd like this:

# /opt/ruby/bin/fluentd 

I got this:

# dstat
----total-cpu-usage---- -dsk/total- -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read  writ| recv  send|  in   out | int   csw 
  1   0  99   0   0   0| 289B 1364B|   0     0 |   2B   11B|  69   145 
 74  26   0   0   0   0|   0     0 |  66B  850B|   0     0 | 253   421 
 82  18   0   0   0   0|   0     0 |  66B  354B|   0     0 | 267   464 
 71  29   0   0   0   0|   0     0 |  66B  354B|   0     0 | 260   438 

[frsyuki]

Thank you for your detailed report. I'll check the problem.

[frsyuki]

The problem is reproduced on my environment.
Unfortunately, it's hard to resolve and may take time to fix. For now, please downgrade the version of fluentd to 0.10.10 which is a stable version:

$ gem uninstall fluentd
$ gem install fluentd -v 0.10.10

I'll fix this problem at the next version.

[frsyuki]

I released v0.10.13 that fixed this problem.
Please check it out!