integrate fluentd with nats streaming

[Mostafakhedri]

Hi, I tried to integrate my pub/sub fluentd with nats streaming. I used these output and input fluentd plugins for nats streaming. Everything works and no problem. But consuming data from nats streaming and push them to elasticsearch is very very slow. I'm almost sure that in/out msgs/s in channel is equal. Everything that publish to nats channel, all of them in the other side consumed. I found this from compare of two metrics as bellow. I think publishing data in nats channel has a problem and very slow.

My input and output configuration as bellow too:

output:

@type nats-streaming
server "x.x.x.x:4222"
client_id "out-#{Socket.gethostname}-#{worker_id}"
cluster_id nat-streaming

<format>
  @type json
</format>

input:
@type nats-streaming
server "x.x.x.x:4222"
cluster_id nat-streaming
channel xxxx
client_id "in-#{Socket.gethostname}-#{worker_id}"
queue fluentd2
durable_name xxxx
start_at new_only
max_consume_interval 300

I'll very happy to know your answer.