kafka-plugin Writer failed to start: undefined symbol: rd_kafka_conf_set_log_cb

[eurekaeru]

Hi,

I'm using sfacct to export flows to kafka. I noticed that the latest version of sfacctd didn't work with kafka plugin with this message:
undefined symbol: rd_kafka_conf_set_log_cb
I'm trying to solve this issue.

ENV:

• librdkafka 0.9.1 (built from source http://ports.ubuntu.com/ubuntu-ports/pool/universe/libr/librdkafka/librdkafka_0.9.1.orig.tar.gz)

# sfacctd -V
sFlow Accounting Daemon, sfacctd 1.6.2-git (20170106-00)
 '--enable-rabbitmq' '--enable-kafka' '--enable-jansson'

For suggestions, critics, bugs, contact me: Paolo Lucente <paolo@pmacct.net>.
# cat /etc/sfacctd.conf 
aggregate: src_mac, dst_mac, vlan, cos, etype, src_as, dst_as, peer_src_ip, peer_dst_ip, in_iface, out_iface, src_host, src_net, dst_host, dst_net, src_mask, dst_mask, src_port, dst_port, tcpflags, proto, tos, sampling_rate, timestamp_start, timestamp_end, timestamp_arrival

plugins: kafka
kafka_output: json
kafka_topic: pmacct.test
kafka_refresh_time: 60
kafka_history: 1m
kafka_history_roundoff: m
kafka_broker_host: <IP>
kafka_broker_port: 9092

# sfacctd -f /etc/sfacctd.conf 
INFO ( default/core ): sFlow Accounting Daemon, sfacctd 1.6.2-git (20170106-00)
INFO ( default/core ):  '--enable-rabbitmq' '--enable-kafka' '--enable-jansson'
INFO ( default/core ): Reading configuration file '/etc/sfacctd.conf'.
INFO ( default/core ): waiting for sFlow data on 0.0.0.0:6343
INFO ( default/kafka ): cache entries=16411 base cache memory=44769208 bytes
sfacctd: kafka Plugin -- Writer [default]: symbol lookup error: sfacctd: kafka Plugin -- Writer [default]: undefined symbol: rd_kafka_conf_set_log_cb
sfacctd: kafka Plugin -- Writer [default]: symbol lookup error: sfacctd: kafka Plugin -- Writer [default]: undefined symbol: rd_kafka_conf_set_log_cb
sfacctd: kafka Plugin -- Writer [default]: symbol lookup error: sfacctd: kafka Plugin -- Writer [default]: undefined symbol: rd_kafka_conf_set_log_cb

[paololucente]

Dear Kaname-san,

Can you please try compiling from sources latest librdkafka code from GitHub or 0.9.1 / 0.9.2 release from GitHub? I ask because doing any of this i'm unable to reproduce your issue.

Regards,
Paolo

[eurekaeru]

Dear Paolo-san,

I tried the latest version of librdkafka with the latest pmacct both on Github.
It worked!! Thank you so much.

Thank you for your help. I really appreciate your efforts on this project.