Skip to content
Elastic Beat for fetching events from Kafka
Go Makefile Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
_meta
beater
cmd
config
docs
include
tests/system
vendor
.editorconfig
.gitignore
.travis.yml
CONTRIBUTING.md
Gopkg.lock
Gopkg.toml
LICENSE
Makefile
NOTICE
README.md
fields.yml
kafkabeat.reference.yml
kafkabeat.yml
magefile.go
main.go
main_test.go

README.md

Kafkabeat

Build Status

Kafkabeat is an elastic Beat that reads events from one or more Kafka topics and forwards them to Logstash (or any other configured output).

The Kafka consumer implements an at-least-once behaviour which means that messages may be forwarded to the configured output more than once.

Getting Started with Kafkabeat

Requirements

Building

# Make sure $GOPATH is set
go get github.com/justsocialapps/kafkabeat
cd $GOPATH/src/github.com/justsocialapps/kafkabeat
make

Running

To run Kafkabeat with debugging output enabled, run:

./kafkabeat -c kafkabeat.yml -e -d "*"

Configuring

An example configuration can be found in the file kafkabeat.yml. The following parameters are specific to Kafkabeat:

kafkabeat:
    # a list of Kafka brokers to connect to
    brokers: ["localhost:9092"]
    # A list of topics to subscribe to
    topics: ["tracking"]
    # The consumer group to join
    group: "kafkabeat"

Testing

To test Kafkabeat, run the following command:

make testsuite

alternatively:

make unit-tests
make system-tests
make integration-tests
make coverage-report

The test coverage is reported in the folder ./build/coverage/

You can’t perform that action at this time.