Kafka Topic Analyzer
A CLI tool that gathers statistics about a Apache Kafka topic by reading it from beginning to end and counting various metrics.
$> ./kafka-topic-analyzer -h Kafka Topic Analyzer USAGE: kafka-topic-analyzer [FLAGS] --bootstrap-server <BOOTSTRAP_SERVER> --topic <TOPIC> FLAGS: -c, --count-alive-keys Counts the effective number of alive keys in a log compacted topic by saving the state for each key in a local file and counting the result at the end of the read operation.A key is 'alive' when it is present and has a non-null value in it's latest-offset version -h, --help Prints help information -V, --version Prints version information OPTIONS: -b, --bootstrap-server <BOOTSTRAP_SERVER> Bootstrap server(s) to work with, comma separated -t, --topic <TOPIC> The topic to analyze
By now, the only way of installing it is building it from source or
cargo install kafka-topic-analyzer. In both cases you need to
have the rust toolchain installed via http://rustup.rs/.
When installed from source, the binary can build librdkafka as part of the dependency resolution process. Please see the rdkafka-rust dependency documentation for the detailed requirements.
rdkafka-rust dependency exports a feature flag, which enables
dynamic linking of the librdkafa dependency.
You can compile this project with
cargo build --features "dynamic_linking"
in order to use the shared library instead of building it with the dependencies.