Skip to content

soualid/kafka-archiver-java

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

kafka-archiver-java

Simple backup utility that read the raw content of a Kafka topic using a high level consumer group passed as parameter, stream the output to a daily rotated file, gzip and upload the resulting files to a given S3 bucket.

I use this to backup the content of our queue on S3 to be able to replay it after.

Example usage

java -jar kafka-archiver-java.jar <server> <topicName> <groupId> <workDirectory> <awsAccessKey> <awsSecret> <awsBucket> <awsPath> 

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages