Skip to content

Releases: ricardoarchive/kafka-topic-cloner

Skip control messages

24 Aug 13:27
85dc7ef
Compare
Choose a tag to compare
Skip control messages Pre-release
Pre-release
  • Don't block when consuming control-messages-only event batches
    This allows to clone exactly-once topic, but the target looses the contorl messages.

Compression codecs

20 Jul 13:52
2ad950b
Compare
Choose a tag to compare
Compression codecs Pre-release
Pre-release
  • Corrected a bug that prevented cloning large batches of small-sized messages
  • Implemented compression codecs (you can choose between the 4 standard values: none, gzip, snappy, lz4)
  • Changed the hasher's shorthand (now 'p')

Cross-cluster cloning

12 Jun 12:29
b05a21a
Compare
Choose a tag to compare
Cross-cluster cloning Pre-release
Pre-release
  • Implemented cross-cluster cloning
  • Changed some parameter names / shorthands
  • Added some verifications before actually cloning
  • Various bugfixes

High-volume producer

30 May 13:25
Compare
Choose a tag to compare
High-volume producer Pre-release
Pre-release

This version contains a debugged producer (which was not supporting high-volume topics before).
The vendor folder has been removed from github.
The code is cleaner, some comments appeared and the README is finally up-to-date!
Also, we added a fancy .exe binary for windows users.

Async producer

14 May 13:14
b155e1a
Compare
Choose a tag to compare
Async producer Pre-release
Pre-release

The producing is now executed by batches, thanks to an async producer.
This greatly increases the cloning performances.

Code refactoring

12 May 10:36
2b82439
Compare
Choose a tag to compare
Code refactoring Pre-release
Pre-release
  • The code is now prettier :)
  • Added a timeout parameter to let the user choose the value (default 10s)
  • Added a default-hasher parameter to disable the use of the murmur2 hasher (still recommended)
  • Added some verbose logs

Timeout

11 May 16:14
1ff48b0
Compare
Choose a tag to compare
Timeout Pre-release
Pre-release

The cloning loop now timeouts after 10 seconds without cloning any new event.

Murmur hasher

09 May 09:24
1ff48b0
Compare
Choose a tag to compare
Murmur hasher Pre-release
Pre-release

Added murmur-based partitioning and a verbose mode

First release

03 May 15:40
1ff48b0
Compare
Choose a tag to compare
First release Pre-release
Pre-release
Merge pull request #10 from ricardo-ch/timeout

Added timeout after 10 seconds