Skip to content

radar-hdfs-restructure version 0.6.0
Compare
Choose a tag to compare
@blootsvoets blootsvoets released this 14 Nov 12:42
v0.6.0
779d34c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Changes since version 0.5.7:

  • A new configuration file has been introduced. This allows for easier and more flexible configuration of the converter.
  • Fixes an issue when using the output generator as a one-time application instead of a service.
  • Converted Java code to Kotlin
  • Refactored package names, including change to org.radarbase
  • Track offsets in a per-topic offsets file in the offsets directory.
  • Added an S3 storage driver.
  • Use per-topic locking, to allow multiple restructure services to run simultaneously.
  • Simplified parallelism.

Upgrade instructions:

  • Write configuration file to match settings used with 0.5.7
  • If needed, move all entries of offsets.csv to their own file in offsets/<topic>.csv. First go to the output directory, then run the bin/migrate-offsets-to-0.6.0.sh script.
Assets 3
Loading