Skip to content

Utility service for scheduled cleaning the local disk from ingested batch files and permanently delete data from druid cluster for retention segments

License

Notifications You must be signed in to change notification settings

igormelz/druid-cleanup

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

druid-cleanup

Utility service for scheduled cleaning the local disk from ingested batch files and permanently delete data from druid cluster for retention segments.

Prerequisites

  • JDK 1.8+
  • Maven 3.5.3+
  • Druid metadata storage on PostgreSQL

Build

# git clone 
# mvn clean install

Install

# java -jar target/*-running.jar

Deployment

  • Must running on the same host that running indexing task.
  • Use options in application.properties to configure druid datastore connection, path to indexing-log and set period to run cleanup task.

Built With

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details

About

Utility service for scheduled cleaning the local disk from ingested batch files and permanently delete data from druid cluster for retention segments

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages