No description, website, or topics provided.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
camus-sweeper
.gitignore
README.md
pom.xml

README.md

#What?

Adopted the Camus Sweeper Project (code) to tackle the Small File Issue together with Camus (code)

Camus Sweeper aggregates the hourly Avro files to daily Avro files

Camus Sweeper needs Avro-Schema files. Since I don't have a Schema Registry I added a configuration parameter for that:

# define the topic to schema class mappings here
# f.e. for topic eu_fakod_app_search_term you should configure:
eu_fakod_app_search_term.camus.sweeper.avro.schema.class=eu.fakod.app.search.term.SchemaClass

#Little more Information