An application for reading data off kafka topics, batching it up and sending it to Presto in a SQL insert query for long-term storage based on data retrieved from a schema registry.
To run the tests
mix testto run the tests a single time
mix test.watchto re-run the tests when a file changes
mix test.watch --staleto only rerun the tests for modules that have changes
mix test.integrationto run the integration tests
To run inside a container(from the root directory):
docker build . -t <image_name:tag>
You can use Divo to stand up the external dependencies locally using docker and docker-compose.
MIX_ENV=integration mix docker.start MIX_ENV=integration iex -S mix
Released under Apache 2 license.