Stream: add health check endpoint

[chuwy]

Migrated from snowplow/snowplow#1912

[ianlofs]

Hello! Any news on when something like this would be available?

[benjben]

Hi @ianlofs , this is not on our roadmap yet to add this health endpoint in enrich.

However, we're going to release this month a new asset enrich-kinesis that aims at replacing Stream Enrich Kinesis. This asset will be able to export metrics about the number of events it enriches, either by logging them or/end by sending them to a StatsD server, with a configurable interval, thus making it possible to assert that enrich is working. The announce will be made on discourse.

[ianlofs]

That's great @benjben! That definitely helps for my use case.

[sarahhenkens]

Hey @benjben, do you have any update on this feature request? Currently, there is no easy way to deploy the enricher on Kubernetes reliable due to a missing health check mechanism.

[benjben]

Hi @sarahhenkens ,

We've stopped adding features to Stream Enrich, as we plan to deprecate it, in favor of enrich-kinesis.

The latter doesn't have /health endpoint, but it's able to send metrics, either to a StatsD server, or in the container logs directly. Instructions to configure them can be found in our docs.

You might be able to use them for health check mechanism?