SinksKinesis

The kinesis sink accepts only Raw events, buffering them internally, and publishing them in batch to the configured stream. Events which violate defined AWS limits are discarded.

Under anticipated operating conditions, this sink guarantees at least once delivery.

Configuration

The following configuration options are available for kinesis sinks:

• stream_name - Stream to post events to. Required.
• region - The AWS region stream exists in. Optional, by default this is inferred from your environment.
• flush_interval - Frequency (in seconds) the local buffer is flushed. Optional, default = 1.

Example

[sinks]
  [sinks.kinesis.mystream]
  stream_name = "mystream"

Note - It is up to the user to ensure that the operating environment has the proper permissions to post to the given stream.

Internal Telemetry

• cernan.sinks.kinesis.publish.success - Number of events successfully published.
• cernan.sinks.kinesis.publish.failure - Number of events which failed to be published and will be retried.
• cernan.sinks.kinesis.publish.discard - Number of events discarded due to AWS limitations.
• cernan.sinks.kinesis.publish.fatal - Number of fatal errors encountered by the kinesis sink.