Redis sink should support event variants based on the encoding type instead of only logs

[nionata]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Use Cases

The redis sink could be leveraged to create a lightweight cache of metric values. All the existing redis tooling and libraries would come with this cache scheme as long as the encoding is standard.

sources:
  statsd:
    type: "statsd"
    address: "127.0.0.1:1337"
    mode: "udp"

sinks:
  redis:
    type: "redis"
    inputs:
      - statsd
    encoding:
      codec: "native_json"
    endpoint: "127.0.0.1:1338"
    key: ".name"

Attempted Solutions

An error will be logged on vector boot if you have configured the redis sink to consume from a metrics source.

ERROR vector::cli: Configuration error. error=Data type mismatch between statsd (["Metric"]) and redis (["Log"])

The redis sink config only allows for log data types today.

Proposal

The sink should work for event variants based on the sink's encoding type. The encoding framework provides for this with the input_type method. That method is even being called in the redis config. It is being overridden to only support logs. This same issue existed for the file sink and was resolved with the aforementioned proposal.

References

No response

Version

No response

[pront]

Hi @nionata, this sounds like a reasonable enhancement. Happy to review a PR.

[ynachi]

Hello @pront, I would like to take this issue. Please assign it to me to avoid work duplicate from others. I will unassign myself if time do not allow me to progress. Thanks.

[pront]

Hello @pront, I would like to take this issue. Please assign it to me to avoid work duplicate from others. I will unassign myself if time do not allow me to progress. Thanks.

You got it @ynachi, thank you for your interest in Vector!