Feature Request - Support for Message Headers

[olib963]

The underlying library has support for kafka message headers: confluentinc/librdkafka#1480.

It would be nice if you could expose the headers to the node library for both consumers and producers. We are looking at using them to store event metadata which we can use to debug issues in the case where our avro messages cannot be deserialised properly.

Thank you.

[webmakersteve]

It is definitely something I want to add. I can't tell when I will have time right now to dedicate to it because of how my time at the office has had to be spent, but it is on my radar.

Hopefully I will have some time soon but will also be very, very happy to take a contribution for this.

[alexander-alvarez]

@webmakersteve what's necessary to make this happen? I could try to take a look at it, but the codebase is pretty foreign to me

[webmakersteve]

Looks like message headers are not supported in C++ yet, and the underlying bindings use the C++ version of librdkafka.

[pcjtse]

It looks like the C++ library has a PR added support for headers 7 days ago:

confluentinc/librdkafka#2109

confluentinc/librdkafka#1959

[Fr8Traindb]

Please! This would be a great feature!

[davidtrihy]

I have this PR open #478 needs a few changes once the librdkafka changes are merged but it should follow it mostly.

[davidtrihy]

Updates to the PR have been made with the new merged changes

[cfinkenstadt]

👍

[iradul]

This is resolved with 6065784

[raman20]

Still not getting headers in message.