Add Kafka for Pub-Sub

[yaron2]

No description provided.

[robertojrojas]

@yaron2 I'm going to work on this issue and I was planning to use the Sarama package.

[yaron2]

Thats great, thanks!

[yaron2]

@robertojrojas are you actively working on this?

[robertojrojas]

@yaron2 yes, I'm hoping to PR in the next day or so.

[yaron2]

That's great. No worries, just checking :)

[robertojrojas]

@yaron2 Any suggestions on how to integration test the pubsub component?

[yaron2]

Add the following line at the bottom of go.mod in the dapr repo:
replace github.com/dapr/components-contrib => ../components-contrib

This assumes your modified components-contrib code resides in the same directory that has the dapr repo in it.

Open a terminal in the dapr repo and run go mod vendor.

This should pull all the dependencies including components-contrib from your local copy into dapr.

Then, update the loader in the Dapr runtime under /pkg/components/pubsub/loader.go:

import "github.com/dapr/components-contrib/pubsub/kafka"

RegisterMessageBus("kafka", kafka.NewKafka)

You can then build the daprd binary locally, copy it to your PATH and test it with the pub-sub sample

[robertojrojas]

@yaron2 Thanks for the instructions.

[rohits-dev]

quite interested in having a look at kafka pub sub, just wanted to know would it support Schema registry for AVRO schema?

[mihaimyh]

Is AVRO schema registry supported?

[mukundansundar]

Is AVRO schema registry supported?

@mihaimyh please create a separate issue for this question.