Apache Kafka - Source
The Apache Kafka Event source enables Knative Eventing integration with Apache Kafka. When a message is produced to Apache Kafka, the Apache Kafka Event Source will consume the produced message and post that message to the corresponding event sink.
Setup Knative Eventing
If not done already, install an Apache Kafka cluster!
- For Kubernetes a simple installation is done using the Strimzi Kafka Operator. Its installation guides provide content for Kubernetes and Openshift.
KafkaSourceis not limited to Apache Kafka installations on Kubernetes. It is also possible to use an off-cluster Apache Kafka installation.
Now that Apache Kafka is installed, apply the
ko apply -f config/
KafkaSourcecustom objects, by configuring the required
topicsvalues on the CR file of your source. Below is an example:
apiVersion: sources.eventing.knative.dev/v1alpha1 kind: KafkaSource metadata: name: kafka-source spec: consumerGroup: knative-group # Broker URL. Replace this with the URLs for your kafka cluster, # which is in the format of my-cluster-kafka-bootstrap.my-kafka-namespace:9092. bootstrapServers: REPLACE_WITH_CLUSTER_URL topics: knative-demo-topic sink: ref: apiVersion: serving.knative.dev/v1alpha1 kind: Service name: event-display
A more detailed example of the
KafkaSource can be found in the