Python with Kafka

tar -zxvf kafka_2.12-3.1.1/.tar.gz

In Terminal

bin/zookeeper-server-start.sh config/zookeeper.properties

bin/kafka-server-start.sh config/server.properties

bin/kafka-topics.sh —create —topic sales —bootstrap-server localhost:9092 —replication-factor 1 —partitions 4

bin/kafka-topics.sh —list —bootstrap-server localhost:9092

bin/kafka-console-producer.sh —broker-list localhost:9092 —topic sales

bin/kafka-console-consumer.sh —bootstrap-server localhost:9092 —topic sales —from-beginning

Python Code

pip install kafka-python

Producer
from kafka import KafkaProducer
producer = KafkaProducer(bootstrap_servers=‘localhost:9092’)
future = producer.send(‘sales’, b’gowtham,male,phone,100’)

Consumer
from kafka import KafkaConsumer
consumer = KafkaConsumer(‘sales’)
for msg in consumer:
print (msg)