Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. This sample project explain the simple producer and consumer options avilabel from Spring boot Kafka module.
- Uses Springboot Kafka Client 2.7.0
- Apache Kafka 2.13 - 2.8.0
- Apache zookeeper 3.7.0
- Windows 10
- Single Gradle project which contains producer and consumer
- Uses Intellij IDEA community Edition
- Uses OpenJDK 11, apache zookeeper 3.7.0 and Kafka 2.13 - 2.8.0
Kafka producer and consumer uses a number of open source projects to work properly:
- OpenJDK - Open JDK
- Apache Kafka - open-source distributed event streaming platform
- IntelliJ IDEA Community - free community IDEA
- zookeeper - install zookeeper on windows
- [Gradle] - IntelliJ IDEA default Gradle plugin
- [windows] - uses windows Operating system
Kafka sample requires Prebuilt OpenJDK v11+ to run.
Download and Install the Zookeer and extract the tar file.
cd C:\software\apache-zookeeper-3.7.0\conf
copy zoo_sample.cfg zoo.cfg
open the zoo.cfg => update the following
dataDir=C:/software/apache-zookeeper-3.7.0/datastart the zookeeper
C:\software\apache-zookeeper-3.7.0\bin>zkServer.cmdDownload and Install the Apache Kafka 2.8.0 and extract the tar file.
cd C:\software\kafka_2.13-2.8.0\config
open the server.properties => update the following
log.dirs=C:/software/kafka_2.13-2.8.0/logsstart the Apache Kafka
cd C:\software\kafka_2.13-2.8.0
.\bin\windows\kafka-server-start.bat .\config\server.propertiesFor running the consumer:
cd consumer
./gradle bootRunFor running the producer:
cd producer
./gradle bootRunNote: We uses Windows 10 operating system single node setup.
MIT