Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Latest commit e65ba87 Oct 24, 2017
Type Name Latest commit message Commit time
Failed to load latest commit information.
src/main use links rather than host mode Oct 17, 2017
.gitignore Initial commit Oct 17, 2017
Makefile fix urls in makefile Oct 24, 2017 add new Make targets Oct 17, 2017
docker-compose.yaml remove comment Oct 17, 2017
pom.xml Initial commit Oct 17, 2017

Investigating using Apache Beam with Apache Kafka

  • Start Kafka and Zookeeper
    • make up
  • Create the Kafka topic
    • make topic
  • Ensure it has been created
    • make describe
  • Use Beam to write to topic
    • make producer
  • Check messages in topic
    • make offset
  • Dump messages from topic
    • make dump
  • Consume messages and run wordcount with Beam
    • make consumer
  • Check output
    • cat wordcount*
  • Stop Kafka and Zookeeper
    • make down
  • Clean up
    • make clean
You can’t perform that action at this time.