No description, website, or topics provided.
Java Python Shell
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
src
.gitignore
README.md
pom.xml

README.md

storm-demo-fosscomm-2016

This project is the demo code of our presentation at FOSSCOMM (2016) conference.

Presentation: Slides

FOSSCOMM Event: Big Data Streaming processing using Apache Storm‏

Maintainers

Requirements

  • Zookeeper (3.4.5+)
  • Kafka (0.8.2.2 or 0.9.x) (for 0.9 need to remove exclusion from pom.xml)
  • Storm (1.0)

Start all the above:

  • bin/zookeeper-server-start.sh config/zookeeper.properties
  • bin/kafka-server-start.sh config/server.properties
  • Start Storm

Create Kafka Topics

  • bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 2 --topic myKafkaTopic
  • bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 2 --topic myKafkaTopicOut

Check Topics

  • bin/kafka-topics.sh --list --zookeeper localhost:2181

Run Topology

Local:

  • storm jar target/StormKafkaDemo-0.1.jar org.apache.storm.flux.Flux --local src/test/resources/topology.yaml

Remote:

  • storm jar target/StormKafkaDemo-0.1.jar org.apache.storm.flux.Flux --remote src/test/resources/topology_cluster.yaml

Check result

  • bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic myKafkaTopicOut --from-beginning