Skip to content

Commit

Permalink
Update documentation, add new architecture diagram in both pptx and j…
Browse files Browse the repository at this point in the history
…pg formats to be able to edit it easier going forward
  • Loading branch information
ppine7 committed Sep 16, 2015
1 parent c9d61b8 commit 43ef193
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 8 deletions.
14 changes: 6 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,27 +1,25 @@
# Welcome to the kafka-elasticsearch-standalone-consumer wiki!

## Illustration of kafka-elasticsearch-standalone-consumer usage

### The consumer is positioned in the middle.
## Architecture of the kafka-elasticsearch-standalone-consumer [indexer]

![](https://raw.githubusercontent.com/reachkrishnaraj/kafka-elasticsearch-standalone-consumer/master/img/Kafka_ES_Illustration_New.png)


# Introduction

### **Kafka Standalone Consumer will read the messages from Kafka, processes and index them in ElasticSearch.**
### **Kafka Standalone Consumer will read the messages from Kafka, processes and index them into ElasticSearch.**

### **Easily Scaleable & Extendable !**

### _As described in the illustration above, here is how the StandAlone Consumer works:_
### _As described in the illustration above, here is how the indexer works:_

* Kafka has a topic named, say `Topic_1`
* Kafka has a topic named, say `Topic1`

* Lets say, `Topic_1` has 5 partitions.
* Lets say, `Topic1` has 5 partitions.

* In the configuration file, kafka-es-indexer.properties, set firstPartition=0 and lastPartition=4 properties

* start the standalone indexer application as described below
* start the indexer application as described below

* there will be 5 threads started, one for each consumer from each of the partitions

Expand Down
Binary file added img/IndexerV2Design.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/IndexerV2Design.pptx
Binary file not shown.

0 comments on commit 43ef193

Please sign in to comment.