Kafka Design Document

[openBackhaul]

Problem:
Documentation about the technical aspects of our appliance of Kafka is needed.

Potential subjects (but not limited to):

• System Architecture Overview
• Producer and Consumer Integration (relation with API GW)
• Access Control and Authentication Mechanisms
• Broker Configuration
• Topic structure concept (if any)
• Monitoring, Logging, and Alerting
• Backup and Disaster Recovery
• Update procedures without payload loss

Status:

• Write document in ApplicationPattern repository
• Invite for discussing the document
• Propose changes to the document (all)
• Finalize document

[IswaryaaS]

Created a detailed document for Kafka and included under https://github.com/openBackhaul/ApplicationPattern/blob/KafkaDocMwdSDN%237/doc/SharedComponents/Kafka/kafka1.md.

It is currently present in a feature branch KafkaDocMwdSDN#7. After getting review comments for further changes and improvements, will raise a Pull request targeting develop branch

[openBackhaul]

A well elaborated first version of the design document has been presented on Friday, 9th of January.
During the discussion, it became clear that we need to connect out-of-domain tools via a company-wide Kafka installation.
Apart from considering the company-wide Kafka installation for connecting out-of-domain tools in the design document, it has to be checked whether the existing Kafka extension to the ApplicationPattern is able to manage this connection, too.