Skip to content

Opni Opensearch Updating Service

Amartya Chakraborty edited this page Jan 25, 2023 · 6 revisions

Description

This service updates Opensearch with inferred logs and log templates.

Programming Languages

  • Python

Diagram

Opni Opensearch Updating Service

Responsibilities

  • Updates Opensearch index "logs" with insights for each log message with anomaly level and log template matched.
  • Updates Opensearch index "templates" with information such as the log template and example of a log message that matches that template.

Input and output interfaces

Input

Component Type Description
inferenced_logs Nats subject The Opensearch Updating service receives the updated logs with their respective anomaly levels through the inferenced_logs Nats subject.
templates_index Nats subject The Opensearch Updating service receives the updated templates in addition to the most commonly occurring log message for each template through the templates_index Nats subject.

Output

Component Type Description
logs Opensearch index The logs index is updated for each log message based on the anomaly level and template matched.
templates Opensearch index The templates index is updated for each log template and the most commonly occurring log message for that template.

Performance issues

  • Sometimes fail to update documents.

Test plan

  • Unit tests
  • Integration tests
  • e2e tests
  • Manual testing
Clone this wiki locally