soy-log-explorer

Introduction

This project sends the messages got from soy_log_collector to Elasticsearch. The internal process is below.

1. Classifies messages received from soy_log_collector according to hot/cold and pushes them to the corresponding queue.
2. Background daemon pops the message from the queue and unzips it.
3. Send the unzipped message to Elasticsearch using REST API.

Installation

$ git clone https://github.com/soyoslab/soy_log_explorer.git
$ cd soy_log_explorer

Usage

Set enviroment variables:

$ export EXPLORER_HOST = 0.0.0.0      # Server IP Address
$ export EXPLORER_PORT = 8972         # Server Port
$ export ES_HOST = x.x.x.x            # Elasticsearch IP Address
$ export ES_PORT = 9200               # Elasticsearch Port
$ export EXPLORER_RINGSZ = 10000      # Maximum Ring Size

If you did not set the environment variables, soy_log_explorer uses default values.

Default environment variables:

EXPLORER_HOST = 0.0.0.0
EXPLORER_PORT = 8972
ES_HOST = localhost
ES_PORT = 9200

Run soy_log_explorer:

$ go run cmd/explorer/main.go