xn2

WIP: Pull, synchronize and package data on interval. Xn2 is a data scraper / muxer, combining data from multiple URLs defined by a set.

See the example configuration used for testing with docker-compose up: simple.yml

Build and test xn2 with docker-compose up. docker-compose starts a fake api server and configures xn2 poll metrics from it. xn2 and all other services are monitored with prometheus.

Demo / Tutorial

Demonstrating Xn2 with docker-compose up will stand up a fairly common data pipeline with three options for visualizing collected data:

• Grafana: UI exposed at: http://localhost:3000
• Kibana: UI exposed at: http://localhost:5601
• Prometheus: Graph UI exposed at: http://localhost:9090/graph

Observe raw metrics collected by Xn2 at: http://localhost:8888/metrics

Development

Run demo from Xn2 source code:

docker-compose up --build

Run source with local config and no destination:

go run ./cmd/xn2.go --port 8282 --config ./config/xn2/local.yml

While running check prometheus metrics at https://localhost:8282/metrics

Release Management

Test release:

goreleaser --skip-publish --rm-dist --skip-validate

Release

GITHUB_TOKEN=$GITHUB_TOKEN goreleaser --rm-dist