Demo of how to ship logs from CloudWatch Logs to a Kinesis stream, and then ship them to Logz.io
A group of Lambda functions for:
- shipping logs from Kinesis stream to Logz.io (hosted ELK stack)
- auto-subscribe new log groups to the configured Kinesis stream so you don't have to subscribe them manually
- auto-updates the retention policy of new log groups to 7 days (configurable)
- insert the
serverless.ymlfile (under the
ship-logs-to-logziofunction's environment variables).
token: your Logz.io account token. Can be retrieved on the Settings page in the Logz.io UI.
logstash_host: if you are in the EU region insert
listener-eu.logz.io, otherwise, use
listener.logz.io. You can tell which region you are in by checking your login URL - app.logz.io means you are in the US. app-eu.logz.io means you are in the EU.
logstash_port: this should be 5050, but is subject to change. See this page for details.
ship-logs-to-logzio: handler: functions/ship-logs/handler.handler description: Sends CloudWatch logs from Kinesis to Logz.io environment: logstash_host: listener.logz.io logstash_port: 5050 token: CduNgGwuFFeUVzbXvqVDXoGkjxEdKzc9
./build.sh deploy devto deploy to a stage called "dev"
Updating existing log groups
fill in the missing configuration values