ZMON is Zalando's open-source platform monitoring tool, used in production since early 2014. It supports our many engineering teams in observing their services and metrics on various layers, from low level system metrics to team's business KPIs.
To get familiar with the ideas behind ZMON and how things work, you can take a quick dive in: Intro
Talks / Blog
Take a look at the slides from our talk at the DevOps Ireland meetup for background information on ZMON.
First post about ZMON: Monitoring the platform
- Define checks as data sources executed on self-defined entities
- Define alerts on checks and entities, with thresholds, as it suits your and your teams needs
- Define custom dashboards with widgets and alert filters based on teams and tags
- Check commands and alert conditions are arbitrary Python expressions, giving you a lot of power
- All metric/check data is stored as time series in KairosDB for later use
- Grafana3 is included, enabling you to build rich data driven dashboards
- Powerful REST API to integrate nicely into other tools: e.g. cmdb/deploy tools
- Entity service to store entities of any kind describing your environment
- Trial run in the UI to develop your checks/alerts with quick feedback
- Auto discovery of AWS services using ZMON's aws agent and entity service, great for AWS deployments
- Authentication via OAuth 2 e.g. GitHub
- Frontend incl. Grafana 3 requires full authentication, no need for VPN. incl. onetime tokens for office TV displays
- Command line client for easy automation and interaction with the REST API
- ZMON data service allows you to connect DCs/Regions via HTTP for federated monitoring
- Supports SQL for PostgreSQL incl. sharded deployments, MySQL, Redis, Scalyr, ...
- Supports desktop and mobile notifications via Firebase Cloud Messaging
- More on connectivity here: Check commands
Local demo and single host deployment
We suggest to use docker compose for deploying zmon locally or on a single host:
More here: compose
The docker compose is also the most convient way to setup a development environment.
In cases where docker compose is not an options continue on (or fall back to obsolete vagrant box).
You best head for the documentation now: Component overview
ZMON relies on a few great open source products to run, which you will need to operate.
- Cassandra + KairosDB
This seems to be a lot, but we provide both a Vagrant box and the deployment scripts for our demo host, lowering the bar to get started :)
Frontend / Controller UI and REST API
Scheduler Schedules check/alert execution
Worker Executes check/alert commands and data acquisition
Data service Used for distributed monitoring where sites don't share network connectivity other than the Internet.
Metric cache Fast special purpose cache for REST API metric data for ZMON's REST metrics/cloud UI
Vagrant Box (deprecated)
Install a recent Vagrant version (at least 1.7.4) and simply do:
$ vagrant up
Please note that the provisioning process will take some time (~15min) while it downloads the Docker images.
Login with your own GitHub credentials (OAuth redirect).
You will be able to create/save dashboards.
KairosDB frontend, i.e. for manually query of metrics:
- If single containers do not start up ssh into the vagrant box and run the
start.shscript again manually or use the
start-services.shscript to restart single components. Later one takes parameters like
Install the Command Line Interface
Use PIP to install the
zmon executable from PyPI.
$ pip3 install --upgrade zmon-cli
Use the ZMON CLI to push/create/update entities (hosts, databases, etc.), check definitions and create optional alerts (also possible via UI).
$ zmon entities push examples/entities/local-postgresql.yaml $ zmon entities push examples/entities/local-scheduler-instance.json
Push your first check definition:
$ zmon check-definitions update examples/check-definitions/zmon-scheduler-rates.yaml
Modify the alert definition to point to the right check id before doing:
$ zmon alert-definitions update examples/alert-definitions/scheduler-rate-too-low.yaml
If you want to compile everything from source, you can do so with our separate "build-env" Vagrant box:
$ cd build-env $ vagrant up
Docker images/scripts used in slightly modified versions are:
- official Redis and PostgreSQL
Thanks to the original authors!
Copyright 2013-2016 Zalando SE
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.