System Monitoring: Grafana and Prometheus

Prometheus

1. Download 'prometheus-2.5.0-rc.0.linux-amd64.tar.gz'
2. Extract 'prometheus-2.5.0-rc.0.linux-amd64.tar.gz'
3. Write start script within '*/prometheus-2.5.0-rc.0.linux-amd64' directory.

Sample start script :

./prometheus 2>&1 &

4. Configure prometheus.yml file

# my global config
global:
  scrape_interval:     15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
  evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.
  # scrape_timeout is set to the global default (10s).
 
# Alertmanager configuration
alerting:
  alertmanagers:
  - static_configs:
    - targets:
      # - alertmanager:9093
 
# Load rules once and periodically evaluate them according to the global 'evaluation_interval'.
rule_files:
  # - "first_rules.yml"
  # - "second_rules.yml"
 
# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'
 
    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.
 
    static_configs:
    - targets: ['localhost:9090']
 
  - job_name: 'map_job'
    metrics_path: /prometheus
    scrape_interval: 5s
    #params:
     # module: [http_2xx]  # Look for a HTTP 200 response.
    static_configs:
      - targets: ['localhost:10015']
        labels:
         application : 'map'
 
  - job_name: 'apigw_job'
    metrics_path: /prometheus
    scrape_interval: 5s
    static_configs:
      - targets: ['localhost:20006']
        labels:
         application : 'apigw'
 
 
    ................

5. Open port 9090 for UI
6. Check prometheus UI through http://mfs-ops1:9090/targets

Grafana

1. Download and install grafana-5.3.2-1.x86_64.rpm
2. Open port 3000 for UI
3. Add prometheus as data source.
4. Import attached dashboards.