Changelog

27376d2 added goreleaser
a2991e9 added feature #56
9baaac4 fix bug #54
55c83fe hmc import fix #52
ffebf53 improved solution #50
7243b29 nmon file delimiter auto detection #50
302f630 fixed NaN values #51
7b1c04c fixed new ssh host key check

Automated with GoReleaser
Built with go version go1.8.1 linux/amd64

Added ssl support for influxdb database

Fixing bug #48.

Two new parameters are available in the configuration file:

influxdb_secure=true
influxdb_skip_cert_check=true

influxdb_skip_cert_check should be used only if you created a self-signed certificate.

Dashboards available on grafana.com

Multiple ready-to-use dashboards are available on grafana.com

The following dashboards are available:

• AIX NMON report
• AIX NMON Individual disks
• Power Systems HMC partition view
• Power Systems HMC system view

Since switching to influxdb client v2 API, import had a huge performance degradation.
It's recommended to upgrade to this version.

pull requests

• PR #1 Dashboard.go changed to also processed .gz files from @eirikrvw.

  It allows to generate Grafana dashboards from gzipped nmon files like standard nmon files.

enhancements

• issue #35 Added support for configuration file in /etc/nmon2influxdb:

  nmon2influxdb will first check if the configuration file /etc/nmon2influxdb/nmon2influxdb.cfg exists before checking in user's home directory.

• issue #38 improved debugging:

  • Log messages use the golang log package now.
  • Added timestamps.
  • Removed duplicate messages for skipped metrics in nmon import.

  New option debug-file redirect output to text file:

  nmon2influxdb --debug-file="debugfile" hmc import
  

  No need to specify the debug option when debug-file is specified.

  Configuration parameters are displayed sanitized in the debug output. Users and passwords are replaced by "secretuser" and "secret":

  2017/01/16 14:52:57 configuration: {Debug:true DebugFile:test2 Timezone:Europe/Paris InfluxdbUser:secretuser InfluxdbPassword:secret InfluxdbServer:192.168.56.101 InfluxdbPort:8086 InfluxdbDatabase:nmon_reports GrafanaUser:secretuser GrafanaPassword:secret GrafanaURL: GrafanaAccess: GrafanaDatasource: HMCServer:hmc1 HMCUser:secretuser HMCPassword:secret HMCDatabase:nmon2influxdbHMC HMCDataRetention:40d HMCManagedSystem:mysystem HMCManagedSystemOnly:false HMCSamples:10 ImportSkipDisks:false ImportAllCpus:false ImportBuildDashboard:false ImportForce:false ImportSkipMetrics: ImportLogDatabase: ImportLogRetention: ImportDataRetention: ImportSSHUser:adejoux ImportSSHKey:/Users/adejoux/.ssh/id_rsa DashboardWriteFile:false StatsLimit:0 StatsSort:mean StatsFilter: StatsFrom: StatsTo: StatsHost: Metric: ListFilter: ListHost: Inputs:[{Measurement:CPU_ALL Name:host Match:itmup Tags:[{Name:BUSINESSCLASS Value:GOLD Regexp:<nil>} {Name:HOSTTYPE Value:PHYSICAL Regexp:<nil>} {Name:OSTYPE Value:AIX Regexp:<nil>} {Name:REGION Value:NA Regexp:<nil>}]}]}
  

bug fixes

• issue #33 fixed chart issue DISKBUSY chart was displaying DISKRIO stats in generated AIX dashboard
• issue #39 unable to generate default configuration file since tagging addition
• issue #40 fixed nmon2influxdb crash when the HMC couldn't get system metrics from managed system

Custom Tags

add custom tags to your data by adding a input section in the configuration file:

[[input]]
  Measurement="PartitionProcessor"
  Name="partition"
  Match="adxlpar"
  [[input.tag]]
    Name="datacenter"
    Value="DC1"

Custom tags are added at import time.
It will add a tag named datacenter with value DC1 if the tag partition in the measurement PartitionProcessor match the regular expression adxlpar.

Attribute's description:

• Measurement: it's the measurement where an additional tag could be added
• Name: name of the tag to check
• Match: the regular expression used to check the tag value. No need to put the regular expression between '/' characters.

More informations on the configuration file page.

enhancements

• added serial tag to nmon files to permit grouping by managed system.
• added information message if retention policy is set.
• added error message on configuration file syntax error.

HMC import

Added two new options to hmc import:

• --sys-only: skip partition metrics
• --samples : fetch the latest samples. Each sample is averaging 30 seconds.

Examples

samples

hmc import --samples 10
Fetching 10 latest samples. 30 seconds interval.
Getting list of managed systems

POWER8-S824A
managed system              POWER8-S824A:     2420 points fetched.
Partition                       WM-SLES1:      730 points fetched.
Partition                 LV-PCM-Manager:      340 points fetched.
Partition                     PowerVC-LE:      290 points fetched.
Partition                   LVL-cluster2:      290 points fetched.
Partition                   lvl-cluster1:      290 points fetched.
Partition                       WM-SLES2:      730 points fetched.

Managed System Only

hmc import --sys-only
Fetching latest 2 hours performance metrics. See hmc_samples parameter.
Getting list of managed systems
p750A
managed system                     p750A:     2728 points fetched.

p720-FTSSNIM_RETIRED
Error getting PCM data

p750-SSIS
managed system                 p750-SSIS:     2728 points fetched.

POWER8-S824A
managed system              POWER8-S824A:    60016 points fetched.

p750B
managed system                     p750B:    22410 points fetched.

p755-HPC
managed system                  p755-HPC:     1992 points fetched.

Fixes

** issue 30: improved HMC authentication error message.

time nmon2influxdb hmc import
2016/11/24 11:13:54 HMC authentication error: 401 Unauthorized

Big release introducing support for HMC Performance and Capacity Monitoring(PCM) metrics.

• new sub command hmc import
• import HMC partition metrics in InfluxDB
• import HMC system metrics in InfluxDB

Two dashboards available to visualize data:

• hmc_partition.json: partition centric
• hmc_system.json: system centric

See more details at nmon2influxdb.org and my blog.

• HMC partition demo available on demo.nmon2influxdb.org/dashboard/db/hmc-partition
• HMC system demo available on demo.nmon2influxdb.org/dashboard/db/hmc-system

Account/password: demo

Enjoy :)

• fixed issue #26:
  get InfluxDB default retention policy name instead of using "default".
• fixed wrong datasource specified in grafana dashboard
  DataSource field in grafana panel was not set. And DSType was wrongly configured to "nmon2influxdb" instead of "influxdb".