Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple metrics on one chart #2359

Closed
shekhirin opened this issue Jun 18, 2017 · 21 comments
Closed

Multiple metrics on one chart #2359

shekhirin opened this issue Jun 18, 2017 · 21 comments
Labels
Projects

Comments

@shekhirin
Copy link

shekhirin commented Jun 18, 2017

How can I show multiple cgroup_CONTAINER_NAME.mem_usage on same chart with legend specified by myself? I think I can achieve that by creating own plugin but I don't understand how to gather information from other plugins.
Thank you!

@ktsaou
Copy link
Member

ktsaou commented Jun 18, 2017

Hi,

unfortunately is not that easy with netdata currently. Either of these will work with netdata:

  1. Write it in javascript, i.e. query netdata for the dimensions you needs, and prepare a chart. It will be hard though; you will need to get into the internals of the dashboard...
    or
  2. Write a plugin that queries netdata itself for the data you need and create a new chart with the dimensions and legends you need. This can be done in python. Use the netdata API to get the data you need, and push the values back in a chart as you like it. This is pretty easy, but it will waste resources since the data are already in netdata and you will duplicate them just to change their presentation.
    or
  3. Prepare a custom dashboard. A simple html page, that shows all the data you need using multiple charts. It will not be a single chart though. The home page of netdata is such a custom dashboard. There are also a few demo custom dashboards installed with netdata: http://your.netdata.ip:19999/demo.html and demo2.html. This is by far the easiest and does not waste any resources.

Of course, if you need to do that a lot, you could archive netdata metrics to a time-series database (see backends) and use grafana to build the charts you want. This however, will use a lot more resources.

Your request however, is valid. Netdata should allows us to cherry pick metrics and create the charts the way we want them. So, I will leave it open as enhancement.

@simongui
Copy link

simongui commented Aug 3, 2017

👍 for this feature. I want to put two related stats into a single graph but I don't know how to do that. I see there's dimensions support but I don't know how to make that work with statsd. Right now I have separate graphs but its really a pain to correlate between multiple graphs.

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

@simongui for statsd metrics this is already in place with synthetic charts: https://github.com/firehol/netdata/wiki/statsd#synthetic-statsd-charts

I use them extensibly. They are magic...

@simongui
Copy link

simongui commented Aug 3, 2017

Oh interesting, I'll try this out! In a custom chart, can I use multiple statsd metrics as dimensions as well somehow?

Also, how do I discover what the metric names are? I'm not sure how myapp.* works because it seems I'm getting the following in go:

sink.SetGauge([]string{"foo", "price"}, 123)

Is giving me a metric of

statsd_gauge_foo.price

I'm also not clear where these synthetic charts show up? I created a .conf file but I don't know where these show up to use?

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

In a custom chart, can I use multiple statsd metrics as dimensions as well somehow?

that is the idea

Also, how do I discover what the metric names are? I'm not sure how myapp.* works because it seems I'm getting the following in go:

The metric name to be matched will be foo. You can of course use * as pattern to match all of them. The right way though is to send metrics to statsd with a prefix, otherwise multiple apps may overlap.

I'm also not clear where these synthetic charts show up? I created a .conf file but I don't know where these show up to use?

For these charts to show up, they need to match a metric. Otherwise, they do not exist.
You will see myapp on the dashboard, by default just below statsd.

@simongui
Copy link

simongui commented Aug 3, 2017

Hmm I must be doing something wrong because it's not showing up in the dashboard. I've added the .conf file and I've restarted netdata.

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

Example:

statsd metrics: foo and bar.

File /etc/netdata/stats.d/foobar.conf:

[app]
  name = foobarapp
  metrics = foo bar
  private charts = yes

[foobar_chart1]
  title = Hey, foo and bar together
  family = foobar_family
  context = foobar.context
  units = foobars/s
  type = area
  dimension = foo 'foo me' last 1 1
  dimension = bar 'bar me' last 1 1

I sent to statsd: foo:10|g and bar:20|g.

I got these private charts:

screenshot from 2017-08-03 23-28-19

and this synthetic chart:

screenshot from 2017-08-03 23-29-14

@simongui
Copy link

simongui commented Aug 3, 2017

It still doesn't seem to be working for me. I have these gauges showing up. Notice the application doesn't show up on the right either.

screen shot 2017-08-03 at 5 00 30 pm

I've used this .conf file.

[app]
	name = myapp
	metrics = vrm.delta bcc.delta
	private charts = yes

[changes]
	title = my chart title
	family = my family
	context = chart.context
	units = percent of change
	priority = 91000
	type = area
	dimension = vrm.delta 'vrm delta' last 1 1
	dimension = bcc.delta 'bcc delta' last 1 1

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

hm.. could you please post the whole charts menu?

@simongui
Copy link

simongui commented Aug 3, 2017

screen shot 2017-08-03 at 5 06 16 pm

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

strange... It works for me:

screenshot from 2017-08-04 00-07-42

Could you please remove all other .conf files from /etc/netdata/stats.d?

@simongui
Copy link

simongui commented Aug 3, 2017

I've also noticed in my custom chart, I can't do the following.

data-netdata="vrm.delta"

I can't do this either.

data-netdata="statsd_gauge_*.delta"

Only this works.

data-netdata="statsd_gauge_vrm.delta"

Is it failing to load because the metrics are missing or improperly used?

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

Did you post any values to these metrics after you created the .conf file?
netdata will not generate synthetic charts with past data. Only on new ones.

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

data-netdata= works on specific charts only. One div for one chart. You cannot (yet) merge netdata charts at the visualization level.

@simongui
Copy link

simongui commented Aug 3, 2017

So I can't make my own custom dashboard that combine multiple gauges?

I am pushing metrics to these gauges as we speak and have been the whole time. I can see them updating under statsd. There's no app shown in the menu at all. What could prevent that from happening?

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

Please follow this procedure.

  1. Make sure the only .conf file in /etc/netdata/statsd.d/ is the file you posted above.
  2. Restart netdata to make sure it has loaded it.
  3. Refresh the netdata dashboard on your web browser.
  4. If the myapp menu is still not visible, wait for vrm.delta or bcc.delta to get a new different value (ie see something that is not a straight line on their private charts).
  5. Once you see this not-straight-line, refresh the page on your browser
  6. The myapp menu should be there.

The idea is that:

  • netdata creates charts on demand
  • statsd values always get updated, with the latest value collected (gauges), or zero (counters)

If it still does not show up, please stop netdata, delete /var/log/netdata/error.log and repeat the above procedure. Then, post the error.log here.

@simongui
Copy link

simongui commented Aug 3, 2017

Here's the error log, thanks for all the help by the way!

2017-08-03 17:43:49: netdata ERROR: Cannot adjust my Out-Of-Memory score to '1000'. (errno 2, No such file or directory)
2017-08-03 17:43:49: netdata ERROR: User netdata is not present.
2017-08-03 17:43:49: netdata ERROR: Cannot become user 'netdata'. Continuing as we are.
2017-08-03 17:43:49: netdata INFO : netdata started on pid 95176.
2017-08-03 17:43:49: netdata ERROR: HEALTH [Simons-MacBook-Pro.local]: cannot open health file: /opt/netdata/var/lib/netdata/health/health-log.db.old (errno 2, No such file or directory)
2017-08-03 17:43:49: netdata INFO : Host 'Simons-MacBook-Pro.local' (at registry as 'Simons-MacBook-Pro.local') with guid '5b4a8448-7787-11e7-929b-60f81dcb7b5c' initialized, os macos, tags '', update every 1, memory mode save, history entries 3996, streaming disabled (to '' with api key ''), health enabled, cache_dir '/opt/netdata/var/cache/netdata', varlib_dir '/opt/netdata/var/lib/netdata', health_log '/opt/netdata/var/lib/netdata/health/health-log.db', alarms default handler '/opt/netdata/usr/libexec/netdata/plugins.d/alarm-notify.sh', alarms default recipient 'root'
2017-08-03 17:43:49: netdata INFO : TC thread created with task id 7575324
2017-08-03 17:43:49: netdata INFO : IDLEJITTER thread created with task id 7575325
2017-08-03 17:43:49: netdata INFO : Multi-threaded WEB SERVER thread created with task id 7575330
2017-08-03 17:43:49: netdata INFO : PLUGINS.D thread created with task id 7575329
2017-08-03 17:43:49: netdata INFO : HEALTH thread created with task id 7575328
2017-08-03 17:43:49: netdata INFO : BACKEND: thread created with task id 7575327
2017-08-03 17:43:49: netdata INFO : MACOS Plugin thread created with task id 7575326
2017-08-03 17:43:49: netdata INFO : STATSD main thread created with task id 7575332
2017-08-03 17:43:49: netdata INFO : BACKEND: thread exiting
2017-08-03 17:43:49: netdata INFO : netdata initialization completed. Enjoy real-time performance monitoring!
2017-08-03 17:43:49: netdata INFO : Listening on 'tcp:[::]:19999'
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin' running on pid 95180
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/fping.plugin' running on pid 95181
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/node.d.plugin' running on pid 95182
2017-08-03 17:43:49: netdata INFO : Listening on 'tcp:[0.0.0.0]:19999'
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/python.d.plugin' running on pid 95183
2017-08-03 17:43:49: netdata INFO : STATSD collector thread No 1 created with task id 7575346
2017-08-03 17:43:49: netdata INFO : POLLFD: LISTENER: listening on 'udp:[::1]:8125'
2017-08-03 17:43:49: netdata INFO : POLLFD: LISTENER: listening on 'udp:[127.0.0.1]:8125'
2017-08-03 17:43:49: netdata INFO : POLLFD: LISTENER: listening on 'tcp:[::1]:8125'
2017-08-03 17:43:49: netdata INFO : POLLFD: LISTENER: listening on 'tcp:[127.0.0.1]:8125'
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
2017-08-03 17:43:49: fping.plugin: FATAL: no hosts configured in '/opt/netdata/etc/netdata/fping.conf' - nothing to do.
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/fping.plugin' called DISABLE. Disabling it.
2017-08-03 17:43:49: netdata ERROR: PLUGINSD: plugin '/opt/netdata/usr/libexec/netdata/plugins.d/fping.plugin' disconnected.
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/fping.plugin' on pid 95181 stopped after 0 successful data collections (ENDs).
2017-08-03 17:43:49: netdata ERROR: child pid 95181 exited with code 1. (errno 9, Bad file descriptor)
2017-08-03 17:43:49: netdata ERROR: PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/fping.plugin' exited with error code 1. Disabling it.
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/fping.plugin' thread exiting
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
/opt/netdata/usr/libexec/netdata/plugins.d/loopsleepms.sh.inc: line 36: /proc/uptime: No such file or directory
/opt/netdata/usr/libexec/netdata/plugins.d/tc-qos-helper.sh: Cannot read /proc/uptime - falling back to current_time_ms_from_date().
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
/opt/netdata/usr/libexec/netdata/plugins.d/tc-qos-helper.sh: Invalid setup for current_time_ms_from_uptime() - falling back to current_time_ms_from_date().
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
2017-08-03 17:43:49: tc-qos-helper.sh: FATAL: cannot find command 'tc' in this system.
2017-08-03 17:43:49: netdata ERROR: child pid 95178 exited with code 1. (errno 9, Bad file descriptor)
2017-08-03 17:43:49: netdata ERROR: TC: tc-qos-helper.sh exited with code 1. Disabling it.
2017-08-03 17:43:49: netdata INFO : TC thread exiting
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
2017-08-03 17:43:49: charts.d: WARNING: main: command 'timeout' is not found in /usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/share/dotnet:/usr/local/go/bin:/Library/Frameworks/Mono.framework/Versions/Current/Commands:/Applications/Wireshark.app/Contents/MacOS:/Users/simon/go/bin:/usr/local/bin:/sbin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/sbin:/usr/sbin:/usr/local/bin:/usr/local/sbin.
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 88: ${1^^}_CMD="": bad substitution
/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin: line 92: ${1^^}_CMD="${x}": bad substitution
2017-08-03 17:43:49: charts.d: FATAL: main: BASH version 4 or later is required, but found version: 3.2.57(1)-release. Please upgrade.
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin' called DISABLE. Disabling it.
2017-08-03 17:43:49: netdata ERROR: PLUGINSD: plugin '/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin' disconnected.
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin' on pid 95180 stopped after 0 successful data collections (ENDs).
2017-08-03 17:43:49: netdata ERROR: child pid 95180 killed by signal 0. (errno 9, Bad file descriptor)
2017-08-03 17:43:49: netdata ERROR: PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin' exited with error code -1. Disabling it.
2017-08-03 17:43:49: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/charts.d.plugin' thread exiting
2017-08-03 17:43:49:  INFO: Using python v2
2017-08-03 17:43:49:  INFO: YAML output is ordered
2017-08-03 17:43:49: python.d INFO: reading configuration file: /opt/netdata/etc/netdata/python.d.conf
2017-08-03 17:43:49: python.d INFO: MODULES_DIR='/opt/netdata/usr/libexec/netdata/python.d/', CONFIG_DIR='/opt/netdata/etc/netdata/', UPDATE_EVERY=1, ONLY_MODULES=[]
2017-08-03 17:43:49: python.d ERROR: apache_cache.chart.py: disabled module  apache_cache
2017-08-03 17:43:49: python.d ERROR: Problem loading cpuidle dlopen(libc.so.6, 6): image not found
2017-08-03 17:43:49: python.d ERROR: example.chart.py: disabled module  example
2017-08-03 17:43:49: python.d ERROR: go_expvar.chart.py: disabled module  go_expvar
2017-08-03 17:43:49: node.d.plugin: ERROR: Cannot load module's snmp config from /opt/netdata/etc/netdata/node.d/snmp.conf exception: Error: ENOENT: no such file or directory, open '/opt/netdata/etc/netdata/node.d/snmp.conf', using internal defaults.
2017-08-03 17:43:49: node.d.plugin: ERROR: Cannot load module's sma_webbox config from /opt/netdata/etc/netdata/node.d/sma_webbox.conf exception: Error: ENOENT: no such file or directory, open '/opt/netdata/etc/netdata/node.d/sma_webbox.conf', using internal defaults.
2017-08-03 17:43:49: node.d.plugin: ERROR: Cannot load module's named config from /opt/netdata/etc/netdata/node.d/named.conf exception: Error: ENOENT: no such file or directory, open '/opt/netdata/etc/netdata/node.d/named.conf', using internal defaults.
2017-08-03 17:43:49: python.d ERROR: Problem loading sensors dlsym(RTLD_DEFAULT, libsensors_version): symbol not found
2017-08-03 17:43:49: node.d.plugin: ERROR: Cannot load module's fronius config from /opt/netdata/etc/netdata/node.d/fronius.conf exception: Error: ENOENT: no such file or directory, open '/opt/netdata/etc/netdata/node.d/fronius.conf', using internal defaults.
2017-08-03 17:43:49: node.d.plugin: ERROR: named: local: Failed to make request, message: connect ECONNREFUSED 127.0.0.1:8888
2017-08-03 17:43:49: python.d ERROR: apache_localhost Url: http://localhost/server-status?auto. Error: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded with url: /server-status?auto (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x109882a90>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: apache_localhost _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: apache_localhost check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: apache/localhost
2017-08-03 17:43:49: python.d ERROR: apache_localipv4 Url: http://127.0.0.1/server-status?auto. Error: HTTPConnectionPool(host='127.0.0.1', port=80): Max retries exceeded with url: /server-status?auto (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1098829d0>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: apache_localipv4 _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: apache_localipv4 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: apache/localipv4
2017-08-03 17:43:49: python.d ERROR: apache_localipv6 Url: http://::1/server-status?auto. Error: Failed to parse: ::1
2017-08-03 17:43:49: python.d ERROR: apache_localipv6 _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: apache_localipv6 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: apache/localipv6
2017-08-03 17:43:49: python.d ERROR: bind_rndc Can't locate 'rndc' binary or binary is not executable by netdata
2017-08-03 17:43:49: python.d ERROR: bind_rndc check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: bind_rndc/None
2017-08-03 17:43:49: python.d ERROR: cpufreq couldn't find a method to read cpufreq statistics
2017-08-03 17:43:49: python.d ERROR: cpufreq check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: cpufreq/None
2017-08-03 17:43:49: python.d ERROR: dns_query_time 'python-dnspython' package is needed to use dns_query_time.chart.py
2017-08-03 17:43:49: python.d ERROR: dns_query_time check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: dns_query_time/None
2017-08-03 17:43:49: python.d ERROR: dovecot_localhost Failed to connect to '::1', port 24242: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: dovecot_localhost Failed to connect to '127.0.0.1', port 24242: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: dovecot_localhost check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: dovecot/localhost
2017-08-03 17:43:49: python.d ERROR: dovecot_localipv4 Failed to connect to '127.0.0.1', port 24242: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: dovecot_localipv4 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: dovecot/localipv4
2017-08-03 17:43:49: python.d ERROR: dovecot_localipv6 Failed to connect to '::1', port 24242: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: dovecot_localipv6 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: dovecot/localipv6
2017-08-03 17:43:49: python.d ERROR: dovecot_localsocket Failed to connect to unix socket '/var/run/dovecot/stats': [Errno 2] No such file or directory
2017-08-03 17:43:49: python.d ERROR: dovecot_localsocket check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: dovecot/localsocket
2017-08-03 17:43:49: python.d ERROR: elasticsearch_local Url: http://127.0.0.1:9200/_cluster/health. Error: HTTPConnectionPool(host='127.0.0.1', port=9200): Max retries exceeded with url: /_cluster/health (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1097eba50>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: elasticsearch_local Url: http://127.0.0.1:9200/_nodes/_local/stats. Error: HTTPConnectionPool(host='127.0.0.1', port=9200): Max retries exceeded with url: /_nodes/_local/stats (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1097eb0d0>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: elasticsearch_local Url: http://127.0.0.1:9200/_cluster/stats. Error: HTTPConnectionPool(host='127.0.0.1', port=9200): Max retries exceeded with url: /_cluster/stats (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1098829d0>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: elasticsearch_local _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: elasticsearch_local check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: elasticsearch/local
2017-08-03 17:43:49: python.d ERROR: exim_local Can't locate "exim -bpc" binary in PATH(['/usr/local/bin', '/usr/bin', '/bin', '/usr/sbin', '/sbin', '/usr/local/share/dotnet', '/usr/local/go/bin', '/Library/Frameworks/Mono.framework/Versions/Current/Commands', '/Applications/Wireshark.app/Contents/MacOS', '/Users/simon/go/bin', '/usr/local/bin', '/sbin', '/usr/sbin', '/usr/local/bin', '/usr/local/sbin'])
2017-08-03 17:43:49: python.d ERROR: exim_local check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: exim/local
2017-08-03 17:43:49: python.d ERROR: fail2ban /var/log/fail2ban.log is not readable or empty
2017-08-03 17:43:49: python.d ERROR: fail2ban check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: fail2ban/None
2017-08-03 17:43:49: python.d ERROR: freeradius_local Can't locate 'radclient' binary or binary is not executable by netdata
2017-08-03 17:43:49: python.d ERROR: freeradius_local check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: freeradius/local
2017-08-03 17:43:49: python.d ERROR: haproxy URL is not defined or type is not <str>
2017-08-03 17:43:49: python.d ERROR: haproxy check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: haproxy/None
2017-08-03 17:43:49: python.d INFO: hddtemp_localhost Autodetecting disks
2017-08-03 17:43:49: python.d ERROR: hddtemp_localhost Failed to connect to '::1', port 7634: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: hddtemp_localhost Failed to connect to '127.0.0.1', port 7634: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: hddtemp_localhost no data received
2017-08-03 17:43:49: python.d ERROR: hddtemp_localhost check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: hddtemp/localhost
2017-08-03 17:43:49: python.d INFO: hddtemp_localipv4 Autodetecting disks
2017-08-03 17:43:49: python.d ERROR: hddtemp_localipv4 Failed to connect to '127.0.0.1', port 7634: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: hddtemp_localipv4 no data received
2017-08-03 17:43:49: python.d ERROR: hddtemp_localipv4 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: hddtemp/localipv4
2017-08-03 17:43:49: python.d INFO: hddtemp_localipv6 Autodetecting disks
2017-08-03 17:43:49: python.d ERROR: hddtemp_localipv6 Failed to connect to '::1', port 7634: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: hddtemp_localipv6 no data received
2017-08-03 17:43:49: python.d ERROR: hddtemp_localipv6 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: hddtemp/localipv6
2017-08-03 17:43:49: python.d ERROR: ipfs_localhost Url: http://localhost:5001/api/v0/pin/ls. Error: HTTPConnectionPool(host='localhost', port=5001): Max retries exceeded with url: /api/v0/pin/ls (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1097f5210>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: ipfs_localhost Url: http://localhost:5001/api/v0/stats/repo. Error: HTTPConnectionPool(host='localhost', port=5001): Max retries exceeded with url: /api/v0/stats/repo (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1097f5910>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: ipfs_localhost Url: http://localhost:5001/api/v0/stats/bw. Error: HTTPConnectionPool(host='localhost', port=5001): Max retries exceeded with url: /api/v0/stats/bw (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1097f5350>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: ipfs_localhost Url: http://localhost:5001/api/v0/config/show. Error: HTTPConnectionPool(host='localhost', port=5001): Max retries exceeded with url: /api/v0/config/show (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1097f5090>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: ipfs_localhost Url: http://localhost:5001/api/v0/swarm/peers. Error: HTTPConnectionPool(host='localhost', port=5001): Max retries exceeded with url: /api/v0/swarm/peers (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x1097f5f10>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: ipfs_localhost _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: ipfs_localhost check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: ipfs/localhost
2017-08-03 17:43:49: python.d ERROR: isc_dhcpd 'python-ipaddress' module is needed
2017-08-03 17:43:49: python.d ERROR: isc_dhcpd check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: isc_dhcpd/None
2017-08-03 17:43:49: python.d ERROR: mdstat Failed to read data from /proc/mdstat or there is no active arrays
2017-08-03 17:43:49: python.d ERROR: mdstat check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mdstat/None
2017-08-03 17:43:49: python.d ERROR: memcached_localhost_localhost Failed to connect to '::1', port 11211: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: memcached_localhost_localhost Failed to connect to '127.0.0.1', port 11211: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: memcached_localhost_localhost check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: memcached/localhost
2017-08-03 17:43:49: python.d ERROR: memcached_localipv4_localipv4 Failed to connect to '127.0.0.1', port 11211: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: memcached_localipv4_localipv4 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: memcached/localipv4
2017-08-03 17:43:49: python.d ERROR: memcached_localipv6_localipv6 Failed to connect to '::1', port 11211: [Errno 61] Connection refused
2017-08-03 17:43:49: python.d ERROR: memcached_localipv6_localipv6 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: memcached/localipv6
2017-08-03 17:43:49: python.d ERROR: mongodb_local Pymongo module is needed to use mongodb.chart.py
2017-08-03 17:43:49: python.d ERROR: mongodb_local check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mongodb/local
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf1 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf1 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/mycnf1
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf2 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf2 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/mycnf2
2017-08-03 17:43:49: python.d ERROR: mysql_debiancnf MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_debiancnf check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/debiancnf
2017-08-03 17:43:49: python.d ERROR: mysql_socket1 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket1 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket1
2017-08-03 17:43:49: python.d ERROR: mysql_socket2 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket2 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket2
2017-08-03 17:43:49: python.d ERROR: mysql_socket3 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket3 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket3
2017-08-03 17:43:49: python.d ERROR: mysql_socket4 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket4 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket4
2017-08-03 17:43:49: python.d ERROR: mysql_tcp MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcp check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcp
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv4 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv4 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcpipv4
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv6 MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv6 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcpipv6
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf1_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf1_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/mycnf1_root
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf2_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf2_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/mycnf2_root
2017-08-03 17:43:49: python.d ERROR: mysql_socket1_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket1_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket1_root
2017-08-03 17:43:49: python.d ERROR: mysql_socket2_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket2_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket2_root
2017-08-03 17:43:49: python.d ERROR: mysql_socket3_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket3_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket3_root
2017-08-03 17:43:49: python.d ERROR: mysql_socket4_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket4_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket4_root
2017-08-03 17:43:49: python.d ERROR: mysql_tcp_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcp_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcp_root
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv4_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv4_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcpipv4_root
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv6_root MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv6_root check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcpipv6_root
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf1_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/disk_inodes._/reserved_for_root.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.2017-08-03 17:43:49: python.d ERROR: mysql_mycnf1_netdata check() failed - disabling job

2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/mycnf1_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf2_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_mycnf2_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/mycnf2_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_socket1_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket1_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket1_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_socket2_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket2_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket2_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_socket3_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket3_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket3_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_socket4_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_socket4_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/socket4_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_tcp_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcp_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcp_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv4_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv4_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcpipv4_netdata
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv6_netdata MySQLdb or PyMySQL module is needed to use mysql.chart.py plugin
2017-08-03 17:43:49: python.d ERROR: mysql_tcpipv6_netdata check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: mysql/tcpipv6_netdata
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.lo0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.lo0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: python.d ERROR: nginx_localhost Url: http://localhost/stub_status. Error: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded with url: /stub_status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x10980ce10>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: nginx_localhost _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: nginx_localhost check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: nginx/localhost
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.gif0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.gif0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: python.d ERROR: nginx_localipv4 Url: http://127.0.0.1/stub_status. Error: HTTPConnectionPool(host='127.0.0.1', port=80): Max retries exceeded with url: /stub_status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x10980cc10>: Failed to establish a new connection: [Errno 61] Connection refused',))
2017-08-03 17:43:49: python.d ERROR: nginx_localipv4 _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: nginx_localipv4 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: nginx/localipv4
2017-08-03 17:43:49: python.d ERROR: nginx_localipv6 Url: http://::1/stub_status. Error: Failed to parse: ::1
2017-08-03 17:43:49: python.d ERROR: nginx_localipv6 _get_data() returned no data or type is not <dict>
2017-08-03 17:43:49: python.d ERROR: nginx_localipv6 check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: nginx/localipv6
2017-08-03 17:43:49: python.d ERROR: nsd_local Can't locate "nsd-control stats_noreset" binary in PATH(['/usr/local/bin', '/usr/bin', '/bin', '/usr/sbin', '/sbin', '/usr/local/share/dotnet', '/usr/local/go/bin', '/Library/Frameworks/Mono.framework/Versions/Current/Commands', '/Applications/Wireshark.app/Contents/MacOS', '/Users/simon/go/bin', '/usr/local/bin', '/sbin', '/usr/sbin', '/usr/local/bin', '/usr/local/sbin'])
2017-08-03 17:43:49: python.d ERROR: nsd_local check() failed - disabling job
2017-08-03 17:43:49: python.d ERROR: DISABLED: nsd/local
2017-08-03 17:43:49: python.d ERROR: ovpn_status_log 'log_path' is not defined
2017-08-03 17:43:49: python.d.plugin: throttling further log messages for 971 seconds
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.stf0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.stf0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en1/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en1/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en2/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en2/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.p2p0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.p2p0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.awdl0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.awdl0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.bridge0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.bridge0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun0/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun0/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun1/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun1/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en6/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.en6/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.bridge100/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.bridge100/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun3/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun3/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun2/frames.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:49: netdata ERROR: File /opt/netdata/var/cache/netdata/net_events.utun2/carrier.db is too old (last collected 1501796629 seconds ago, but the database is 3996 seconds). Clearing it.
2017-08-03 17:43:50: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/node.d.plugin' called DISABLE. Disabling it.
2017-08-03 17:43:50: netdata ERROR: PLUGINSD: plugin '/opt/netdata/usr/libexec/netdata/plugins.d/node.d.plugin' disconnected.
2017-08-03 17:43:50: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/node.d.plugin' on pid 95182 stopped after 0 successful data collections (ENDs).
2017-08-03 17:43:50: netdata ERROR: child pid 95182 exited with code 1. (errno 9, Bad file descriptor)
2017-08-03 17:43:50: netdata ERROR: PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/node.d.plugin' exited with error code 1. Disabling it.
2017-08-03 17:43:50: netdata INFO : PLUGINSD: '/opt/netdata/usr/libexec/netdata/plugins.d/node.d.plugin' thread exiting

@ktsaou
Copy link
Member

ktsaou commented Aug 3, 2017

I don't see any statsd errors.
All the errors are auto-detection failures.

Do you have the nc or ncat command on this mac?

@simongui
Copy link

simongui commented Aug 4, 2017

I have nc yeah.

@gmosx gmosx self-assigned this Nov 18, 2018
@gmosx gmosx added this to To do in Web GUI via automation Nov 18, 2018
@gmosx gmosx added the feature request New features label Nov 19, 2018
@gpapamathND gpapamathND assigned gpapamathND and unassigned gmosx Jun 25, 2019
@gpapamathND gpapamathND removed their assignment Apr 21, 2020
@ilyam8
Copy link
Member

ilyam8 commented Jul 19, 2021

Closing this feature request. We will re-evaluate the request internally.

@lyc8503
Copy link

lyc8503 commented Feb 2, 2024

Hi,

unfortunately is not that easy with netdata currently. Either of these will work with netdata:

  1. Write it in javascript, i.e. query netdata for the dimensions you needs, and prepare a chart. It will be hard though; you will need to get into the internals of the dashboard...
    or
  2. Write a plugin that queries netdata itself for the data you need and create a new chart with the dimensions and legends you need. This can be done in python. Use the netdata API to get the data you need, and push the values back in a chart as you like it. This is pretty easy, but it will waste resources since the data are already in netdata and you will duplicate them just to change their presentation.
    or
  3. Prepare a custom dashboard. A simple html page, that shows all the data you need using multiple charts. It will not be a single chart though. The home page of netdata is such a custom dashboard. There are also a few demo custom dashboards installed with netdata: http://your.netdata.ip:19999/demo.html and demo2.html. This is by far the easiest and does not waste any resources.

Of course, if you need to do that a lot, you could archive netdata metrics to a time-series database (see backends) and use grafana to build the charts you want. This however, will use a lot more resources.

Your request however, is valid. Netdata should allows us to cherry pick metrics and create the charts the way we want them. So, I will leave it open as enhancement.

I wrote a simple plugin according to method 2 here. It works well in my usecase.

https://gist.github.com/lyc8503/5698e5194001cbfc753dcdc2673f3afe

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
No open projects
Web GUI
  
Done
Development

No branches or pull requests

8 participants