Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

部分指标的数据无法在监控大盘中显示 #279

Closed
AstonPudding opened this issue Aug 5, 2020 · 8 comments
Closed

部分指标的数据无法在监控大盘中显示 #279

AstonPudding opened this issue Aug 5, 2020 · 8 comments

Comments

@AstonPudding
Copy link

问题描述:

在监控大盘中配置了多个指标的展示,部分指标却无数据显示。
但是在监控看图中各个endpoint的指标都能够正常显示数据。
如图所示:
以 disk.bytes.used.percent 为例
微信截图_20200805185249
微信截图_20200805185505

排查过程:

各个组件开启DEBUG日志,发现从collector到transfer再到tsdb最后到index都能正常收发关于该指标的数据。
但在查看这个指标所在的监控大盘时,tsdb报warning
2020-08-05 18:37:51.303809 WARNING rpc/query.go:121 fetch rrd data err:opening error seriesID:a0788ef3aa756cd0ff8db77edfbd1b50, param:{1596620271 1596623871 AVERAGE 10.6.16.158 disk.bytes.used.percent 20 } 2020-08-05 18:37:51.447239 WARNING rpc/query.go:121 fetch rrd data err:opening error seriesID:a0788ef3aa756cd0ff8db77edfbd1b50, param:{1596620271 1596623871 AVERAGE 10.6.16.158 disk.bytes.used.percent 20 } 2020-08-05 18:37:51.614677 WARNING rpc/query.go:121 fetch rrd data err:opening error seriesID:a0788ef3aa756cd0ff8db77edfbd1b50, param:{1596620271 1596623871 AVERAGE 10.6.16.158 disk.bytes.used.percent 20 } 2020-08-05 18:37:55.508135 WARNING rpc/query.go:121 fetch rrd data err:opening error seriesID:a0788ef3aa756cd0ff8db77edfbd1b50, param:{1596620275 1596623875 AVERAGE 10.6.16.158 disk.bytes.used.percent 20 } 2020-08-05 18:37:55.665849 WARNING rpc/query.go:121 fetch rrd data err:opening error seriesID:a0788ef3aa756cd0ff8db77edfbd1b50, param:{1596620275 1596623875 AVERAGE 10.6.16.158 disk.bytes.used.percent 20 }

其他:

使用的master最新代码

@AstonPudding
Copy link
Author

大佬们能不能帮忙提供一下排查思路~

@UlricQin
Copy link
Member

UlricQin commented Aug 8, 2020

监控大盘怎么配置的,截个图看看

@AstonPudding
Copy link
Author

disk.bytes.used.percent配置截图
企业微信截图_20200808123836

只要是 disk.bytes 开头的,在监控大盘里都没有数据显示
企业微信截图_20200808124658

只能在监控看图中看到数据
企业微信截图_20200808124816

并且在另一套夜莺系统中,也出现了相同的现象,不过是 net.in.* 和 net.out.* 无法在监控大盘中显示,其余均正常。

@UlricQin
Copy link
Member

UlricQin commented Aug 9, 2020

监控大盘那个endpoint字段,不要=all,直接选中endpoint看看什么效果。
同时打开浏览器调试工具,看看disk相关的这几个指标获取数据的时候发给服务端的是什么请求,收到的什么内容

@AstonPudding
Copy link
Author

我发现问题了,整理下晚会发上来~

@ggq-ng
Copy link

ggq-ng commented Nov 25, 2020

大佬,怎么解决的啊

1 similar comment
@supervisoredis
Copy link

大佬,怎么解决的啊

@AstonPudding
Copy link
Author

在监控大盘里直接创建新的监控图表,不要现有的基础上克隆图表。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants