Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.
Sign upUnknown reason prometheus's data genedated graphs having spikes dips #2772
Comments
This comment has been minimized.
This comment has been minimized.
|
This is probably an oddness in your enviroment, looking into it is best done on https://groups.google.com/forum/#!forum/prometheus-users |
brian-brazil
closed this
Jul 14, 2017
This comment has been minimized.
This comment has been minimized.
lock
bot
commented
Mar 23, 2019
|
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs. |
lock
bot
locked and limited conversation to collaborators
Mar 23, 2019
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
sutest commentedMay 26, 2017
As seen from the screenshot , it's a graph showing nginx QPS which collected from prometheus_nginx_exporter (this exporter fetch data by tail log file function)
Normally this QPS graph should be consistent, somehow recently we have been seeing this issue that the QPS graph suddenly got so bad spikes or dips (value suddenly go down sharply and recovered)
FYI, the graph are generated via grafana which fetching data from prometheus
The strange thing is , when the prometheus service reboot, this situation will recover at once, however after 1~2days , these spikes appears again.
We did some test to prove that the actual QPS never has this kind of sharply drop at anytime, so we consider this should be either a prometheus hidden bug or metrics issue.
We looking for some help
thanks in advance