Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unknown reason prometheus's data genedated graphs having spikes dips #2772

Closed
sutest opened this Issue May 26, 2017 · 2 comments

Comments

Projects
None yet
2 participants
@sutest
Copy link

sutest commented May 26, 2017

image

As seen from the screenshot , it's a graph showing nginx QPS which collected from prometheus_nginx_exporter (this exporter fetch data by tail log file function)

Normally this QPS graph should be consistent, somehow recently we have been seeing this issue that the QPS graph suddenly got so bad spikes or dips (value suddenly go down sharply and recovered)

FYI, the graph are generated via grafana which fetching data from prometheus

The strange thing is , when the prometheus service reboot, this situation will recover at once, however after 1~2days , these spikes appears again.

We did some test to prove that the actual QPS never has this kind of sharply drop at anytime, so we consider this should be either a prometheus hidden bug or metrics issue.

We looking for some help

thanks in advance

@brian-brazil

This comment has been minimized.

Copy link
Member

brian-brazil commented Jul 14, 2017

This is probably an oddness in your enviroment, looking into it is best done on https://groups.google.com/forum/#!forum/prometheus-users

@lock

This comment has been minimized.

Copy link

lock bot commented Mar 23, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Mar 23, 2019

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
You can’t perform that action at this time.