Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

omit data #3514

Closed
timchenxiaoyu opened this Issue Nov 27, 2017 · 7 comments

Comments

Projects
None yet
5 participants
@timchenxiaoyu
Copy link

timchenxiaoyu commented Nov 27, 2017

prometheus 2.0.0 +k8s 1.7.6

curl http://10.39.0.113:10009/api/v1/query?query=container_memory_usage_bytes&time=1511761470.963

get metric ,sometime pod metric disappear

@timchenxiaoyu

This comment has been minimized.

Copy link
Author

timchenxiaoyu commented Nov 27, 2017

wx20171127-135358 2x

@timchenxiaoyu

This comment has been minimized.

Copy link
Author

timchenxiaoyu commented Nov 27, 2017

omit data, and no error log??

@gouthamve

This comment has been minimized.

Copy link
Member

gouthamve commented Nov 27, 2017

Hi, I think this is due to the new staleness changes and cAdvisor spitting out inconsistent metrics. See google/cadvisor#1704 and #2982.

Closing it off as a cAdvisor issue.

@gouthamve gouthamve closed this Nov 27, 2017

@timchenxiaoyu timchenxiaoyu changed the title namespace disappear omit data Nov 27, 2017

@m4agenbitter

This comment has been minimized.

Copy link

m4agenbitter commented Nov 28, 2017

@gouthamve I'm running into the same issue with an custom exporter.

I only scrape it every 10 minutes (wich is enough for my use case), but they will get reported as stale after 5 minutes.
However they aren't really stale at that point.

Can I change the default value of 5 minutes?

@brian-brazil

This comment has been minimized.

Copy link
Member

brian-brazil commented Nov 28, 2017

It makes more sense to ask questions like this on the prometheus-users mailing list rather than in a GitHub issue. On the mailing list, more people are available to potentially respond to your question, and the whole community can benefit from the answers provided.

@dashpole

This comment has been minimized.

Copy link

dashpole commented Dec 7, 2017

The fix is released in version v0.28.3

@lock

This comment has been minimized.

Copy link

lock bot commented Mar 23, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Mar 23, 2019

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
You can’t perform that action at this time.