Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OOM detection logic doesn't work inside a docker container. #1313

Open
vishh opened this issue May 27, 2016 · 10 comments
Open

OOM detection logic doesn't work inside a docker container. #1313

vishh opened this issue May 27, 2016 · 10 comments

Comments

@vishh
Copy link
Contributor

vishh commented May 27, 2016

Also, after the recent changes, did we test if OOM detection works without journalctl command available?

cc @timstclair

We might have to fix this for k8s v1.3

@luxas
Copy link

luxas commented May 27, 2016

(Just a small note, I don't think the case was inside a container, it was in the localkube vm)
But it might be a bug nonetheless. At least it's confusing in case it's not required

@vishh
Copy link
Contributor Author

vishh commented May 27, 2016

I tried a docker container and it did not work inside the container either!

On Fri, May 27, 2016 at 9:33 AM, Lucas Käldström notifications@github.com
wrote:

(Just a small note, I don't think the case was inside a container, it was
in the localkube vm)
But it might be a bug nonetheless. At least it's confusing in case it's
not required


You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#1313 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AGvIKMuoI9DBKf9SxgNLJYDNIhURtwqmks5qFxzkgaJpZM4IonQd
.

@luxas
Copy link

luxas commented May 27, 2016

Any clue how to solve?

@vishh
Copy link
Contributor Author

vishh commented May 27, 2016

I think cAdvisor is not looking at the relative root path while inside the
container. On the outside, I suspect that not finding journalctl binary
is the cause of the failure.

On Fri, May 27, 2016 at 10:23 AM, Lucas Käldström notifications@github.com
wrote:

Any clue how to solve?


You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#1313 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AGvIKPEG5M_3dC_OlyyqsVkQ2ODg7xrAks5qFyh3gaJpZM4IonQd
.

@luxas
Copy link

luxas commented Jun 3, 2016

@vishh @timstclair Will this be fixed before v1.3?

@vishh
Copy link
Contributor Author

vishh commented Jun 3, 2016 via email

@goettl79
Copy link

goettl79 commented Jan 9, 2017

Testet it with cadvios 0.24.1 by mounting the journalctl binary into the container like this:

--volume=/usr/bin/journalctl:/usr/bin/journalctl:ro

This change makes the oom parser at least start:

manager.go:1082] Started watching for new ooms in manager

However, the shared libraries for journalctl as well as the journalctl data is missing inside the container. I'd suggest to install journalctl in the cadvisor image and actually change the logic that determines if journalctl or syslog is used. My proposal is to change it based on program arguments, not on existence of the journalctl binary.

@vishh
Copy link
Contributor Author

vishh commented Jan 9, 2017 via email

@goettl79
Copy link

goettl79 commented Jan 9, 2017

I think this would not be a dependency to cadvisor, rather a change in the dockerfile.

@vishh
Copy link
Contributor Author

vishh commented Jan 9, 2017 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants